StreamSets Transformer for Snowflake Released
June 14, 2022
Share this

StreamSets announced the general availability of the newest engine in the StreamSets DataOps Platform, StreamSets Transformer for Snowflake.

The new engine provides a unique combination of power and ease-of-use for data engineers to build, operate and monitor smart data pipelines for the Snowflake Data Cloud

“The Transformer for Snowflake engine is a prime example of how Snowpark is broadening the depth of use cases on the Data Cloud,” said Tarik Dwiek, Head of Technology Alliances at Snowflake. “By pairing the powerful extensibility of Snowpark with StreamSets’ smart data pipelines, we are extending the Data Cloud to ELT and advanced transformation use cases.”

StreamSets Transformer for Snowflake is the newest engine in the StreamSets DataOps platform delivering advanced data transformation functionality on Snowflake, natively. Transformer for Snowflake an enterprise-grade transformation engine built on Snowpark, combining the power and extensibility of the Snowflake Data Cloud with the data integration capabilities of StreamSets. This new engine combined with StreamSets existing capabilities for batch, streaming, and change data capture (CDC) aims to cover the full lifecycle of modern cloud data engineering use cases.

StreamSets is a Snowflake Premier Technology Partner, Snowpark Accelerated, and Snowflake Ready partner. The company has seen early traction in partnership with the launch of Snowpark. The new engine extends the powerful functionality of the Data Cloud and allows data engineers to go beyond SQL to express powerful data transformation logic with the StreamSets DataOps Platform to conform and cleanse data.

“Data collection and transformation is a critical component of the digital backbone, especially in hybrid and multi-cloud environments” said Girish Pancha, CEO of StreamSets. “Transformer for Snowflake offers a scalable and powerful engine for complex native transformations in the Snowflake Data Cloud removing the technical debt enterprises experience moving data across cloud systems.”

Transformer for Snowflake is available now.

Share this

The Latest

September 30, 2022

For businesses with vast and distributed computing infrastructures, one of the main objectives of IT and network operations is to locate the cause of a service condition that is having an impact. The more human resources are put into the task of gathering, processing, and finally visual monitoring the massive volumes of event and log data that serve as the main source of symptomatic indications for emerging crises, the closer the service is to the company's source of revenue ...

September 29, 2022

Our digital economy is intolerant of downtime. But consumers haven't just come to expect always-on digital apps and services. They also expect continuous innovation, new functionality and lightening fast response times. Organizations have taken note, investing heavily in teams and tools that supposedly increase uptime and free resources for innovation. But leaders have not realized this "throw money at the problem" approach to monitoring is burning through resources without much improvement in availability outcomes ...

September 28, 2022

Although 83% of businesses are concerned about a recession in 2023, B2B tech marketers can look forward to growth — 51% of organizations plan to increase IT budgets in 2023 vs. a narrow 6% that plan to reduce their spend, according to the 2023 State of IT report from Spiceworks Ziff Davis ...

September 27, 2022

Users have high expectations around applications — quick loading times, look and feel visually advanced, with feature-rich content, video streaming, and multimedia capabilities — all of these devour network bandwidth. With millions of users accessing applications and mobile apps from multiple devices, most companies today generate seemingly unmanageable volumes of data and traffic on their networks ...

September 26, 2022

In Italy, it is customary to treat wine as part of the meal ... Too often, testing is treated with the same reverence as the post-meal task of loading the dishwasher, when it should be treated like an elegant wine pairing ...

September 23, 2022

In order to properly sort through all monitoring noise and identify true problems, their causes, and to prioritize them for response by the IT team, they have created and built a revolutionary new system using a meta-cognitive model ...

September 22, 2022

As we shift further into a digital-first world, where having a reliable online experience becomes more essential, Site Reliability Engineers remain in-demand among organizations of all sizes ... This diverse set of skills and values can be difficult to interview for. In this blog, we'll get you started with some example questions and processes to find your ideal SRE ...

September 21, 2022

US government agencies are bringing more of their employees back into the office and implementing hybrid work schedules, but federal workers are worried that their agencies' IT architectures aren't built to handle the "new normal." They fear that the reactive, manual methods used by the current systems in dealing with user, IT architecture and application problems will degrade the user experience and negatively affect productivity. In fact, according to a recent survey, many federal employees are concerned that they won't work as effectively back in the office as they did at home ...

September 20, 2022

Users today expect a seamless, uninterrupted experience when interacting with their web and mobile apps. Their expectations have continued to grow in tandem with their appetite for new features and consistent updates. Mobile apps have responded by increasing their release cadence by up to 40%, releasing a new full version of their app every 4-5 days, as determined in this year's SmartBear State of Software Quality | Application Stability Index report ...

September 19, 2022

In this second part of the blog series, we look at how adopting AIOps capabilities can drive business value for an organization ...