Datadog Launches Observability Pipelines
June 21, 2022
Share this

Datadog announced the launch of Datadog Observability Pipelines—a new product that enables organizations to take greater control of their data so they can reliably scale their observability practices.

Datadog Observability Pipelines is powered by Vector, an open source and high-performance framework for building telemetry pipelines.

Datadog Observability Pipelines provides customers with a unified view to control and monitor the flow of all their infrastructure and application metrics, logs and traces. Users can now seamlessly collect, enrich, transform, sanitize and route observability data from any source to any destination—before data leaves their environment. This unified view gives enterprises enhanced visibility into how much they are spending and where, what tools they are leveraging and who has access to what data. This enables them to more precisely manage costs, reduce technology lock-in, improve compliance and standardization of data quality and ultimately scale their observability practices.

“As the amount of telemetry continues to grow at an organization, teams are often completely overwhelmed—if they’re not blind to—the runaway costs, reliability and compliance risks that come from a lack of visibility into infrastructure and application data,” said Zach Sherman, Senior Product Manager at Datadog. “We built Datadog Observability Pipelines to give organizations a powerful way to take back control of their data, without compromising visibility for engineering, security and SRE teams.”

Datadog Observability Pipelines helps IT and security teams in their goals to affordably manage and scale observability with complete flexibility and control over how their logs, metrics and traces are collected, transformed and routed. This helps organizations:

- Control Costs: Aggregate, filter and route all observability data based on use case without compromising visibility

- Simplify Migrations and Reduce Lock-In: Orchestrate and monitor data processing from any source to any destination in one unified view

- Protect Sensitive Data: Filter, redact and monitor sensitive data before it leaves your network in order to better meet compliance requirements

- Enforce Data Quality: Standardize the format of logs, metrics and traces to improve observability across teams

- Scale with Confidence: Scale seamlessly with a product powered by Vector, a vendor-agnostic, open source project and engaged community with millions of monthly downloads that is deployed in production by enterprises processing petabytes of data every month

- Easily Collect and Route Data: Observability Pipelines comes with more than 80 out-of-the-box integrations so organizations can quickly and easily collect and route data to any of the tools their teams already use, without disrupting existing workflows

Datadog Observability Pipelines is generally available now.

Share this

The Latest

September 30, 2022

For businesses with vast and distributed computing infrastructures, one of the main objectives of IT and network operations is to locate the cause of a service condition that is having an impact. The more human resources are put into the task of gathering, processing, and finally visual monitoring the massive volumes of event and log data that serve as the main source of symptomatic indications for emerging crises, the closer the service is to the company's source of revenue ...

September 29, 2022

Our digital economy is intolerant of downtime. But consumers haven't just come to expect always-on digital apps and services. They also expect continuous innovation, new functionality and lightening fast response times. Organizations have taken note, investing heavily in teams and tools that supposedly increase uptime and free resources for innovation. But leaders have not realized this "throw money at the problem" approach to monitoring is burning through resources without much improvement in availability outcomes ...

September 28, 2022

Although 83% of businesses are concerned about a recession in 2023, B2B tech marketers can look forward to growth — 51% of organizations plan to increase IT budgets in 2023 vs. a narrow 6% that plan to reduce their spend, according to the 2023 State of IT report from Spiceworks Ziff Davis ...

September 27, 2022

Users have high expectations around applications — quick loading times, look and feel visually advanced, with feature-rich content, video streaming, and multimedia capabilities — all of these devour network bandwidth. With millions of users accessing applications and mobile apps from multiple devices, most companies today generate seemingly unmanageable volumes of data and traffic on their networks ...

September 26, 2022

In Italy, it is customary to treat wine as part of the meal ... Too often, testing is treated with the same reverence as the post-meal task of loading the dishwasher, when it should be treated like an elegant wine pairing ...

September 23, 2022

In order to properly sort through all monitoring noise and identify true problems, their causes, and to prioritize them for response by the IT team, they have created and built a revolutionary new system using a meta-cognitive model ...

September 22, 2022

As we shift further into a digital-first world, where having a reliable online experience becomes more essential, Site Reliability Engineers remain in-demand among organizations of all sizes ... This diverse set of skills and values can be difficult to interview for. In this blog, we'll get you started with some example questions and processes to find your ideal SRE ...

September 21, 2022

US government agencies are bringing more of their employees back into the office and implementing hybrid work schedules, but federal workers are worried that their agencies' IT architectures aren't built to handle the "new normal." They fear that the reactive, manual methods used by the current systems in dealing with user, IT architecture and application problems will degrade the user experience and negatively affect productivity. In fact, according to a recent survey, many federal employees are concerned that they won't work as effectively back in the office as they did at home ...

September 20, 2022

Users today expect a seamless, uninterrupted experience when interacting with their web and mobile apps. Their expectations have continued to grow in tandem with their appetite for new features and consistent updates. Mobile apps have responded by increasing their release cadence by up to 40%, releasing a new full version of their app every 4-5 days, as determined in this year's SmartBear State of Software Quality | Application Stability Index report ...

September 19, 2022

In this second part of the blog series, we look at how adopting AIOps capabilities can drive business value for an organization ...