The Future of Big Data APM in 2022

Recent data shows that the global APM (application performance management) market is booming. Currently valued at $6.3 billion, the global APM industry is expected to reach $12 billion by 2026. This growth indicates the increasing importance of monitoring, diagnosing, and improving application performance.

Visibility and automation is key to sustaining the growth and evolution of APM. Speaking to APMdigest, Pepperdata CEO Ash Munshi delved deeper into why he thinks visibility and automation are the future of APM well into 2022.

The Big Shift to the Cloud Continues

By the end of 2021, nearly 70% of all enterprises' infrastructure was slated to become cloud based. By now, more than 80% of business organizations say they already have implemented or are planning to implement a multi-cloud strategy. In addition, 82% of workloads will be moved to the cloud.

Drivers of this shift include the ubiquity of mobile devices, as well as the growing need for online collaboration, remote work, and new digital services to support a hybrid workforce. Recent disruptions and the need to accelerate digital transformation hard pressed 90% of enterprises to increase their cloud usage.

Ash Munshi expects to see this trend continue to expand in 2022. Global cloud adoption will continue on a very rapid and massive scale in the immediate future. Global spend on public cloud services will go over $480 billion in 2022.

The Cloud's Complexity Will Grow, Too

"In the beginning, the cloud made everything easier. However, cloud complexity has increased dramatically," Ash Munshi told APMdigest. Enterprises are forced to increase their spending because they failed to anticipate the extra capacity needed to run their current cloud-based applications. As their cloud usage intensifies, so do the compute requirements of their applications and workloads.

Some key reasons why organizations accelerate their cloud migration are reducing their headcount, eliminating the difficulties of accessing data center facilities, and avoiding hardware supply chain delays.

However, many enterprises fail to realize how extremely complex cloud computing is. This has caused organizations to exceed their cloud budget by as much as 40%. In very extreme cases, enterprises that can't handle the challenges of cloud computing are forced to repatriate workloads and applications to their previous settings.

Adding to the cloud's complexity is the daunting number of application stack choices. Enterprises not only struggle to pick the right cloud vendor and the ideal application stack to run, but the current crop of APM solutions are also lacking the visibility and depth needed to help them fully optimize their cloud infrastructure, improve the performance of their big data stacks, and enjoy the promised benefits of cloud computing.

"For compute, there are over 400 different instance types on AWS alone. Add on to that a hybrid solution, and the choices companies need to make to move their data and application explodes," Munshi lamented. Managing application performance in the cloud while staying within their budget is also a formidable challenge for many enterprises.

The Future of APM

The increasing ubiquity of cloud computing and big data, along with its growing complications, necessitate a big overhaul in approach.

"Our approach to the cloud and application performance management must change in response," Ash emphasized.

According to Pepperdata's recent survey, approximately 42% of enterprises rely on their cloud vendors' solutions to monitor their cloud processes and manage their application performance. But this is problematic, as most APM tools are designed to track and measure surface metrics. These solutions don't have the depth and granularity needed by enterprises to look at the application level and truly perform powerful resource allocation and performance optimization at scale.

But Ash Munshi believes that enterprises will recognize this stumbling block and evolve their approach to APM.

The Impact of Visibility and Automation on APM

Most APM tools on the market don't have comprehensive, application-level visibility. When you can't see into your applications, their performance, resource utilization, and more, you can't gain deeper context into your applications. Your big data stack in the cloud is riddled with blind spots.

In one of our earlier surveys, 64% of enterprises highlighted "cost management and containment" as their biggest, most pressing concern with running cloud big data stacks and applications. On top of that, the majority of respondents said they wanted to "better optimize current cloud resources."

"This research shows us the importance of visibility into big data workloads. It also highlights the need for automated optimization as a means to control runaway costs," Ash stressed. APM tools that provide users with visibility and automated optimization help in getting their cloud costs under control.

"Future APM solutions will no longer be just about debugging and tuning on an application-by-application basis," Ash told APMDigest. "The future of application performance management needs visibility and automation to manage your compute, software stack, and ensure that your costs are within budget."

Hot Topics

The Latest

Implementing AI Isn't the Hard Part Anymore - Adoption Is

Two years ago, almost every customer conversation about AI started with the same questions: Which model should we use? What can it do? Is it ready for the enterprise? Today, those discussions have moved on. CIOs are far more interested in how to govern AI, integrate it with existing systems, prepare their workforce and make it part of everyday operations. The challenge is no longer to prove that AI can deliver value. It's instead about how to embed AI into the business in a way that's secure, scalable and delivers measurable outcomes ...

 

The Incident Load Is Rising, but Recovery Times Aren't Moving

Two things happened to production incidents between 2023 and now, and they did not happen at the same speed. The first is that a class of dependency that barely existed three years ago now accounts for one incident in ten. Incidents disclosed by AI model and AI application providers rose from 1.7% of all disclosed unplanned incidents in 2023 to 10.7% in 2026 year to date, roughly a sixfold rise; that counts only incidents at AI companies themselves, so the true share is higher. The second is that the time to close an incident has not come down ...

Your AI Pipeline May Have a Document Observability Problem

When an AI assistant gives an incomplete or incorrect answer, teams often blame the model. They adjust prompts, switch models, increase context windows or test a new retrieval strategy. However the model may not be a problem. In many enterprise AI workflows, the problem begins inside the document-ingestion pipeline ...

The SIEM Isn't the Problem. Your Telemetry Architecture Is

If you talk to any security or observability teams right now, they're all fighting the same fire: their tooling was built to ingest X, but their sources are pumping Y and soon to be doing Z. The knee-jerk reaction is always the same: we need more platform. However, this reaction is wrong. Let me explain why, because the solution to this problem is foundational, not financial. Instead of hurling yet more money at the problem, make sure you've done what's needed upstream ...

As AI Scales Across Enterprises, Breaking Points Emerge

Rapid AI adoption and the unique ways AI workloads operate is redefining the scope and structure of what these teams must deliver. This shift is forcing organizations to rethink how they manage scale, automation, and control, according to The State of SRE and Platform Engineering 2026, a new report from Dynatrace ...

Preparing Network Infrastructure for AI Starts with the Basics

AI is usually talked about as a software tool, but it also depends heavily on the network behind it. Whether a company is using AI for chatbots, automation, monitoring, analytics, or employee support, all of that information has to move across the network in a reliable and secure way. That means AI is not just an application decision. It is also an infrastructure decision. Before organizations rush into AI, they should ask a simple question: Is our network ready to support it? ...

Agentic Operations Begin with Governed Middleware Access

Enterprise AI often lacks governed access to where business processes actually execute. Without that access, AI agents may be able to reason, but they cannot operate reliably across enterprise workflows. For AI agents to effectively carry out workflows, they will require integration-layer context and controls. Organizations can implement these prerequisites by providing AI with managed access to the middleware layer ...

The Network Data Problem Slowing Down Enterprise AIOps

Enterprise networks rarely behave the same way for very long. A routing adjustment in one region may unexpectedly alter application performance in another. A cloud migration may introduce hidden dependencies that go unnoticed until an outage occurs. All the while, the network is managed by several different teams, each of whom use different tool sets — and as a result, have different views of the network ... There’s usually an engineer who remembers why traffic fails over a certain way between sites, or which transparent firewall was added where. The problem is that human memory cannot scale alongside enterprise-scale networks ...

The Governance Gap Behind AI's Infrastructure Problem

Ask an infrastructure team how confident they are in their ability to govern AI, and most will tell you they've got it handled. A recent survey of 406 IT decision-makers and platform engineering leaders found 86% expressing exactly that confidence. Ask the same group whether they have a formal written AI governance policy, and the number drops to 30%, according to Spacelift's Infrastructure Automation Report ...

MEAN TIME TO INSIGHT Podcast - Episode 27: Observability Unification

In MEAN TIME TO INSIGHT Episode 27, Shamus McGillicuddy, EMA VP of Research, Network Infrastructure and Operations, and Parker Hathcock, EMA Research Director covering IT Service/Operations (ServiceOps), discuss observability unification in modern IT operations ... 

The Future of Big Data APM in 2022

Recent data shows that the global APM (application performance management) market is booming. Currently valued at $6.3 billion, the global APM industry is expected to reach $12 billion by 2026. This growth indicates the increasing importance of monitoring, diagnosing, and improving application performance.

Visibility and automation is key to sustaining the growth and evolution of APM. Speaking to APMdigest, Pepperdata CEO Ash Munshi delved deeper into why he thinks visibility and automation are the future of APM well into 2022.

The Big Shift to the Cloud Continues

By the end of 2021, nearly 70% of all enterprises' infrastructure was slated to become cloud based. By now, more than 80% of business organizations say they already have implemented or are planning to implement a multi-cloud strategy. In addition, 82% of workloads will be moved to the cloud.

Drivers of this shift include the ubiquity of mobile devices, as well as the growing need for online collaboration, remote work, and new digital services to support a hybrid workforce. Recent disruptions and the need to accelerate digital transformation hard pressed 90% of enterprises to increase their cloud usage.

Ash Munshi expects to see this trend continue to expand in 2022. Global cloud adoption will continue on a very rapid and massive scale in the immediate future. Global spend on public cloud services will go over $480 billion in 2022.

The Cloud's Complexity Will Grow, Too

"In the beginning, the cloud made everything easier. However, cloud complexity has increased dramatically," Ash Munshi told APMdigest. Enterprises are forced to increase their spending because they failed to anticipate the extra capacity needed to run their current cloud-based applications. As their cloud usage intensifies, so do the compute requirements of their applications and workloads.

Some key reasons why organizations accelerate their cloud migration are reducing their headcount, eliminating the difficulties of accessing data center facilities, and avoiding hardware supply chain delays.

However, many enterprises fail to realize how extremely complex cloud computing is. This has caused organizations to exceed their cloud budget by as much as 40%. In very extreme cases, enterprises that can't handle the challenges of cloud computing are forced to repatriate workloads and applications to their previous settings.

Adding to the cloud's complexity is the daunting number of application stack choices. Enterprises not only struggle to pick the right cloud vendor and the ideal application stack to run, but the current crop of APM solutions are also lacking the visibility and depth needed to help them fully optimize their cloud infrastructure, improve the performance of their big data stacks, and enjoy the promised benefits of cloud computing.

"For compute, there are over 400 different instance types on AWS alone. Add on to that a hybrid solution, and the choices companies need to make to move their data and application explodes," Munshi lamented. Managing application performance in the cloud while staying within their budget is also a formidable challenge for many enterprises.

The Future of APM

The increasing ubiquity of cloud computing and big data, along with its growing complications, necessitate a big overhaul in approach.

"Our approach to the cloud and application performance management must change in response," Ash emphasized.

According to Pepperdata's recent survey, approximately 42% of enterprises rely on their cloud vendors' solutions to monitor their cloud processes and manage their application performance. But this is problematic, as most APM tools are designed to track and measure surface metrics. These solutions don't have the depth and granularity needed by enterprises to look at the application level and truly perform powerful resource allocation and performance optimization at scale.

But Ash Munshi believes that enterprises will recognize this stumbling block and evolve their approach to APM.

The Impact of Visibility and Automation on APM

Most APM tools on the market don't have comprehensive, application-level visibility. When you can't see into your applications, their performance, resource utilization, and more, you can't gain deeper context into your applications. Your big data stack in the cloud is riddled with blind spots.

In one of our earlier surveys, 64% of enterprises highlighted "cost management and containment" as their biggest, most pressing concern with running cloud big data stacks and applications. On top of that, the majority of respondents said they wanted to "better optimize current cloud resources."

"This research shows us the importance of visibility into big data workloads. It also highlights the need for automated optimization as a means to control runaway costs," Ash stressed. APM tools that provide users with visibility and automated optimization help in getting their cloud costs under control.

"Future APM solutions will no longer be just about debugging and tuning on an application-by-application basis," Ash told APMDigest. "The future of application performance management needs visibility and automation to manage your compute, software stack, and ensure that your costs are within budget."

Hot Topics

The Latest

Implementing AI Isn't the Hard Part Anymore - Adoption Is

Two years ago, almost every customer conversation about AI started with the same questions: Which model should we use? What can it do? Is it ready for the enterprise? Today, those discussions have moved on. CIOs are far more interested in how to govern AI, integrate it with existing systems, prepare their workforce and make it part of everyday operations. The challenge is no longer to prove that AI can deliver value. It's instead about how to embed AI into the business in a way that's secure, scalable and delivers measurable outcomes ...

 

The Incident Load Is Rising, but Recovery Times Aren't Moving

Two things happened to production incidents between 2023 and now, and they did not happen at the same speed. The first is that a class of dependency that barely existed three years ago now accounts for one incident in ten. Incidents disclosed by AI model and AI application providers rose from 1.7% of all disclosed unplanned incidents in 2023 to 10.7% in 2026 year to date, roughly a sixfold rise; that counts only incidents at AI companies themselves, so the true share is higher. The second is that the time to close an incident has not come down ...

Your AI Pipeline May Have a Document Observability Problem

When an AI assistant gives an incomplete or incorrect answer, teams often blame the model. They adjust prompts, switch models, increase context windows or test a new retrieval strategy. However the model may not be a problem. In many enterprise AI workflows, the problem begins inside the document-ingestion pipeline ...

The SIEM Isn't the Problem. Your Telemetry Architecture Is

If you talk to any security or observability teams right now, they're all fighting the same fire: their tooling was built to ingest X, but their sources are pumping Y and soon to be doing Z. The knee-jerk reaction is always the same: we need more platform. However, this reaction is wrong. Let me explain why, because the solution to this problem is foundational, not financial. Instead of hurling yet more money at the problem, make sure you've done what's needed upstream ...

As AI Scales Across Enterprises, Breaking Points Emerge

Rapid AI adoption and the unique ways AI workloads operate is redefining the scope and structure of what these teams must deliver. This shift is forcing organizations to rethink how they manage scale, automation, and control, according to The State of SRE and Platform Engineering 2026, a new report from Dynatrace ...

Preparing Network Infrastructure for AI Starts with the Basics

AI is usually talked about as a software tool, but it also depends heavily on the network behind it. Whether a company is using AI for chatbots, automation, monitoring, analytics, or employee support, all of that information has to move across the network in a reliable and secure way. That means AI is not just an application decision. It is also an infrastructure decision. Before organizations rush into AI, they should ask a simple question: Is our network ready to support it? ...

Agentic Operations Begin with Governed Middleware Access

Enterprise AI often lacks governed access to where business processes actually execute. Without that access, AI agents may be able to reason, but they cannot operate reliably across enterprise workflows. For AI agents to effectively carry out workflows, they will require integration-layer context and controls. Organizations can implement these prerequisites by providing AI with managed access to the middleware layer ...

The Network Data Problem Slowing Down Enterprise AIOps

Enterprise networks rarely behave the same way for very long. A routing adjustment in one region may unexpectedly alter application performance in another. A cloud migration may introduce hidden dependencies that go unnoticed until an outage occurs. All the while, the network is managed by several different teams, each of whom use different tool sets — and as a result, have different views of the network ... There’s usually an engineer who remembers why traffic fails over a certain way between sites, or which transparent firewall was added where. The problem is that human memory cannot scale alongside enterprise-scale networks ...

The Governance Gap Behind AI's Infrastructure Problem

Ask an infrastructure team how confident they are in their ability to govern AI, and most will tell you they've got it handled. A recent survey of 406 IT decision-makers and platform engineering leaders found 86% expressing exactly that confidence. Ask the same group whether they have a formal written AI governance policy, and the number drops to 30%, according to Spacelift's Infrastructure Automation Report ...

MEAN TIME TO INSIGHT Podcast - Episode 27: Observability Unification

In MEAN TIME TO INSIGHT Episode 27, Shamus McGillicuddy, EMA VP of Research, Network Infrastructure and Operations, and Parker Hathcock, EMA Research Director covering IT Service/Operations (ServiceOps), discuss observability unification in modern IT operations ...