IT Operations Unsatisfied with APM and BSM, Survey Says

More than half (63%) of senior IT operations executives are dissatisfied with their Application Performance Monitoring (APM) solutions, and 75% are dissatisfied with their Business Service Monitoring (BSM) solutions, according to a new BlueStripe survey of Fortune 500 companies.

While reasons vary, a common theme is the inability of these tools to keep pace with the make-up of applications both in the data center and within public and hybrid cloud environments.

Top reasons for dissatisfaction with APM tools, according to the survey, include an inability to support all applications or track all application components; metrics that are too developer-centric; difficult tool integration; and the simple fact that the tools do not actually help IT solve problems.

The problems cited with BSM tools include manpower requirements to keep service models up to date; lack of root cause analysis; too many alerts; difficult integration with other tools; and limited alerting for service level issues.

The survey highlighted three key trends in IT Operations:

- Current IT Operations processes for application monitoring and problem solving are both ineffective and manpower intensive

- IT Operations leaders are dissatisfied with their current set of performance monitoring and management tools

- Enterprise companies are hesitant to move mission-critical transactional applications to the cloud until processes and tools become more effective

“As companies continue to incorporate new technologies into their applications, the inability of conventional APM and BSM tools to keep up is taking its toll on IT Operations,” said Chris Neal, BlueStripe co-founder and CEO. “We were surprised to learn that in 2013, 81 percent of companies still have more than a quarter of their application issues go un-resolved, even with APM and BSM tools.”

Additional results from the survey:

- 68% of respondents reported failing to identify at least 1 in 10 business impacting incidents before users did

- 36% of respondents reported learning about more than 25% of problems from end user complaints

- Only 8% of respondents have a monitoring framework that both aggregates alerts and provides appropriate application and service level context for interpreting and acting on those alerts

- 92% of of respondents either have fragmented monitoring, using separate tools, or basic integrated monitoring, which does not correlate alerts to service level issues

- 52% of respondents reported that the standard process for fixing outages is a bridge call - which in large organizations can involve more than 50 individuals

- Companies using bridge calls as the primary approach reported the lowest success rates, with only 14% solving outages quickly

- Companies that used smaller teams for problem solving reported a greater success rate, with 29% able to solve outages quickly

Survey results also indicated a sharp contrast in attitudes regarding virtualization and private cloud versus public and hybrid cloud deployments for critical applications. In last year’s (January 2012) survey, IT Operations executives indicated that they viewed virtualization and private cloud as “just another technology” to be managed within their application architecture. The 2013 results build on this, showing widespread adoption of virtualization and private cloud.

In contrast, attitudes toward public and hybrid cloud among large company IT operations executives were distinctly skeptical. Despite the rapid growth of public cloud services like Amazon Web Services (AWS) and Microsoft Azure, large companies are explicitly avoiding critical application deployments using public and hybrid cloud, in part due to the limited ability of APM and BSM tools to monitor and manage new technologies.

About the Survey

BlueStripe Software surveyed senior IT Operations executives at 166 large US-based companies in early 2013.

Hot Topics

The Latest

Exploring AI Observability – Part 5: Roles

AI observability serves several roles across an organization. AI engineers use it to build, evaluate, and improve AI systems. SREs use it to operate those systems reliably and efficiently in production, including managing their cost. Leaders need it to connect AI behavior and operational performance to business outcomes. The common need is a clear understanding of whether AI systems are delivering the intended result ...

Exploring AI Observability – Part 4: Challenges

Part 4 outlines the challenges enterprise face when adopting AI observability. The main challenge is that AI complexity compounds at every stage of maturity. LLM-based applications introduce new behavior, dependencies, and quality considerations, while Agentic AI adds further failure modes as systems make decisions and take actions ...

Exploring AI Observability – Part 3: The Current State of AI Observability

Part 3 reports on the current state of AI observability. Most experts agree: enterprises are moving faster with AI than they are with the operational discipline needed to run it safely ...

Exploring AI Observability – Part 2: Traditional vs. AI Observability

When discussing AI Observability, one of the first questions that arises: Is this just an extension of traditional observability or is this a whole new type of tool? Part 2 compares traditional observability with AI observability ...

Exploring AI Observability – Part 1: Why It Matters

In this extensive 14-part series that will post over the next three weeks, experts across observability and AI will provide insight and opinions on the need for AI Observability, the challenges, the benefits, the current state, and predictions for the future ...

AgenticOps Scaling Quickly in the Enterprise

Amid rising complexity, organizations are moving quickly toward agent-driven operations: AgenticOps, according to The Impact of Agentic AI on Network Operations, a new report from Cisco ...

Why Better Technology Won't Fix a Broken Workflow

AI, automation, and enterprise software give organizations an extraordinary amount of leverage. Work that once required hours can happen in minutes. Information buried across systems can be analyzed almost instantly. Complex workflows can be coordinated across teams with far less manual intervention. That leverage creates a temptation to start with the technology ...

What If AI's Biggest Competitive Advantage Isn't the Model?

Everyone wants to talk about models. Compute clusters. Benchmark scores that climb a fraction of a point and make headlines anyway. It's an easy conversation to have because it's measurable. But it's also increasingly beside the point ...

Why Going All-In on Cloud No Longer Works in the Age of AI

For more than a decade, the default infrastructure play has been simple. Move more workloads to the cloud, retire on-premises gear and treat the data center as a cost to shrink. That logic held while public cloud offered near-limitless capacity at predictable prices, and AI demand is now testing both halves of that assumption ...

Visibility Is Not a Strategy - What Matters Is What Happens Next

Most enterprise IT leaders can tell you exactly how many applications are running across their organization. They can surface a dashboard showing telecom spend by region, pull a report on SaaS license utilization, or call up a real-time view of mobile device inventory. The data is there, and IT leaders have largely delivered on the promise of visibility. Yet, in most organizations, that visibility has not translated into business value ...

IT Operations Unsatisfied with APM and BSM, Survey Says

More than half (63%) of senior IT operations executives are dissatisfied with their Application Performance Monitoring (APM) solutions, and 75% are dissatisfied with their Business Service Monitoring (BSM) solutions, according to a new BlueStripe survey of Fortune 500 companies.

While reasons vary, a common theme is the inability of these tools to keep pace with the make-up of applications both in the data center and within public and hybrid cloud environments.

Top reasons for dissatisfaction with APM tools, according to the survey, include an inability to support all applications or track all application components; metrics that are too developer-centric; difficult tool integration; and the simple fact that the tools do not actually help IT solve problems.

The problems cited with BSM tools include manpower requirements to keep service models up to date; lack of root cause analysis; too many alerts; difficult integration with other tools; and limited alerting for service level issues.

The survey highlighted three key trends in IT Operations:

- Current IT Operations processes for application monitoring and problem solving are both ineffective and manpower intensive

- IT Operations leaders are dissatisfied with their current set of performance monitoring and management tools

- Enterprise companies are hesitant to move mission-critical transactional applications to the cloud until processes and tools become more effective

“As companies continue to incorporate new technologies into their applications, the inability of conventional APM and BSM tools to keep up is taking its toll on IT Operations,” said Chris Neal, BlueStripe co-founder and CEO. “We were surprised to learn that in 2013, 81 percent of companies still have more than a quarter of their application issues go un-resolved, even with APM and BSM tools.”

Additional results from the survey:

- 68% of respondents reported failing to identify at least 1 in 10 business impacting incidents before users did

- 36% of respondents reported learning about more than 25% of problems from end user complaints

- Only 8% of respondents have a monitoring framework that both aggregates alerts and provides appropriate application and service level context for interpreting and acting on those alerts

- 92% of of respondents either have fragmented monitoring, using separate tools, or basic integrated monitoring, which does not correlate alerts to service level issues

- 52% of respondents reported that the standard process for fixing outages is a bridge call - which in large organizations can involve more than 50 individuals

- Companies using bridge calls as the primary approach reported the lowest success rates, with only 14% solving outages quickly

- Companies that used smaller teams for problem solving reported a greater success rate, with 29% able to solve outages quickly

Survey results also indicated a sharp contrast in attitudes regarding virtualization and private cloud versus public and hybrid cloud deployments for critical applications. In last year’s (January 2012) survey, IT Operations executives indicated that they viewed virtualization and private cloud as “just another technology” to be managed within their application architecture. The 2013 results build on this, showing widespread adoption of virtualization and private cloud.

In contrast, attitudes toward public and hybrid cloud among large company IT operations executives were distinctly skeptical. Despite the rapid growth of public cloud services like Amazon Web Services (AWS) and Microsoft Azure, large companies are explicitly avoiding critical application deployments using public and hybrid cloud, in part due to the limited ability of APM and BSM tools to monitor and manage new technologies.

About the Survey

BlueStripe Software surveyed senior IT Operations executives at 166 large US-based companies in early 2013.

Hot Topics

The Latest

Exploring AI Observability – Part 5: Roles

AI observability serves several roles across an organization. AI engineers use it to build, evaluate, and improve AI systems. SREs use it to operate those systems reliably and efficiently in production, including managing their cost. Leaders need it to connect AI behavior and operational performance to business outcomes. The common need is a clear understanding of whether AI systems are delivering the intended result ...

Exploring AI Observability – Part 4: Challenges

Part 4 outlines the challenges enterprise face when adopting AI observability. The main challenge is that AI complexity compounds at every stage of maturity. LLM-based applications introduce new behavior, dependencies, and quality considerations, while Agentic AI adds further failure modes as systems make decisions and take actions ...

Exploring AI Observability – Part 3: The Current State of AI Observability

Part 3 reports on the current state of AI observability. Most experts agree: enterprises are moving faster with AI than they are with the operational discipline needed to run it safely ...

Exploring AI Observability – Part 2: Traditional vs. AI Observability

When discussing AI Observability, one of the first questions that arises: Is this just an extension of traditional observability or is this a whole new type of tool? Part 2 compares traditional observability with AI observability ...

Exploring AI Observability – Part 1: Why It Matters

In this extensive 14-part series that will post over the next three weeks, experts across observability and AI will provide insight and opinions on the need for AI Observability, the challenges, the benefits, the current state, and predictions for the future ...

AgenticOps Scaling Quickly in the Enterprise

Amid rising complexity, organizations are moving quickly toward agent-driven operations: AgenticOps, according to The Impact of Agentic AI on Network Operations, a new report from Cisco ...

Why Better Technology Won't Fix a Broken Workflow

AI, automation, and enterprise software give organizations an extraordinary amount of leverage. Work that once required hours can happen in minutes. Information buried across systems can be analyzed almost instantly. Complex workflows can be coordinated across teams with far less manual intervention. That leverage creates a temptation to start with the technology ...

What If AI's Biggest Competitive Advantage Isn't the Model?

Everyone wants to talk about models. Compute clusters. Benchmark scores that climb a fraction of a point and make headlines anyway. It's an easy conversation to have because it's measurable. But it's also increasingly beside the point ...

Why Going All-In on Cloud No Longer Works in the Age of AI

For more than a decade, the default infrastructure play has been simple. Move more workloads to the cloud, retire on-premises gear and treat the data center as a cost to shrink. That logic held while public cloud offered near-limitless capacity at predictable prices, and AI demand is now testing both halves of that assumption ...

Visibility Is Not a Strategy - What Matters Is What Happens Next

Most enterprise IT leaders can tell you exactly how many applications are running across their organization. They can surface a dashboard showing telecom spend by region, pull a report on SaaS license utilization, or call up a real-time view of mobile device inventory. The data is there, and IT leaders have largely delivered on the promise of visibility. Yet, in most organizations, that visibility has not translated into business value ...