IT Operations Unsatisfied with APM and BSM, Survey Says
February 18, 2013
Share this

More than half (63%) of senior IT operations executives are dissatisfied with their Application Performance Monitoring (APM) solutions, and 75% are dissatisfied with their Business Service Monitoring (BSM) solutions, according to a new BlueStripe survey of Fortune 500 companies.

While reasons vary, a common theme is the inability of these tools to keep pace with the make-up of applications both in the data center and within public and hybrid cloud environments.

Top reasons for dissatisfaction with APM tools, according to the survey, include an inability to support all applications or track all application components; metrics that are too developer-centric; difficult tool integration; and the simple fact that the tools do not actually help IT solve problems.

The problems cited with BSM tools include manpower requirements to keep service models up to date; lack of root cause analysis; too many alerts; difficult integration with other tools; and limited alerting for service level issues.

The survey highlighted three key trends in IT Operations:

- Current IT Operations processes for application monitoring and problem solving are both ineffective and manpower intensive

- IT Operations leaders are dissatisfied with their current set of performance monitoring and management tools

- Enterprise companies are hesitant to move mission-critical transactional applications to the cloud until processes and tools become more effective

“As companies continue to incorporate new technologies into their applications, the inability of conventional APM and BSM tools to keep up is taking its toll on IT Operations,” said Chris Neal, BlueStripe co-founder and CEO. “We were surprised to learn that in 2013, 81 percent of companies still have more than a quarter of their application issues go un-resolved, even with APM and BSM tools.”

Additional results from the survey:

- 68% of respondents reported failing to identify at least 1 in 10 business impacting incidents before users did

- 36% of respondents reported learning about more than 25% of problems from end user complaints

- Only 8% of respondents have a monitoring framework that both aggregates alerts and provides appropriate application and service level context for interpreting and acting on those alerts

- 92% of of respondents either have fragmented monitoring, using separate tools, or basic integrated monitoring, which does not correlate alerts to service level issues

- 52% of respondents reported that the standard process for fixing outages is a bridge call - which in large organizations can involve more than 50 individuals

- Companies using bridge calls as the primary approach reported the lowest success rates, with only 14% solving outages quickly

- Companies that used smaller teams for problem solving reported a greater success rate, with 29% able to solve outages quickly

Survey results also indicated a sharp contrast in attitudes regarding virtualization and private cloud versus public and hybrid cloud deployments for critical applications. In last year’s (January 2012) survey, IT Operations executives indicated that they viewed virtualization and private cloud as “just another technology” to be managed within their application architecture. The 2013 results build on this, showing widespread adoption of virtualization and private cloud.

In contrast, attitudes toward public and hybrid cloud among large company IT operations executives were distinctly skeptical. Despite the rapid growth of public cloud services like Amazon Web Services (AWS) and Microsoft Azure, large companies are explicitly avoiding critical application deployments using public and hybrid cloud, in part due to the limited ability of APM and BSM tools to monitor and manage new technologies.

About the Survey

BlueStripe Software surveyed senior IT Operations executives at 166 large US-based companies in early 2013.

Share this

The Latest

October 17, 2019

As the data generated by organizations grows, APM tools are now required to do a lot more than basic monitoring of metrics. Modern data is often raw and unstructured and requires more advanced methods of analysis. The tools must help dig deep into this data for both forensic analysis and predictive analysis. To extract more accurate and cheaper insights, modern APM tools use Big Data techniques to store, access, and analyze the multi-dimensional data ...

October 16, 2019

Modern enterprises are generating data at an unprecedented rate but aren't taking advantage of all the data available to them in order to drive real-time, actionable insights. According to a recent study commissioned by Actian, more than half of enterprises today are unable to efficiently manage nor effectively use data to drive decision-making ...

October 15, 2019

According to a study by Forrester Research, an enhanced UX design can increase the conversion rate by 400%. If UX has become the ultimate arbiter in determining the success or failure of a product or service, let us first understand what UX is all about ...

October 10, 2019

The requirements of an APM tool are now much more complex than they've ever been. Not only do they need to trace a user transaction across numerous microservices on the same system, but they also need to happen pretty fast ...

October 09, 2019

Performance monitoring is an old problem. As technology has advanced, we've had to evolve how we monitor applications. Initially, performance monitoring largely involved sending ICMP messages to start troubleshooting a down or slow application. Applications have gotten much more complex, so this is no longer enough. Now we need to know not just whether an application is broken, but why it broke. So APM has had to evolve over the years for us to get there. But how did this evolution take place, and what happens next? Let's find out ...

October 08, 2019

There are some IT organizations that are using DevOps methodology but are wary of getting bogged down in ITSM procedures. But without at least some ITSM controls in place, organizations lose their focus on systematic customer engagement, making it harder for them to scale ...

October 07, 2019
OK, I admit it. "Service modeling" is an awkward term, especially when you're trying to frame three rather controversial acronyms in the same overall place: CMDB, CMS and DDM. Nevertheless, that's exactly what we did in EMA's most recent research: <span style="font-style: italic;">Service Modeling in the Age of Cloud and Containers</span>. The goal was to establish a more holistic context for looking at the synergies and differences across all these areas ...
October 03, 2019

If you have deployed a Java application in production, you've probably encountered a situation where the application suddenly starts to take up a large amount of CPU. When this happens, application response becomes sluggish and users begin to complain about slow response. Often the solution to this problem is to restart the application and, lo and behold, the problem goes away — only to reappear a few days later. A key question then is: how to troubleshoot high CPU usage of a Java application? ...

October 02, 2019

Operations are no longer tethered tightly to a main office, as the headquarters-centric model has been retired in favor of a more decentralized enterprise structure. Rather than focus the business around a single location, enterprises are now comprised of a web of remote offices and individuals, where network connectivity has broken down the geographic barriers that in the past limited the availability of talent and resources. Key to the success of the decentralized enterprise model is a new generation of collaboration and communication tools ...

October 01, 2019

To better understand the AI maturity of businesses, Dotscience conducted a survey of 500 industry professionals. Research findings indicate that although enterprises are dedicating significant time and resources towards their AI deployments, many data science and ML teams don't have the adequate tools needed to properly collaborate on, build and deploy AI models efficiently ...