Skip to main content

Franken-Monitoring - A Case of Too Many Tools

Most Organizations Have 11 or more tools to Manage Application Performance
Kalyan Ramanathan

In a recent interview, an IT operations director told us, “We frankly have too many tools, and many of them weren’t performing to our expectations.”

If you are an enterprise ops leader managing complex applications, you can probably relate to that statement. At AppDynamics, we call this “Franken-monitoring,” a situation characterized by many, usually too many, siloed tools — for application, server, database, end-user client, etc. — that provide varying levels of disparate visibility into IT applications.

The challenges with this approach include:

■ Tools have minimal integration or common context, which makes it near impossible to manage the application or its business transactions.

■ Tools are designed for subject-matter experts, so it’s hard to provide value to the ops team as a whole.

■ Tools have high total cost of ownership, since every tool has to be independently procured, installed and managed, and staff have to be trained in their use.

2015 APM Tools Survey Finds That Tools Are Underutilized and Solving Performance Problems is Still a Massive Challenge

We commissioned analyst firm Enterprise Management Associates (EMA) to get to the bottom of this. In the 2015 APM Tools Survey, EMA found that a majority of surveyed enterprises have 11 or more commercial tools in their arsenal to manage application performance.

Nearly two-thirds of respondents report that it takes at least three hours to determine the root cause of performance issues; one-third report that it takes six or more hours to find the source of an issue.

EMA’s survey indicated that the lack of application-focused solutions appears to contribute to current IT challenges, with IT teams often trying to manage modern, complex applications with siloed tools and primarily manual processes. Just about every user of monitoring tools complains about the challenges of having too many tools without any situational awareness. Current approaches to integrate these tools with solutions like MoM (manager of managers) or CMDB (configuration management database) have for the most part failed, because it is hard to stitch together these disparate solutions from different vendors.

Gartner recently did a survey that pointed exactly to this challenge. The key reasons (besides price) for poor APM adoption were, indeed, the complexity of the tools and poor integration between tools.

Specifically, the EMA study found:

■ Siloed and shelved monitoring tools: 65 percent of the companies surveyed indicated that they own more than 10 different commercial monitoring products. Nearly half also indicated that 50 percent or fewer of their purchased tools are actively being used.

■ Manual resources expended on application support: According to respondents, calls from users are the second-most frequent way IT organizations find out about application-related problems (27 percent cited detection by monitoring centers; 25 percent cited user calls). Line staff, those closest to the problem, report a significantly higher incidence, citing user calls as their first “heads up” 35 percent of the time.

■ Extensive people-hours required to solve a single application problem: IT organizations surveyed indicated that, for those application-related problems escalated beyond Level 1 support, mean time to repair (MTTR) is most often between five and seven hours; in addition, between three and four people are typically required to solve a given problem.

“Based on our findings, the majority of companies are still trying to manage complex applications with a combination of siloed tools, ‘all hands on deck’ interactive marathons, and tribal knowledge,” said Julie Craig, Research Director, Application Management at EMA. “The ability to automatically discover and manage the business transaction topology as the application itself changes is a significant challenge encountered by virtually every IT organization.”

In addition to EMA’s finding that most companies have under-invested in application-specific management tools, the survey also found clear purchasing preferences regarding future APM purchases:

■ Almost 75 percent identified “flexible deployment options” (supporting SaaS, on-premises, and/or hybrid deployments) as either “critical or important” factors for purchasing an APM solution.

■ More than 70 percent identified the “ability to monitor infrastructure as a service (IaaS) public cloud” as either critical or important.

■ When asked about their top “must have” features for an APM product purchase, respondents selected the following:

#1 feature preference: An integrated monitoring platform consolidating application and infrastructure monitoring in one solution

#2 feature preference: Cloud-readiness features necessary to monitor/manage application components hosted in public cloud

#3 feature preference: Support for trending and reporting

The EMA study shows that very few IT organizations have an accurate, comprehensive view of today’s complex application environment, business transactions and their dependencies. Unified Monitoring is a new way to manage applications proactively, by tracing and monitoring transactions from the end user through the entire application and infrastructure environment to help quickly and proactively solve performance issues and ensure excellent user experience. Companies no longer need to waste valuable time and resources on a dozen different tools that will likely just collect dust on the shelf.

EMA Survey Methodology: AppDynamics commissioned EMA to conduct a survey in May 2015 of nearly 300 IT professionals from small, midsized and large companies across both North America and Europe. For the purposes of the study, respondents were filtered to include only those actively involved in enterprise application development/management/delivery at the executive, middle manager, or "hands on" line staff levels.

Kalyan Ramanathan is VP Marketing at AppDynamics.

The Latest

Enterprises today operate in a real-time environment where uninterrupted access to trusted data has become a baseline expectation for users, applications and automated systems. Traditional DataOps models, built on manual effort and human triage, cannot keep pace with this always active demand. AI agents are emerging as the operational backbone, ensuring consistent data availability, reinforcing trustworthiness and enabling a level of scale that manual processes cannot achieve ...

For decades, trust in the digital workplace rested on familiar signals. We trusted faces on video calls, voices on the phone, and emails that appeared to come from people we knew. These cues felt human and intuitive. They anchored how decisions were made, approvals were granted, and access was authorized. AI-powered deepfakes have quietly broken that model ...

Cloud migration was supposed to be a one-way door. For most enterprises, it turns out it isn't. Cloud data repatriation is a real and growing trend. A new survey ... finds that 89% of organizations plan to expand their on-premises infrastructure footprint over the next two years — and 75% have already moved at least some workloads back from public cloud in the past 24 months. The findings point to a broad rethinking of where data belongs ...

Over the past few years, large language models (LLMs) have revolutionized the software industry. Given their ability to excel at multi-step reasoning, LLMs have helped enterprises streamline workflows and adapt to the unknown. However, employing such models comes with sky-high costs, latency issues, and limited flexibility. In the realm of IT operations, it is generally wiser to employ smaller, domain-specific models instead ...

For years, DevOps teams operated under a simple assumption: collect enough telemetry, and you can find and fix any problem. That assumption is breaking down. Modern enterprises now operate across microservices, hybrid cloud environments, APIs, Kubernetes, and highly automated delivery pipelines. Releases happen continuously, dependencies shift constantly, and failures spread faster than teams can diagnose them ...

New Relic surveyed IT and engineering leaders from the media and entertainment (M&E) sector to understand what's working — and where challenges persist with their observability practices. The findings reveal how M&E organizations are navigating rising platform complexity, audience expectations, and AI-driven change. Below are five takeaways that stand out ...

Let me start with something I've seen play out more times than I can count. A team hits a wall with the cloud. Costs creep up, then spike. Performance starts to feel inconsistent. Someone in finance asks a simple question like "why did this double?" and nobody has a clean answer ... Maybe this isn't the right place for everything. That realization feels like a breakthrough, like you've identified the problem. In reality, you've just identified the starting line ...

In MEAN TIME TO INSIGHT Episode 24, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses network observability tool sprawl ... 

In cloud-native systems, scaling is often as simple as moving a slider. For on-premise databases, the stakes are different. Over-provisioning hardware is expensive. Under-provisioning leads to performance bottlenecks that are difficult to fix once the equipment is in the rack ...

When most people think about cybersecurity, they picture firewalls, encryption, and access controls — technical tools designed to protect systems and data. But beneath the technology lies a deeper set of principles about trust, decision-making, and resilience ... The best leaders don't eliminate risk. They manage it intelligently. And in many ways, cybersecurity offers a surprisingly useful playbook for doing exactly that ...

Franken-Monitoring - A Case of Too Many Tools

Most Organizations Have 11 or more tools to Manage Application Performance
Kalyan Ramanathan

In a recent interview, an IT operations director told us, “We frankly have too many tools, and many of them weren’t performing to our expectations.”

If you are an enterprise ops leader managing complex applications, you can probably relate to that statement. At AppDynamics, we call this “Franken-monitoring,” a situation characterized by many, usually too many, siloed tools — for application, server, database, end-user client, etc. — that provide varying levels of disparate visibility into IT applications.

The challenges with this approach include:

■ Tools have minimal integration or common context, which makes it near impossible to manage the application or its business transactions.

■ Tools are designed for subject-matter experts, so it’s hard to provide value to the ops team as a whole.

■ Tools have high total cost of ownership, since every tool has to be independently procured, installed and managed, and staff have to be trained in their use.

2015 APM Tools Survey Finds That Tools Are Underutilized and Solving Performance Problems is Still a Massive Challenge

We commissioned analyst firm Enterprise Management Associates (EMA) to get to the bottom of this. In the 2015 APM Tools Survey, EMA found that a majority of surveyed enterprises have 11 or more commercial tools in their arsenal to manage application performance.

Nearly two-thirds of respondents report that it takes at least three hours to determine the root cause of performance issues; one-third report that it takes six or more hours to find the source of an issue.

EMA’s survey indicated that the lack of application-focused solutions appears to contribute to current IT challenges, with IT teams often trying to manage modern, complex applications with siloed tools and primarily manual processes. Just about every user of monitoring tools complains about the challenges of having too many tools without any situational awareness. Current approaches to integrate these tools with solutions like MoM (manager of managers) or CMDB (configuration management database) have for the most part failed, because it is hard to stitch together these disparate solutions from different vendors.

Gartner recently did a survey that pointed exactly to this challenge. The key reasons (besides price) for poor APM adoption were, indeed, the complexity of the tools and poor integration between tools.

Specifically, the EMA study found:

■ Siloed and shelved monitoring tools: 65 percent of the companies surveyed indicated that they own more than 10 different commercial monitoring products. Nearly half also indicated that 50 percent or fewer of their purchased tools are actively being used.

■ Manual resources expended on application support: According to respondents, calls from users are the second-most frequent way IT organizations find out about application-related problems (27 percent cited detection by monitoring centers; 25 percent cited user calls). Line staff, those closest to the problem, report a significantly higher incidence, citing user calls as their first “heads up” 35 percent of the time.

■ Extensive people-hours required to solve a single application problem: IT organizations surveyed indicated that, for those application-related problems escalated beyond Level 1 support, mean time to repair (MTTR) is most often between five and seven hours; in addition, between three and four people are typically required to solve a given problem.

“Based on our findings, the majority of companies are still trying to manage complex applications with a combination of siloed tools, ‘all hands on deck’ interactive marathons, and tribal knowledge,” said Julie Craig, Research Director, Application Management at EMA. “The ability to automatically discover and manage the business transaction topology as the application itself changes is a significant challenge encountered by virtually every IT organization.”

In addition to EMA’s finding that most companies have under-invested in application-specific management tools, the survey also found clear purchasing preferences regarding future APM purchases:

■ Almost 75 percent identified “flexible deployment options” (supporting SaaS, on-premises, and/or hybrid deployments) as either “critical or important” factors for purchasing an APM solution.

■ More than 70 percent identified the “ability to monitor infrastructure as a service (IaaS) public cloud” as either critical or important.

■ When asked about their top “must have” features for an APM product purchase, respondents selected the following:

#1 feature preference: An integrated monitoring platform consolidating application and infrastructure monitoring in one solution

#2 feature preference: Cloud-readiness features necessary to monitor/manage application components hosted in public cloud

#3 feature preference: Support for trending and reporting

The EMA study shows that very few IT organizations have an accurate, comprehensive view of today’s complex application environment, business transactions and their dependencies. Unified Monitoring is a new way to manage applications proactively, by tracing and monitoring transactions from the end user through the entire application and infrastructure environment to help quickly and proactively solve performance issues and ensure excellent user experience. Companies no longer need to waste valuable time and resources on a dozen different tools that will likely just collect dust on the shelf.

EMA Survey Methodology: AppDynamics commissioned EMA to conduct a survey in May 2015 of nearly 300 IT professionals from small, midsized and large companies across both North America and Europe. For the purposes of the study, respondents were filtered to include only those actively involved in enterprise application development/management/delivery at the executive, middle manager, or "hands on" line staff levels.

Kalyan Ramanathan is VP Marketing at AppDynamics.

The Latest

Enterprises today operate in a real-time environment where uninterrupted access to trusted data has become a baseline expectation for users, applications and automated systems. Traditional DataOps models, built on manual effort and human triage, cannot keep pace with this always active demand. AI agents are emerging as the operational backbone, ensuring consistent data availability, reinforcing trustworthiness and enabling a level of scale that manual processes cannot achieve ...

For decades, trust in the digital workplace rested on familiar signals. We trusted faces on video calls, voices on the phone, and emails that appeared to come from people we knew. These cues felt human and intuitive. They anchored how decisions were made, approvals were granted, and access was authorized. AI-powered deepfakes have quietly broken that model ...

Cloud migration was supposed to be a one-way door. For most enterprises, it turns out it isn't. Cloud data repatriation is a real and growing trend. A new survey ... finds that 89% of organizations plan to expand their on-premises infrastructure footprint over the next two years — and 75% have already moved at least some workloads back from public cloud in the past 24 months. The findings point to a broad rethinking of where data belongs ...

Over the past few years, large language models (LLMs) have revolutionized the software industry. Given their ability to excel at multi-step reasoning, LLMs have helped enterprises streamline workflows and adapt to the unknown. However, employing such models comes with sky-high costs, latency issues, and limited flexibility. In the realm of IT operations, it is generally wiser to employ smaller, domain-specific models instead ...

For years, DevOps teams operated under a simple assumption: collect enough telemetry, and you can find and fix any problem. That assumption is breaking down. Modern enterprises now operate across microservices, hybrid cloud environments, APIs, Kubernetes, and highly automated delivery pipelines. Releases happen continuously, dependencies shift constantly, and failures spread faster than teams can diagnose them ...

New Relic surveyed IT and engineering leaders from the media and entertainment (M&E) sector to understand what's working — and where challenges persist with their observability practices. The findings reveal how M&E organizations are navigating rising platform complexity, audience expectations, and AI-driven change. Below are five takeaways that stand out ...

Let me start with something I've seen play out more times than I can count. A team hits a wall with the cloud. Costs creep up, then spike. Performance starts to feel inconsistent. Someone in finance asks a simple question like "why did this double?" and nobody has a clean answer ... Maybe this isn't the right place for everything. That realization feels like a breakthrough, like you've identified the problem. In reality, you've just identified the starting line ...

In MEAN TIME TO INSIGHT Episode 24, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses network observability tool sprawl ... 

In cloud-native systems, scaling is often as simple as moving a slider. For on-premise databases, the stakes are different. Over-provisioning hardware is expensive. Under-provisioning leads to performance bottlenecks that are difficult to fix once the equipment is in the rack ...

When most people think about cybersecurity, they picture firewalls, encryption, and access controls — technical tools designed to protect systems and data. But beneath the technology lies a deeper set of principles about trust, decision-making, and resilience ... The best leaders don't eliminate risk. They manage it intelligently. And in many ways, cybersecurity offers a surprisingly useful playbook for doing exactly that ...