Skip to main content

Gartner Q&A: Jonah Kowall Talks About APM - Part 1

Pete Goldin
APMdigest

In Part 1 of APMdigest's exclusive interview, Jonah Kowall, Research Vice President, IT Operations Management at Gartner, discusses Gartner's 2013 Magic Quadrant for Application Performance Monitoring (APM), and APM hot topics including SaaS and Mobile.

APM: What do you see as the most significant changes in the market between the release of Gartner's 2012 and 2013 Magic Quadrants for APM?

JK: We have seen increased acceleration and investment by some of the smaller players in the space. In addition, the use of analytics technology has further differentiated offerings in the Application Performance Monitoring (APM) market.

And, of course, we have seen a greater importance on Software-as-a-Service (SaaS) delivery. We definitely see more end-user organizations implementing SaaS. I think that trend will continue, hence the relative weighting of SaaS and analytics will be increasing year over year for the APM Magic Quadrant.

APM: Is the growth of SaaS APM living up to the expectations many of us set for it a year or two ago?

JK: SaaS is not for everyone. It is definitely a subset of the market today. Solutions which offer differentiation because of the delivery model, or solutions which give you a choice of the same product in both delivery models, appeal more to buyers.

Additionally, SaaS helps shorten the buying cycle, meaning POCs can be executed much more efficiently, and customers can see value quickly, even if they decide longer-term that they may want to move on-premise.

APM: The requirements for Gartner's Magic Quadrant for APM continue to say "some features of the APM offering must be available via a SaaS delivery model" rather than requiring full feature SaaS. At some point, do you foresee the APM Magic Quadrant requiring every vendor to offer the full product as a service?

JK: We require that vendors have a least some functionality in SaaS. In 2012, we allowed a third party to provide the SaaS, and in 2013 we required that the vendors themselves provide SaaS.

Looking forward, we definitely do see most of the players in the APM Magic Quadrant offering more of their full solution as a service, so I wouldn't be surprised to see that requirement continue to expand.

APM: Do you have any stats on how much productivity can be increased by using APM SaaS?

JK: There have not been any studies conducted and I think that it would be hard to determine what that number is. It also depends on the complexity of the product.

Some solutions are very straightforward to implement, in terms of infrastructure requirements, meaning the server that collects the data from the agents. Other solutions can be more complex and require many components, especially at scale. It really varies on the vendor solution in terms of the complexity of the infrastructure requirements.

APM: But you do see an advantage to APM as a service?

Yes. There is no question upgrades may be painful. One area of complication is when customizations or integrations have been made with other products. By offering APM as a service, the customer is automatically upgraded without having to deal with the upgrade process. The agents are normally backwards compatible, but at least the user interface and functionality will remain current without putting in the extra work.

The other piece is that SaaS products integrate with well-formed APIs because they have been designed that way, since they are remotely delivered. When you have on-premise software, customization and integration often takes the form of either custom code or integrations that are not as well formed in terms of the APIs that are available.

SaaS providers have to keep some level of API compatibility in order for integration. That is definitely not the case with on-premise, and we have seen that be an issue with keeping customers on current revisions of software. If the software is not kept up to date, the customer eventually gets disgruntled with the fact that it doesn't support the new technologies or there are bugs that do not get fixed. It ultimately ends up reflecting poorly on the vendor, even if the solution, in its current version, fixes a lot of the issues that the users dislike. SaaS solves these issues.

APM: It seems like a lot of these productivity issues are maintenance oriented?

JK: Yes, it is the work that the ops guys need to do to keep current on the versions of the software. Enterprises often skip a major version of software and go to the next one. That is something we see a lot. For example, with Windows, many enterprises deployed Windows XP and then Windows 7, and skipped Windows Vista. We are seeing a lot of the same type of approach to APM. But the vendors don't expect enterprises to skip major versions. If you try to upgrade from version 5 to version 7, for example, it can cause problems because there is a pretty significant gap between those major versions.

APM: Your 2013 APM Magic Quadrant says "Mobile APM is the next wave of innovation" but it seems to be taking longer than we all expected.

JK: In 2013, we didn't really see mobile APM products that were actually giving “true APM”. We have had synthetic testing products that do mobile for quite a while, but that is a completely different value proposition from APM, which lives inside the application. So when I say "mobile APM", I am really talking about the same type of APM that looks inside applications, not the type of synthetic end user experience that just tries to emulate a user.

So even a year ago from today we just started to see early versions of true APM products for mobile coming out. This market has not been around very long. Solution providers typically have a revenue goal in mind when they release these products, and most of the mobile APM solutions out there exceeded any of the goals that were set.

APM: When do you feel Mobile APM will become truly mainstream, to the point where it drives the APM market?

JK: The demand is there because of the growth and diversity of mobile applications themselves. There are a lot of mobile apps out there, so it is going to take a while to actually proliferate through enough of the development organizations to be what I would call "mainstream". I would say that true Mobile APM is probably a couple of years off from being mainstream by any stretch of the imagination, but it is definitely growing in adoption and we are seeing new and interesting solutions coming to market.

Gartner Q&A: Jonah Kowall Talks About APM - Part 2

In Part 2, Jonah Kowall discusses Gartner's 2013 Magic Quadrant for Application Performance Monitoring (APM), complexity in today's product offerings, and the market's move to simplify APM.

Hot Topic
The Latest
The Latest 10

The Latest

Enterprises today operate in a real-time environment where uninterrupted access to trusted data has become a baseline expectation for users, applications and automated systems. Traditional DataOps models, built on manual effort and human triage, cannot keep pace with this always active demand. AI agents are emerging as the operational backbone, ensuring consistent data availability, reinforcing trustworthiness and enabling a level of scale that manual processes cannot achieve ...

For decades, trust in the digital workplace rested on familiar signals. We trusted faces on video calls, voices on the phone, and emails that appeared to come from people we knew. These cues felt human and intuitive. They anchored how decisions were made, approvals were granted, and access was authorized. AI-powered deepfakes have quietly broken that model ...

Cloud migration was supposed to be a one-way door. For most enterprises, it turns out it isn't. Cloud data repatriation is a real and growing trend. A new survey ... finds that 89% of organizations plan to expand their on-premises infrastructure footprint over the next two years — and 75% have already moved at least some workloads back from public cloud in the past 24 months. The findings point to a broad rethinking of where data belongs ...

Over the past few years, large language models (LLMs) have revolutionized the software industry. Given their ability to excel at multi-step reasoning, LLMs have helped enterprises streamline workflows and adapt to the unknown. However, employing such models comes with sky-high costs, latency issues, and limited flexibility. In the realm of IT operations, it is generally wiser to employ smaller, domain-specific models instead ...

For years, DevOps teams operated under a simple assumption: collect enough telemetry, and you can find and fix any problem. That assumption is breaking down. Modern enterprises now operate across microservices, hybrid cloud environments, APIs, Kubernetes, and highly automated delivery pipelines. Releases happen continuously, dependencies shift constantly, and failures spread faster than teams can diagnose them ...

New Relic surveyed IT and engineering leaders from the media and entertainment (M&E) sector to understand what's working — and where challenges persist with their observability practices. The findings reveal how M&E organizations are navigating rising platform complexity, audience expectations, and AI-driven change. Below are five takeaways that stand out ...

Let me start with something I've seen play out more times than I can count. A team hits a wall with the cloud. Costs creep up, then spike. Performance starts to feel inconsistent. Someone in finance asks a simple question like "why did this double?" and nobody has a clean answer ... Maybe this isn't the right place for everything. That realization feels like a breakthrough, like you've identified the problem. In reality, you've just identified the starting line ...

In MEAN TIME TO INSIGHT Episode 24, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses network observability tool sprawl ... 

In cloud-native systems, scaling is often as simple as moving a slider. For on-premise databases, the stakes are different. Over-provisioning hardware is expensive. Under-provisioning leads to performance bottlenecks that are difficult to fix once the equipment is in the rack ...

When most people think about cybersecurity, they picture firewalls, encryption, and access controls — technical tools designed to protect systems and data. But beneath the technology lies a deeper set of principles about trust, decision-making, and resilience ... The best leaders don't eliminate risk. They manage it intelligently. And in many ways, cybersecurity offers a surprisingly useful playbook for doing exactly that ...

Gartner Q&A: Jonah Kowall Talks About APM - Part 1

Pete Goldin
APMdigest

In Part 1 of APMdigest's exclusive interview, Jonah Kowall, Research Vice President, IT Operations Management at Gartner, discusses Gartner's 2013 Magic Quadrant for Application Performance Monitoring (APM), and APM hot topics including SaaS and Mobile.

APM: What do you see as the most significant changes in the market between the release of Gartner's 2012 and 2013 Magic Quadrants for APM?

JK: We have seen increased acceleration and investment by some of the smaller players in the space. In addition, the use of analytics technology has further differentiated offerings in the Application Performance Monitoring (APM) market.

And, of course, we have seen a greater importance on Software-as-a-Service (SaaS) delivery. We definitely see more end-user organizations implementing SaaS. I think that trend will continue, hence the relative weighting of SaaS and analytics will be increasing year over year for the APM Magic Quadrant.

APM: Is the growth of SaaS APM living up to the expectations many of us set for it a year or two ago?

JK: SaaS is not for everyone. It is definitely a subset of the market today. Solutions which offer differentiation because of the delivery model, or solutions which give you a choice of the same product in both delivery models, appeal more to buyers.

Additionally, SaaS helps shorten the buying cycle, meaning POCs can be executed much more efficiently, and customers can see value quickly, even if they decide longer-term that they may want to move on-premise.

APM: The requirements for Gartner's Magic Quadrant for APM continue to say "some features of the APM offering must be available via a SaaS delivery model" rather than requiring full feature SaaS. At some point, do you foresee the APM Magic Quadrant requiring every vendor to offer the full product as a service?

JK: We require that vendors have a least some functionality in SaaS. In 2012, we allowed a third party to provide the SaaS, and in 2013 we required that the vendors themselves provide SaaS.

Looking forward, we definitely do see most of the players in the APM Magic Quadrant offering more of their full solution as a service, so I wouldn't be surprised to see that requirement continue to expand.

APM: Do you have any stats on how much productivity can be increased by using APM SaaS?

JK: There have not been any studies conducted and I think that it would be hard to determine what that number is. It also depends on the complexity of the product.

Some solutions are very straightforward to implement, in terms of infrastructure requirements, meaning the server that collects the data from the agents. Other solutions can be more complex and require many components, especially at scale. It really varies on the vendor solution in terms of the complexity of the infrastructure requirements.

APM: But you do see an advantage to APM as a service?

Yes. There is no question upgrades may be painful. One area of complication is when customizations or integrations have been made with other products. By offering APM as a service, the customer is automatically upgraded without having to deal with the upgrade process. The agents are normally backwards compatible, but at least the user interface and functionality will remain current without putting in the extra work.

The other piece is that SaaS products integrate with well-formed APIs because they have been designed that way, since they are remotely delivered. When you have on-premise software, customization and integration often takes the form of either custom code or integrations that are not as well formed in terms of the APIs that are available.

SaaS providers have to keep some level of API compatibility in order for integration. That is definitely not the case with on-premise, and we have seen that be an issue with keeping customers on current revisions of software. If the software is not kept up to date, the customer eventually gets disgruntled with the fact that it doesn't support the new technologies or there are bugs that do not get fixed. It ultimately ends up reflecting poorly on the vendor, even if the solution, in its current version, fixes a lot of the issues that the users dislike. SaaS solves these issues.

APM: It seems like a lot of these productivity issues are maintenance oriented?

JK: Yes, it is the work that the ops guys need to do to keep current on the versions of the software. Enterprises often skip a major version of software and go to the next one. That is something we see a lot. For example, with Windows, many enterprises deployed Windows XP and then Windows 7, and skipped Windows Vista. We are seeing a lot of the same type of approach to APM. But the vendors don't expect enterprises to skip major versions. If you try to upgrade from version 5 to version 7, for example, it can cause problems because there is a pretty significant gap between those major versions.

APM: Your 2013 APM Magic Quadrant says "Mobile APM is the next wave of innovation" but it seems to be taking longer than we all expected.

JK: In 2013, we didn't really see mobile APM products that were actually giving “true APM”. We have had synthetic testing products that do mobile for quite a while, but that is a completely different value proposition from APM, which lives inside the application. So when I say "mobile APM", I am really talking about the same type of APM that looks inside applications, not the type of synthetic end user experience that just tries to emulate a user.

So even a year ago from today we just started to see early versions of true APM products for mobile coming out. This market has not been around very long. Solution providers typically have a revenue goal in mind when they release these products, and most of the mobile APM solutions out there exceeded any of the goals that were set.

APM: When do you feel Mobile APM will become truly mainstream, to the point where it drives the APM market?

JK: The demand is there because of the growth and diversity of mobile applications themselves. There are a lot of mobile apps out there, so it is going to take a while to actually proliferate through enough of the development organizations to be what I would call "mainstream". I would say that true Mobile APM is probably a couple of years off from being mainstream by any stretch of the imagination, but it is definitely growing in adoption and we are seeing new and interesting solutions coming to market.

Gartner Q&A: Jonah Kowall Talks About APM - Part 2

In Part 2, Jonah Kowall discusses Gartner's 2013 Magic Quadrant for Application Performance Monitoring (APM), complexity in today's product offerings, and the market's move to simplify APM.

Hot Topic
The Latest
The Latest 10

The Latest

Enterprises today operate in a real-time environment where uninterrupted access to trusted data has become a baseline expectation for users, applications and automated systems. Traditional DataOps models, built on manual effort and human triage, cannot keep pace with this always active demand. AI agents are emerging as the operational backbone, ensuring consistent data availability, reinforcing trustworthiness and enabling a level of scale that manual processes cannot achieve ...

For decades, trust in the digital workplace rested on familiar signals. We trusted faces on video calls, voices on the phone, and emails that appeared to come from people we knew. These cues felt human and intuitive. They anchored how decisions were made, approvals were granted, and access was authorized. AI-powered deepfakes have quietly broken that model ...

Cloud migration was supposed to be a one-way door. For most enterprises, it turns out it isn't. Cloud data repatriation is a real and growing trend. A new survey ... finds that 89% of organizations plan to expand their on-premises infrastructure footprint over the next two years — and 75% have already moved at least some workloads back from public cloud in the past 24 months. The findings point to a broad rethinking of where data belongs ...

Over the past few years, large language models (LLMs) have revolutionized the software industry. Given their ability to excel at multi-step reasoning, LLMs have helped enterprises streamline workflows and adapt to the unknown. However, employing such models comes with sky-high costs, latency issues, and limited flexibility. In the realm of IT operations, it is generally wiser to employ smaller, domain-specific models instead ...

For years, DevOps teams operated under a simple assumption: collect enough telemetry, and you can find and fix any problem. That assumption is breaking down. Modern enterprises now operate across microservices, hybrid cloud environments, APIs, Kubernetes, and highly automated delivery pipelines. Releases happen continuously, dependencies shift constantly, and failures spread faster than teams can diagnose them ...

New Relic surveyed IT and engineering leaders from the media and entertainment (M&E) sector to understand what's working — and where challenges persist with their observability practices. The findings reveal how M&E organizations are navigating rising platform complexity, audience expectations, and AI-driven change. Below are five takeaways that stand out ...

Let me start with something I've seen play out more times than I can count. A team hits a wall with the cloud. Costs creep up, then spike. Performance starts to feel inconsistent. Someone in finance asks a simple question like "why did this double?" and nobody has a clean answer ... Maybe this isn't the right place for everything. That realization feels like a breakthrough, like you've identified the problem. In reality, you've just identified the starting line ...

In MEAN TIME TO INSIGHT Episode 24, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses network observability tool sprawl ... 

In cloud-native systems, scaling is often as simple as moving a slider. For on-premise databases, the stakes are different. Over-provisioning hardware is expensive. Under-provisioning leads to performance bottlenecks that are difficult to fix once the equipment is in the rack ...

When most people think about cybersecurity, they picture firewalls, encryption, and access controls — technical tools designed to protect systems and data. But beneath the technology lies a deeper set of principles about trust, decision-making, and resilience ... The best leaders don't eliminate risk. They manage it intelligently. And in many ways, cybersecurity offers a surprisingly useful playbook for doing exactly that ...