In APMdigest's exclusive interview, Will Cappelli, Gartner Research VP in Enterprise Management, talks about his latest report: Will IT Operations Analytics Platforms Replace APM Suites?
APM: In your December report - Will IT Operations Analytics Platforms Replace APM Suites? - you say the importance of analytics to APM will grow over the next five years. How do you see that importance expanding?
WC: In one sense, non-analytic APM tools will continue to generate more and more data. As more and more applications are monitored, as the applications being monitored become more and more complex and interconnected, the quantity of data that is being generated by the tools grows. In order to understand what is going on in the application, deeper and deeper analysis capabilities are required.
The other sense is that there are a number of tasks that are carried out by the non-analytic tools, that will increasingly be taken up by some of the analytic tools. So, for example, there is a lot of root cause analysis, which is now not really done with analytics tools, it is done by looking at the topology map. As the application topologies become a lot more complex, you are not going to be able to just look at a map on the screen and find the root cause. You are going to have to apply some sort of automated algorithm that will identify what could be the cause. So these analytics tools will take over some of the function that has been traditionally performed by the non-analytics tools.
There is a third sense, as well. In general, predictive issues are becoming more important. Until now most of the burden of the application performance monitoring tools has been in the area of retroactive determination of the root cause of the problem. We are seeing, with the people we talk to, more and more focus on getting out ahead of problems before they occur. And in order to do that kind of predictive action, you need some kind of analytics tools.
APM: Do you see this driving any evolution in Gartner's 5-dimension APM model?
WC: The model was never meant to be a dogmatic statement of what constitutes APM. It describes the conceptual model that buyers and vendors have when they come to the APM market. So it is really not “prescriptive” as much as it is “descriptive”.
It can evolve, and ought to evolve. At Gartner, we have had the sense that it was going this way. If you look at APM portfolios in the next couple of years, the end-user experience will continue to grow in importance. Analytics will continue to grow in importance. And those three central areas – the architecture discovery, transaction profiling, and deep dive component monitoring – are not going to be as important as the end-user experience in monitoring and the analytics applied to the application performance.
APM: Are you seeing a lot more interest in APM-related analytics in the last year, not just from analysts and vendors but also from the users?
WC: Oh yes definitely. A lot of users call me up and ask about analytics in various forms. I think that some of the market evidence – if you look at the unquestionable success of a vendor like Splunk in the last year particularly, and other vendors that make up the overall analytics area, like Netuitive or Prelert – a lot of their activity has been in the application performance space.
To date the majority of use cases that we have seen for analytics have been in the application performance space. In fact, one of the interesting trajectories is that application performance monitoring initiates the interest in analytics. Analytics within IT seems to be a outgrowth of APM, and then extends to other areas of the stack, whether it's the virtual fabric or the network.
And now I'm beginning to see it move, although in the very early days, into the configuration and change space. I'm beginning to get some calls from end-users looking at the CMDBs or asset management databases or trouble ticketing systems, and asking if they can use analytics in these areas as well. That is a new development that takes us beyond performance and availability.
This interest in analytics is also tied into the general interest across IT and across business as well as in Big Data. And certainly once again Splunk is an important character in the story, at least for now. The Splunk IPO was built around the narrative of Splunk as the Big Data company. One of the interesting side effects of that was a big hype wave in 2012 that has shown a very favorable light on IT operations performance and availability as a great proof case for Big Data analytics.
The question is: can the Big Data analytics move beyond IT operations? That is the open question that I think a lot of users have. Right now, I would say that IT operations is the epicenter of the actual application of Big Data analytics technology. Where you see genuine Big Data technology actually deployed today in real life enterprises is around the IT operations.
APM: Your report seems to imply that in 2013 many organizations plan to spend less on the monitoring side of APM and more on the analytics.
WC: I'm not saying they're going to strictly spend less. I am saying the growth of APM, in terms of spending, will not be at the rates we've seen since around 2000 or so.
APM: Are the companies actually taking the budget that was designated for APM and now spending it on analytics?
WC: I think that is a good analysis. It does seem to me, based upon the people that I've talked to, when they look at what they're going to spend in 2013, they don't say “We're not going to spend on the APM stuff anymore.” But it is the same people that would've bought or expanded their APM investment that are talking enthusiastically about buying analytics technology or analytics services. That is why I was saying earlier that the analytics investment going on right now has a strong application performance and general performance and availability flavor to it, although now they are beginning to expand into other ITIL process areas.
I think there is some causal relationship between the acceleration of the growth and spend on analytics, and the deceleration of the growth of APM. I also think there are a couple of other factors that lead to the deceleration of APM growth that are not directly tied to analytics, but that is certainly one of the factors behind it.
But one can over-dramatize the changing fortunes of APM. It's a transformation from being the hot growth spot in the overall enterprise management space to more like some of the other submarkets in the enterprise management space.
APM: Are the organizations actually telling you that they believe analytics, in their minds, is going to replace traditional APM?
WC: Very few people will say that specifically. But what I do hear is rather than buying some deep dive component monitoring technology, they will invest in Splunk, Netuitive or BMC Proactivenet technology.
It is usually not put as someone saying: “We don't like APM anymore – we are going to buy this other stuff.” It is more: “This analytics technology seems to answer a very pressing need. I am going to buy analytics this year and I may not expand my APM or NPM investment.”
But we are not talking about a decline or contraction of the APM market. We are talking about a deceleration in growth.
The requirements of an APM tool are now much more complex than they've ever been. Not only do they need to trace a user transaction across numerous microservices on the same system, but they also need to happen pretty fast ...
Performance monitoring is an old problem. As technology has advanced, we've had to evolve how we monitor applications. Initially, performance monitoring largely involved sending ICMP messages to start troubleshooting a down or slow application. Applications have gotten much more complex, so this is no longer enough. Now we need to know not just whether an application is broken, but why it broke. So APM has had to evolve over the years for us to get there. But how did this evolution take place, and what happens next? Let's find out ...
There are some IT organizations that are using DevOps methodology but are wary of getting bogged down in ITSM procedures. But without at least some ITSM controls in place, organizations lose their focus on systematic customer engagement, making it harder for them to scale ...
If you have deployed a Java application in production, you've probably encountered a situation where the application suddenly starts to take up a large amount of CPU. When this happens, application response becomes sluggish and users begin to complain about slow response. Often the solution to this problem is to restart the application and, lo and behold, the problem goes away — only to reappear a few days later. A key question then is: how to troubleshoot high CPU usage of a Java application? ...
Operations are no longer tethered tightly to a main office, as the headquarters-centric model has been retired in favor of a more decentralized enterprise structure. Rather than focus the business around a single location, enterprises are now comprised of a web of remote offices and individuals, where network connectivity has broken down the geographic barriers that in the past limited the availability of talent and resources. Key to the success of the decentralized enterprise model is a new generation of collaboration and communication tools ...
To better understand the AI maturity of businesses, Dotscience conducted a survey of 500 industry professionals. Research findings indicate that although enterprises are dedicating significant time and resources towards their AI deployments, many data science and ML teams don't have the adequate tools needed to properly collaborate on, build and deploy AI models efficiently ...
Digital transformation, migration to the enterprise cloud and increasing customer demands are creating a surge in IT complexity and the associated costs of managing it. Technical leaders around the world are concerned about the effect this has on IT performance and ultimately, their business according to a new report from Dynatrace, based on an independent global survey of 800 CIOs, Top Challenges for CIOs in a Software-Driven, Hybrid, Multi-Cloud World ...
APM tools are your window into your application's performance — its capacity and levels of service. However, traditional APM tools are now struggling due to the mismatch between their specifications and expectations. Modern application architectures are multi-faceted; they contain hybrid components across a variety of on-premise and cloud applications. Modern enterprises often generate data in silos with each outflow having its own data structure. This data comes from several tools over different periods of time. Such diversity in sources, structure, and formats present unique challenges for traditional enterprise tools ...
Today's organizations clearly understand the value of digital transformation and its ability to spark innovation. It's surprising that fewer than half of organizations have undertaken a digital transformation project. Workfront has identified five of the top challenges that IT teams face in digital transformation — and how to overcome them ...