In APMdigest's exclusive interview, Will Cappelli, Gartner Research VP in Enterprise Management, talks about his latest report: Will IT Operations Analytics Platforms Replace APM Suites?
APM: In your December report - Will IT Operations Analytics Platforms Replace APM Suites? - you say the importance of analytics to APM will grow over the next five years. How do you see that importance expanding?
WC: In one sense, non-analytic APM tools will continue to generate more and more data. As more and more applications are monitored, as the applications being monitored become more and more complex and interconnected, the quantity of data that is being generated by the tools grows. In order to understand what is going on in the application, deeper and deeper analysis capabilities are required.
The other sense is that there are a number of tasks that are carried out by the non-analytic tools, that will increasingly be taken up by some of the analytic tools. So, for example, there is a lot of root cause analysis, which is now not really done with analytics tools, it is done by looking at the topology map. As the application topologies become a lot more complex, you are not going to be able to just look at a map on the screen and find the root cause. You are going to have to apply some sort of automated algorithm that will identify what could be the cause. So these analytics tools will take over some of the function that has been traditionally performed by the non-analytics tools.
There is a third sense, as well. In general, predictive issues are becoming more important. Until now most of the burden of the application performance monitoring tools has been in the area of retroactive determination of the root cause of the problem. We are seeing, with the people we talk to, more and more focus on getting out ahead of problems before they occur. And in order to do that kind of predictive action, you need some kind of analytics tools.
APM: Do you see this driving any evolution in Gartner's 5-dimension APM model?
WC: The model was never meant to be a dogmatic statement of what constitutes APM. It describes the conceptual model that buyers and vendors have when they come to the APM market. So it is really not “prescriptive” as much as it is “descriptive”.
It can evolve, and ought to evolve. At Gartner, we have had the sense that it was going this way. If you look at APM portfolios in the next couple of years, the end-user experience will continue to grow in importance. Analytics will continue to grow in importance. And those three central areas – the architecture discovery, transaction profiling, and deep dive component monitoring – are not going to be as important as the end-user experience in monitoring and the analytics applied to the application performance.
APM: Are you seeing a lot more interest in APM-related analytics in the last year, not just from analysts and vendors but also from the users?
WC: Oh yes definitely. A lot of users call me up and ask about analytics in various forms. I think that some of the market evidence – if you look at the unquestionable success of a vendor like Splunk in the last year particularly, and other vendors that make up the overall analytics area, like Netuitive or Prelert – a lot of their activity has been in the application performance space.
To date the majority of use cases that we have seen for analytics have been in the application performance space. In fact, one of the interesting trajectories is that application performance monitoring initiates the interest in analytics. Analytics within IT seems to be a outgrowth of APM, and then extends to other areas of the stack, whether it's the virtual fabric or the network.
And now I'm beginning to see it move, although in the very early days, into the configuration and change space. I'm beginning to get some calls from end-users looking at the CMDBs or asset management databases or trouble ticketing systems, and asking if they can use analytics in these areas as well. That is a new development that takes us beyond performance and availability.
This interest in analytics is also tied into the general interest across IT and across business as well as in Big Data. And certainly once again Splunk is an important character in the story, at least for now. The Splunk IPO was built around the narrative of Splunk as the Big Data company. One of the interesting side effects of that was a big hype wave in 2012 that has shown a very favorable light on IT operations performance and availability as a great proof case for Big Data analytics.
The question is: can the Big Data analytics move beyond IT operations? That is the open question that I think a lot of users have. Right now, I would say that IT operations is the epicenter of the actual application of Big Data analytics technology. Where you see genuine Big Data technology actually deployed today in real life enterprises is around the IT operations.
APM: Your report seems to imply that in 2013 many organizations plan to spend less on the monitoring side of APM and more on the analytics.
WC: I'm not saying they're going to strictly spend less. I am saying the growth of APM, in terms of spending, will not be at the rates we've seen since around 2000 or so.
APM: Are the companies actually taking the budget that was designated for APM and now spending it on analytics?
WC: I think that is a good analysis. It does seem to me, based upon the people that I've talked to, when they look at what they're going to spend in 2013, they don't say “We're not going to spend on the APM stuff anymore.” But it is the same people that would've bought or expanded their APM investment that are talking enthusiastically about buying analytics technology or analytics services. That is why I was saying earlier that the analytics investment going on right now has a strong application performance and general performance and availability flavor to it, although now they are beginning to expand into other ITIL process areas.
I think there is some causal relationship between the acceleration of the growth and spend on analytics, and the deceleration of the growth of APM. I also think there are a couple of other factors that lead to the deceleration of APM growth that are not directly tied to analytics, but that is certainly one of the factors behind it.
But one can over-dramatize the changing fortunes of APM. It's a transformation from being the hot growth spot in the overall enterprise management space to more like some of the other submarkets in the enterprise management space.
APM: Are the organizations actually telling you that they believe analytics, in their minds, is going to replace traditional APM?
WC: Very few people will say that specifically. But what I do hear is rather than buying some deep dive component monitoring technology, they will invest in Splunk, Netuitive or BMC Proactivenet technology.
It is usually not put as someone saying: “We don't like APM anymore – we are going to buy this other stuff.” It is more: “This analytics technology seems to answer a very pressing need. I am going to buy analytics this year and I may not expand my APM or NPM investment.”
But we are not talking about a decline or contraction of the APM market. We are talking about a deceleration in growth.
Modern complex systems are easy to develop and deploy but extremely difficult to observe. Their IT Ops data gets very messy. If you have ever worked with modern Ops teams, you will know this. There are multiple issues with data, from collection to processing to storage to getting proper insights at the right time. I will try to group and simplify them as much as possible and suggest possible solutions to do it right ...
In Agile, development and testing work in tandem, with testing being performed at each stage of the software delivery lifecycle, also known as the SDLC. This combination of development and testing is known as "shifting left." Shift left is a software development testing practice intended to resolve any errors or performance bottlenecks as early in the software development lifecycle (SDLC) as possible ...
Overwhelmingly, business leaders cited digital preparedness as key to their ability to adapt, according to an in-depth study by the Economist Intelligence Unit (EIU), looking into how the relationship between technology, business and people evolved during the COVID-19 pandemic ...
Robotic Data Automation (RDA) is a new paradigm to help automate data integration and data preparation activities involved in dealing with machine data for Analytics and AI/Machine Learning applications. RDA is not just a framework, but also includes a set of technologies and product capabilities that help implement the data automation ...
There is no one-size-fits-all approach to changing the experience of employees during a pandemic, but technological innovation can have a positive impact on how employees work from home as companies design their digital workspace strategy. The IT team supporting this shift needs to think about the following questions ...
Downtime. It's more than just a bar on the Rebel Alliance's base on Folor. For IT Ops teams, downtime is not fun. It costs time, money and often, user frustration. It takes more than the Force to handle incidents ... it takes an intergalactic team. An effective incident management team is made up of people with many different skill sets, styles and approaches. We thought it would be fun to map the heroes of IT Ops with Star Wars characters (across Star Wars generations) based on their traits ...
Vendors and their visions often run ahead of the real-world pack — at least, the good ones do, because progress begins with vision. The downside of this rush to tomorrow is that IT practitioners can be left to ponder the practicality of technologies and wonder if their organization is ahead of the market curve or sliding behind in an invisible race that is always competitive ...
According to a new report, Digital Workspace Deployment & Performance Monitoring in the New Normal, 82% of respondents had changes in their digital workspaces due to the pandemic ...
There are a few best practices that DevOps teams should keep in mind to ensure they are not lost in the weeds when incorporating visibility and troubleshooting programs into their systems, containers, and infrastructures. Let's dive into these best practices ...