Q&A Part Two: TRAC Research Talks About the APM Spectrum
March 26, 2013
Share this

In Part Two of APMdigest's exclusive interview, Bojan Simic, President and Principal Analyst at TRAC Research, talks about the firm's new APM Spectrum report, APM analytics, virtualization, and different types of APM for different job roles.

Start with Q&A Part One: TRAC Research Talks About the APM Spectrum

APM: Your report deals a lot with job roles. Did you see differences in expectations for APM solutions between IT operations and developers?

TRAC: We saw a major difference between IT operations versus developers, in terms of what they are looking to purchase. You can talk to developers and IT operations about the same exact tool and developers might say it is very effective, while IT operations will say it is too difficult for them to deploy in the workflow, and just not designed for what they are trying to do.

We asked developers and IT operations about their levels of satisfaction with the solutions that are currently being deployed. The data shows that developers are more likely to say that usability of data is pretty good. 59% of developers said they are satisfied, versus 40% of IT operations.

We also asked a question about the quality of user experience, and the numbers flip-flopped. 56% of IT operations said they were satisfied compared to only 39% of developers. Part of the reason is that some of the solutions being purchased by developers work really well in pre-production, but they are not as effective in production.

APM: So what is the solution? Do developers and IT operations always require separate tools?

TRAC: In some cases they could benefit from using two separate solutions. It really depends on the use case. A lot of it has to do with how they want to use the data they are collecting, whether it is one tool or multiple tools, and how the tool actually maps to what they're trying to do in production versus pre-production.

It goes back to what I mentioned before, it is not about selecting one solution that is going to take care of all your needs, user experience monitoring, transaction monitoring, infrastructure view — in many cases you need multiple products. What is important to know is: can these products work together?

One point that is important to mention, we asked the question in the survey about tools being used in pre-production only, production only, or both pre-production and production. 52% said APM tools are being used in production only. 10% are being used in pre-production only. 38% are being used in both. So on the developer side, you need to make sure the tool can also be effective in production. That is one of the recommendations that we have for developers in the study.

APM: Developer vs. IT ops is a fairly high profile example. Can you give some other examples of APM for specific job roles?

TRAC: We have seen quite a few people who purchase APM solutions, but they come from the business side, which IT is not even aware of. We are seeing almost a new class of APM deployments where IT is not even involved in the buying cycle. They might not even be aware it exists because the business side is buying APM for their purposes. Business users are becoming almost a separate submarket.

We are seeing more marketing folks being able to benefit from APM data if it is presented in the right way. They don't necessarily care about all the nuts and bolts of the technology, looking at packets and code, but they do care about the user experience. They care about how performance impacts application usage and business metrics.

We talked to people in charge of application training, and they want to use APM tools to understand why a number of licenses are unused. Is it because the application is slow, or because people are not trained properly, or because the workflow is difficult to use?

In our survey, CIOs identified that their number one goal was to be able to invest more resources in innovation. Where APM fits into the CIO's agenda is to reduce the time and resources spent on maintaining IT services. Once you do that, you can allocate more resources in developing innovative services and create a competitive advantage.

APM: Do these multiple roles with different needs cause a challenge when purchasing an APM solution?

TRAC: Very often multiple job roles will be involved in the buying cycle. Capacity planning managers, developers, application support — and the companies are trying to get an APM solution that can support all of them, providing a value proposition across all the different job roles. But very often, what they end up buying is a solution that addresses only limited use cases.

APM: How do you view the increased importance of APM analytics?

TRAC: This is one of the key stories in the report. Analytics comes across most, if not all, sections of the report — anywhere from the APM overview to key challenges to best practices to recommendations.

One point is that 81% of organizations in the survey reported that the amount of APM data they collect increased over the last 12 months. That, by itself, shows that there is more data to be processed, the complexity is growing, and if you try to make sense out of the data manually you are setting yourself up for a task that is not humanly possible.

The survey also shows that only 16% of these organizations are able to proactively prevent issues in 80% of incidents or more. Many of them are using a number of different solutions that were never designed to work together, while trying to bring them all together and make sense out of this information. They need some technology in place to be able to analyze the data and bring it back to a single view.

In terms of usability, two key challenges were shown. One is the challenge of correlating and normalizing data collected from different sources. Second, is the amount of information that is not relevant to the problem you're trying to solve. I think the bottom line is that there is no correlation between the amount of information people have in the end, and their effectiveness in addressing key challenges. The fact that you can collect more information does not mean a whole lot unless you can process it, and present it back to people who are making decisions to prevent and resolve these issues.

APM: Your report says that virtualization is becoming another management silo. Why is that happening?

TRAC: Traditionally, we have two different types of solutions that are dealing with virtualization. You have virtualization management solutions that do a really good job talking about CPU utilization, availability and capacity. Most of these tools do not have any visibility into how actions on the virtualization management side impact the quality of the user experience for applications that are being virtualized.

Then you have user experience monitoring solutions that can do a good job telling you when you have a problem, but they don't have a lot of visibility into the actual infrastructure.

In the virtualization section of the study, we asked: what are the key challenges for managing application performance in virtualized environments? Number one was the inability to find the optimal balance between utilization and performance. If you are looking to manage a virtualization project with one goal in mind, to improve utilization, you need to know how it impacts the user experience. That is why virtualization is becoming a silo, because a lot of people don't have visibility into how their actions are impacting the end-user.

The number two challenge of virtualization management was lack of visibility into transaction flow, anywhere from the point where end-users interact with the application into the virtualized server. Having that kind of end-to-end visibility is critical, and not a lot of people have that.

Read Q&A Part Three: TRAC Research Talks About the APM Spectrum

Related Links:

Read Q&A Part One: TRAC Research Talks About the APM Spectrum

Share this

The Latest

June 25, 2020

I've had the opportunity to work with a number of organizations embarking on their AIOps journey. I always advise them to start by evaluating their needs and the possibilities AIOps can bring to them through five different levels of AIOps maturity. This is a strategic approach that allows enterprises to achieve complete automation for long-term success ...

June 24, 2020

Sumo Logic recently commissioned an independent market research study to understand the industry momentum behind continuous intelligence — and the necessity for digital organizations to embrace a cloud-native, real-time continuous intelligence platform to support the speed and agility of business for faster decision-making, optimizing security, driving new innovation and delivering world-class customer experiences. Some of the key findings include ...

June 23, 2020

When it comes to viruses, it's typically those of the computer/digital variety that IT is concerned about. But with the ongoing pandemic, IT operations teams are on the hook to maintain business functions in the midst of rapid and massive change. One of the biggest challenges for businesses is the shift to remote work at scale. Ensuring that they can continue to provide products and services — and satisfy their customers — against this backdrop is challenging for many ...

June 22, 2020

Teams tasked with developing and delivering software are under pressure to balance the business imperative for speed with high customer expectations for quality. In the course of trying to achieve this balance, engineering organizations rely on a variety of tools, techniques and processes. The 2020 State of Software Quality report provides a snapshot of the key challenges organizations encounter when it comes to delivering quality software at speed, as well as how they are approaching these hurdles. This blog introduces its key findings ...

June 18, 2020

For IT teams, run-the-business, commodity areas such as employee help desks, device support and communication platforms are regularly placed in the crosshairs for cost takeout, but these areas are also highly visible to employees. Organizations can improve employee satisfaction and business performance by building unified functions that are measured by employee experience rather than price. This approach will ultimately fund transformation, as well as increase productivity and innovation ...

June 17, 2020

In the agile DevOps framework, there is a vital piece missing; something that previous approaches to application development did well, but has since fallen by the wayside. That is, the post-delivery portion of the toolchain. Without continuous cloud optimization, the CI/CD toolchain still produces massive inefficiencies and overspend ...

June 16, 2020

The COVID-19 pandemic has exponentially accelerated digital transformation projects. To better understand where IT professionals are turning for help, we analyzed the online behaviors of IT decision-makers. Our research found an increase in demand for resources related to APM, microservices and dependence on cloud services ...

June 15, 2020

The rush to the public cloud has now slowed as organizations realized that it is not a "one size fits all" solution. The main issue is the lack of deep visibility into the performance of applications provided by the host. Our own research has recently revealed that 32% of public cloud resources are currently under-utilized, and without proper direction and guidance, this will remain the case ...

June 11, 2020

The global shift to working from home (WFH) enforced by COVID-19 stay-at-home orders has had a massive impact on everyone's working lives, not just in the way they remotely interact with their teams and IT systems, but also in how they spend their working days. With both governments and businesses committed to slowly opening up offices, it's increasingly clear that a high prevalence of remote work will continue throughout 2020 and beyond. This situation begets important questions ...

June 10, 2020
In recent years, with the emergence of newer technologies ranging from the cloud to machine learning, IT modernization has evolved from a replacement of end-of-life infrastructure to an enabler of innovation and business value. It is a complex process that can take months or even years, but a recent survey shows that the effort begins to deliver measurable results almost as soon as an organization executes the first steps on its roadmap ...