Delivering Deep Insights Into End User Quality of Experience
December 21, 2011
Raj Sabhlok and Suvish Viswanathan
Share this

The quality of an end user's experience of an application is becoming an ever more important consideration in the APM world. It's not enough to draw a conclusion about the end user's experience based on an evaluation of how an individual application is performing. Increasingly, multiple applications and loosely coupled infrastructure components are coming together to contribute to the end user's experience. Understanding how all those applications and components are interacting at the point where the user is engaging them is crucial to an understanding of the user's experience.

So where do you start to gain this understanding? First, you must identify what constitutes a user's experience of an application: Response speed? Ease of information access? Depth of integration with other applications? Until you understand what constitutes a user's experience, you're not in a position to measure or quantify it.

Some of the elements that contribute to an end user's experience of an application will be inside the corporate firewall — servers, routers, database machines, and more.

Other elements contributing to the end user's experience will be outside the corporate firewall — data feeds from third parties, for example.

Organizations that want to know how well their applications are performing for users — particularly customers who are interacting from outside the firewall — need tools to monitor the user's experience that look at it from both the inside and the outside.

Monitoring Application Response Times For Each Transaction

Today's application infrastructures involve many servers, routers, switches, load balancers, and more. In any given application, information moves among these different devices. To understand fully what is happening every time the data moves among application or network elements, you need tools that can track and capture transaction information in real time and at a very granular level.

You also need to monitor for patterns in user engagement. Response times for an online booking application, for example, may be consistent all week long, then spike suddenly on a Friday night when everyone leaves work for the weekend. The user experience of your applications on a Friday night may be poor, given the traffic that your systems are experiencing.

Without insight into the response times for each movement between application and infrastructure elements, though, you won't know where to make changes to improve the end user experience.

Monitoring Business Metrics Related to Application Performance

While the ability to monitor all the different aspects of the application and infrastructure that contribute to end user experience is critical, you also need a context in which the data you capture from that monitoring effort has relevance. You need to develop business metrics that identify desired transaction performance levels.

Without both the metrics and the ability to track transaction performance against those metrics, you have information without any context — and it is impossible know where or how to refine a user's experience without that context.

Monitoring the Impact on End User Experience Across Infrastructure Tiers

Increasingly, today's applications are built from loosely coupled components that can exist in many different places and in many different infrastructure tiers — even within a single organization. Tracing root causes of end user experience problems is more complicated now, given the different infrastructure tiers in place.

In order to improve that end user experience, you need tools that can provide a comprehensive view of all those infrastructure elements — and show you how data and messages are moving between those elements.

Generating Synthetic Transactions For Measuring End User Performance

Finally, the ability to monitor the end user experience and trace root causes of problems across different transactions and infrastructure elements is crucial when an end user calls to report a problem. With these tools, you can find and fix a problem quickly.

However, it would be better to monitor the system proactively, finding end user experience problems before the end users report them. If you are able to do that, you could eliminate a large number of poor experiences before users even encounter them.

Passive monitoring tools can provide insights into the end user experience from outside the firewall. They can monitor the transactions, the transitions from page to page in a web application, and how much time it takes before the user can move on to a next step while waiting for a transaction to complete.

Active monitoring tools, in contrast, can create synthetic transactions that you can use to understand end user experience without the end user's involvement. They enable you to get a jump on end user experience management, because you can find and fix problems before the users do.

Ultimately, when you're looking at APM, you need to pay particular attention to the tools that enable you to monitor and manage the experience of the end user. The traditional APM tools are powerful tools for managing traditional applications, but as newer applications veer away from the traditional development and deployment models, you need tools that can focus on the end user experience, in order to understand how best to use the APM tools to modify the application delivery environment.

Create the right user experience, and you will keep more customers. They will be engaged with the experience you have created — and that, ultimately, is the best measure of application performance.

About Raj Sabhlok and Suvish Viswanathan

Raj Sabhlok is the President of ManageEngine. Suvish Viswanathan is an APM Research Analyst at ManageEngine. ​ ManageEngine is a division of Zoho Corp. and makers of a globally renowned suite of cost-effective network, systems, security, and applications management software solutions.

Related Links:

Click to read "Another Look at Gartner's 5 Dimensions of APM" by Raj Sabhlok and Suvish Viswanathan

Share this

The Latest

September 17, 2020
One of the benefits of doing the <span style="font-style: italic;">EMA Radar Report: AIOps- A Guide for Investing in Innovation</span> was getting data from all 17 vendors on critical areas ranging from deployment and adoption challenges, to cost and pricing, to architectural and functionality insights across everything from heuristics, to automation, and data assimilation ...
September 16, 2020

When you consider that the average end-user interacts with at least 8 applications, then think about how important those applications are in the overall success of the business and how often the interface between the application and the hardware needs to be updated, it's a potential minefield for business operations. Any single update could explode in your face at any time ...

September 15, 2020

Despite the efforts in modernizing and building a robust infrastructure, IT teams routinely deal with the application, database, hardware, or software outages that can last from a few minutes to several days. These types of incidents can cause financial losses to businesses and damage its reputation ...

September 14, 2020

In Episode 7, Will Cappelli, Field CTO of Moogsoft and Former Gartner Research VP, joins the AI+ITOPS Podcast to discuss the future of APM, AIOps and Observability ...

September 11, 2020

Mark Thiele on the AI+ITOPS Podcast: "I believe AIOps will be everywhere, or you will be failing if you're attempting to do scale ..."

September 10, 2020

How is the AIOps market evolving? The answer in five words is: "Toward increasing levels of diversity." In the EMA Radar Report AIOps: A Guide for Investing in Innovation, EMA examined 17 vendors with cross-domain AIOps capabilities, along with doing 31 deployment interviews, and discovered a high degree of variety in design, functionality and purpose ...

September 09, 2020

In 2020, our society is undergoing massive upheaval and businesses are being forced to adapt on the fly. During this period of crisis, the companies that make the necessary adjustments the quickest will succeed. We're already seeing it happen in the accelerated push toward digitization, as companies that smoothly digitize their customer experiences move forward and those that don't get left behind ...

September 08, 2020

In Episode 6, Mark Thiele, Co-Founder and CEO of Edgevana, joins the AI+ITOPS Podcast to discuss taking AIOps to the edge ...

September 04, 2020

Bhanu Singh on the AI+ITOPS Podcast: "AIOps is an enabler for us to manage the complex digital world that we are stepping in at lightning speed ..."

September 03, 2020
Businesses — in order to remain competitive, agile, innovative, secure, and profitable — are embracing digital transformation. However, achieving success has often been a pipedream for many given the need to usher in cultural change and upgrade of the legacy systems. So, even when business leaders are in agreement with the need for embracing enterprise digital transformation, why is it that only a few have implemented it? What are the biggest barriers to a successful digital transformation initiative? Let us find out ...