Skip to main content

Who's Doing Your ECM QA? Your Users?

Dave Gibson

End users are increasingly demanding. Not many years ago, expectations for apps and performance were set by experience with in-house systems. Now, users’ expectations are set by social media interaction in terms of interfaces and performance. Everyone expects high-performance access – both in their personal lives and for their knowledge worker applications.

ECM (Enterprise Content Management) systems, and their supporting IT and application teams, know this all too well. How often have you heard, “It’s taking forever to download a document,” or “search is taking forever!”

Two big problems are revealed - what do these ambiguous performance comments mean in terms of measured ECM application service levels AND why are you hearing about this problem from your end user? These problems lead to more questions. How do you diagnose the issue? What does forever mean? Why does the user know about their performance problems before you do?

The recent survey, Managing and Monitoring Business-Critical Content and Capture Applications, executed by AIIM and Reveille revealed critical statistics about these concerns.

■ 72% of organizations said their current performance monitoring was “manual – triggered by incidents/support calls.”

■ Of the companies surveyed, only 20% had dedicated content monitoring products that helped them find ECM-specific problems before their end users are affected.

■ Systems with 1000+ users created 60-150 support tickets per month.

This might be one reason that adoption and expansion of ECM solutions is such a challenge for organizations. According to a Forrester Global Enterprise Content Management and Archiving Online survey, “48% find user adoption of existing ECM solutions to be a challenge facing their organization”. (Five Key Trends That Are Shaping How We Manage Enterprise Content, Forrester Research, Inc., September 19, 2014)

Rethinking QA – Ongoing, Not One-Time

To get ahead of these support calls and improve end-user satisfaction, ECM support teams need to proactively manage their ECM application performance. Say goodbye to the days of testing only prior to upgrades and migrations, with ideal use cases, and a limited set of users. Say good riddance to relying on synthetic logins and scripts to tell you (by simulation) what your end-users are experiencing after deployment. And yes, let’s drop ambiguous performance descriptions like slow and “forever.”

In today’s demanding environment, with new case management and workflow-based applications, ECM applications are becoming increasingly mission-critical. Here are the top four items you need to know about your ECM environment to support continuous improvement and ensure your end users aren’t the ones dong your QA:

■ Know actual, named end-user's experience by having insight into their real-time transactions and response times.

■ Know your systems actual usage – both volume and transactions for a normal operations and peak loading scenarios.

■ Know when a problem is about to strike by leveraging thresholds, so you can be alerted when performance is starting to falter, before end-users feel the impact.

■ Know how to correlate issues between ECM platform performance and your end-user experience to more quickly diagnose problems.

There are many other important aspects to managing your ECM – benchmarking, trending, automatic repairs and more – but by focusing on the actual end-user experience, you’ll be one step closer to ensuring peak ECM performance and widespread adoption.

Dave Gibson is COO of Reveille Software.

The Latest

In the early days of the cloud revolution, business leaders perceived cloud services as a means of sidelining IT organizations. IT was too slow, too expensive, or incapable of supporting new technologies. With a team of developers, line of business managers could deploy new applications and services in the cloud. IT has been fighting to retake control ever since. Today, IT is back in the driver's seat, according to new research by Enterprise Management Associates (EMA) ...

In today's fast-paced and increasingly complex network environments, Network Operations Centers (NOCs) are the backbone of ensuring continuous uptime, smooth service delivery, and rapid issue resolution. However, the challenges faced by NOC teams are only growing. In a recent study, 78% state network complexity has grown significantly over the last few years while 84% regularly learn about network issues from users. It is imperative we adopt a new approach to managing today's network experiences ...

Image
Broadcom

From growing reliance on FinOps teams to the increasing attention on artificial intelligence (AI), and software licensing, the Flexera 2025 State of the Cloud Report digs into how organizations are improving cloud spend efficiency, while tackling the complexities of emerging technologies ...

Today, organizations are generating and processing more data than ever before. From training AI models to running complex analytics, massive datasets have become the backbone of innovation. However, as businesses embrace the cloud for its scalability and flexibility, a new challenge arises: managing the soaring costs of storing and processing this data ...

Despite the frustrations, every engineer we spoke with ultimately affirmed the value and power of OpenTelemetry. The "sucks" moments are often the flip side of its greatest strengths ... Part 2 of this blog covers the powerful advantages and breakthroughs — the "OTel Rocks" moments ...

OpenTelemetry (OTel) arrived with a grand promise: a unified, vendor-neutral standard for observability data (traces, metrics, logs) that would free engineers from vendor lock-in and provide deeper insights into complex systems ... No powerful technology comes without its challenges, and OpenTelemetry is no exception. The engineers we spoke with were frank about the friction points they've encountered ...

Enterprises are turning to AI-powered software platforms to make IT management more intelligent and ensure their systems and technology meet business needs for efficiency, lowers costs and innovation, according to new research from Information Services Group ...

The power of Kubernetes lies in its ability to orchestrate containerized applications with unparalleled efficiency. Yet, this power comes at a cost: the dynamic, distributed, and ephemeral nature of its architecture creates a monitoring challenge akin to tracking a constantly shifting, interconnected network of fleeting entities ... Due to the dynamic and complex nature of Kubernetes, monitoring poses a substantial challenge for DevOps and platform engineers. Here are the primary obstacles ...

The perception of IT has undergone a remarkable transformation in recent years. What was once viewed primarily as a cost center has transformed into a pivotal force driving business innovation and market leadership ... As someone who has witnessed and helped drive this evolution, it's become clear to me that the most successful organizations share a common thread: they've mastered the art of leveraging IT advancements to achieve measurable business outcomes ...

More than half (51%) of companies are already leveraging AI agents, according to the PagerDuty Agentic AI Survey. Agentic AI adoption is poised to accelerate faster than generative AI (GenAI) while reshaping automation and decision-making across industries ...

Image
Pagerduty

 

Who's Doing Your ECM QA? Your Users?

Dave Gibson

End users are increasingly demanding. Not many years ago, expectations for apps and performance were set by experience with in-house systems. Now, users’ expectations are set by social media interaction in terms of interfaces and performance. Everyone expects high-performance access – both in their personal lives and for their knowledge worker applications.

ECM (Enterprise Content Management) systems, and their supporting IT and application teams, know this all too well. How often have you heard, “It’s taking forever to download a document,” or “search is taking forever!”

Two big problems are revealed - what do these ambiguous performance comments mean in terms of measured ECM application service levels AND why are you hearing about this problem from your end user? These problems lead to more questions. How do you diagnose the issue? What does forever mean? Why does the user know about their performance problems before you do?

The recent survey, Managing and Monitoring Business-Critical Content and Capture Applications, executed by AIIM and Reveille revealed critical statistics about these concerns.

■ 72% of organizations said their current performance monitoring was “manual – triggered by incidents/support calls.”

■ Of the companies surveyed, only 20% had dedicated content monitoring products that helped them find ECM-specific problems before their end users are affected.

■ Systems with 1000+ users created 60-150 support tickets per month.

This might be one reason that adoption and expansion of ECM solutions is such a challenge for organizations. According to a Forrester Global Enterprise Content Management and Archiving Online survey, “48% find user adoption of existing ECM solutions to be a challenge facing their organization”. (Five Key Trends That Are Shaping How We Manage Enterprise Content, Forrester Research, Inc., September 19, 2014)

Rethinking QA – Ongoing, Not One-Time

To get ahead of these support calls and improve end-user satisfaction, ECM support teams need to proactively manage their ECM application performance. Say goodbye to the days of testing only prior to upgrades and migrations, with ideal use cases, and a limited set of users. Say good riddance to relying on synthetic logins and scripts to tell you (by simulation) what your end-users are experiencing after deployment. And yes, let’s drop ambiguous performance descriptions like slow and “forever.”

In today’s demanding environment, with new case management and workflow-based applications, ECM applications are becoming increasingly mission-critical. Here are the top four items you need to know about your ECM environment to support continuous improvement and ensure your end users aren’t the ones dong your QA:

■ Know actual, named end-user's experience by having insight into their real-time transactions and response times.

■ Know your systems actual usage – both volume and transactions for a normal operations and peak loading scenarios.

■ Know when a problem is about to strike by leveraging thresholds, so you can be alerted when performance is starting to falter, before end-users feel the impact.

■ Know how to correlate issues between ECM platform performance and your end-user experience to more quickly diagnose problems.

There are many other important aspects to managing your ECM – benchmarking, trending, automatic repairs and more – but by focusing on the actual end-user experience, you’ll be one step closer to ensuring peak ECM performance and widespread adoption.

Dave Gibson is COO of Reveille Software.

The Latest

In the early days of the cloud revolution, business leaders perceived cloud services as a means of sidelining IT organizations. IT was too slow, too expensive, or incapable of supporting new technologies. With a team of developers, line of business managers could deploy new applications and services in the cloud. IT has been fighting to retake control ever since. Today, IT is back in the driver's seat, according to new research by Enterprise Management Associates (EMA) ...

In today's fast-paced and increasingly complex network environments, Network Operations Centers (NOCs) are the backbone of ensuring continuous uptime, smooth service delivery, and rapid issue resolution. However, the challenges faced by NOC teams are only growing. In a recent study, 78% state network complexity has grown significantly over the last few years while 84% regularly learn about network issues from users. It is imperative we adopt a new approach to managing today's network experiences ...

Image
Broadcom

From growing reliance on FinOps teams to the increasing attention on artificial intelligence (AI), and software licensing, the Flexera 2025 State of the Cloud Report digs into how organizations are improving cloud spend efficiency, while tackling the complexities of emerging technologies ...

Today, organizations are generating and processing more data than ever before. From training AI models to running complex analytics, massive datasets have become the backbone of innovation. However, as businesses embrace the cloud for its scalability and flexibility, a new challenge arises: managing the soaring costs of storing and processing this data ...

Despite the frustrations, every engineer we spoke with ultimately affirmed the value and power of OpenTelemetry. The "sucks" moments are often the flip side of its greatest strengths ... Part 2 of this blog covers the powerful advantages and breakthroughs — the "OTel Rocks" moments ...

OpenTelemetry (OTel) arrived with a grand promise: a unified, vendor-neutral standard for observability data (traces, metrics, logs) that would free engineers from vendor lock-in and provide deeper insights into complex systems ... No powerful technology comes without its challenges, and OpenTelemetry is no exception. The engineers we spoke with were frank about the friction points they've encountered ...

Enterprises are turning to AI-powered software platforms to make IT management more intelligent and ensure their systems and technology meet business needs for efficiency, lowers costs and innovation, according to new research from Information Services Group ...

The power of Kubernetes lies in its ability to orchestrate containerized applications with unparalleled efficiency. Yet, this power comes at a cost: the dynamic, distributed, and ephemeral nature of its architecture creates a monitoring challenge akin to tracking a constantly shifting, interconnected network of fleeting entities ... Due to the dynamic and complex nature of Kubernetes, monitoring poses a substantial challenge for DevOps and platform engineers. Here are the primary obstacles ...

The perception of IT has undergone a remarkable transformation in recent years. What was once viewed primarily as a cost center has transformed into a pivotal force driving business innovation and market leadership ... As someone who has witnessed and helped drive this evolution, it's become clear to me that the most successful organizations share a common thread: they've mastered the art of leveraging IT advancements to achieve measurable business outcomes ...

More than half (51%) of companies are already leveraging AI agents, according to the PagerDuty Agentic AI Survey. Agentic AI adoption is poised to accelerate faster than generative AI (GenAI) while reshaping automation and decision-making across industries ...

Image
Pagerduty