While Quality Owners Might Change, Similar Challenges Continue
October 07, 2021

Noel Wurst
SmartBear

SmartBear recently released the results of its 2021 State of Software Quality | Testing survey, my personal favorite of the company's reports. While I do work for SmartBear, my interest in these non-product-promotional surveys is purely due to my fascination with the world of software quality, and the evolution we're seeing around who owns quality, the challenges that quality owners face, and what they feel will solve those challenges.


I don't feel too bad about revealing this spoiler, because I doubt you'll be surprised to hear that a "lack of time" was reported as the number one challenge to doing more testing, especially as release frequencies continue to increase. However, it was disheartening to see that a lack of time was also the number one response when we asked people to identify the biggest blocker to professional development.

We also asked respondents what testing activity is the most time-intensive task within the time they are able to dedicate to testing, and the number one answer was disheartening again.

23% of respondents reported that "writing manual test cases" is the biggest culprit.

Why is that disheartening?

I would argue that writing out test cases isn't actually testing. It's a testing-related activity, sure, and maybe even a necessary one.

But can you say that the single act of writing out test cases actually improves the quality of your software?

Would your customers say the same?

The second-place answer, coming in at only 1% less at 22% was "learning how to use test tools." Again, a necessary requirement and skill, but learning how to use a tool to test is not testing. What I find humorous, but not surprising at all, is that in this year's survey, we asked respondents for the number one quality they look for in API tooling.

What would you guess the number one answer was?

Most powerful features?

The latest AI/ML innovations?

Nope. "Ease of use."

One trend that's been interesting to observe — from within this survey and in the industry at large — is looking at who owns quality in an organization. In the past, it was largely, if not entirely, owned by manual QA teams. But today, quality owners possess any number of professional titles and backgrounds: manual or exploratory testers, automation engineers, SDETs, business analysts, DevOps teams, or probably the fastest growing group of quality owners — developers.

Even as an exploratory testing enthusiast myself, I'm thrilled to see developers share the responsibility of testing. However, one result that completely surprised me was finding out just how much time developers say they are spending on testing in an average week. Developers were one of the only roles to state that they're spending more time on testing in 2021 than they did in years' past and this percentage is increasing every year (automation engineers, manual testers, and business analysts all reported a decrease in 2021). Developers reported spending, on average, 47% of their week testing. What? Really?

Do developers want to spend nearly 50% of their week not developing new software? From all the testers I've ever spoken to, few would want to spend 50% of their week not testing. I won't be surprised at all to one day see every developer claim to also be a fellow quality owner like their tester counterparts, but at what percentage over 50% of a developer's week being taken up by testing do they simply become … a tester?

There's simply too much actual testing that needs to be done, too many accelerated release cadence goals to hit, and too many bugs to eliminate from the last release(!) to envision those who own software quality being able to continually deliver on our promises to customers. Not if we continue to struggle to spend time on what directly impacts our customers, because too much of our time is stuck doing what doesn't.

Noel Wurst is Software Quality Evangelist at SmartBear
Share this

Industry News

March 18, 2024

Kubiya.ai announces the launch of its DevOps Digital Agents.

March 18, 2024

Aviatrix® introduced Aviatrix Distributed Cloud Firewall for Kubernetes, a distributed cloud networking and network security solution for containerized enterprise applications and workloads.

March 18, 2024

Stride announces the general availability of Stride Conductor, its new autonomous coding product that transforms the software development landscape.

March 14, 2024

CircleCI unveiled CircleCI releases, which enables developers to automate the release orchestration process directly from the CircleCI UI.

March 13, 2024

Fermyon™ Technologies announces Fermyon Platform for Kubernetes, a WebAssembly platform for Kubernetes.

March 13, 2024

Akuity announced a new offer targeted at Enterprises and businesses where security and compliance are key.

March 13, 2024

New Relic launched new capabilities for New Relic IAST (Interactive Application Security Testing), including proof-of-exploit reporting for application security testing.

March 12, 2024

OutSystems announced AI Agent Builder, a new solution in the OutSystems Developer Cloud platform that makes it easy for IT leaders to incorporate generative AI (GenAI) powered applications into their digital transformation strategy, as well as govern the use of AI to ensure standardization and security.

March 12, 2024

Mirantis announced significant updates to Lens Desktop that makes working with Kubernetes easier by simplifying operations, improving efficiency, and increasing productivity. Lens 2024 Early Access is now available to Lens users.

March 12, 2024

Codezero announced a $3.5 million seed-funding round led by Ballistic Ventures, the venture capital firm dedicated exclusively to funding entrepreneurs and innovations in cybersecurity.

March 11, 2024

Prismatic launched a code-native integration building experience.

March 07, 2024

Check Point® Software Technologies Ltd. announced its Check Point Infinity Platform has been ranked as the #1 Zero Trust Platform in the latest Miercom Zero Trust Platform Assessment.

March 07, 2024

Tricentis announced the launch and availability of SAP Test Automation by Tricentis as an SAP Solution Extension.

March 07, 2024

Netlify announced the general availability of the AI-enabled deploy assist.

March 07, 2024

DataStax announced a new integration with Airbyte that simplifies the process of building production-ready GenAI applications with structured and unstructured data.