Development teams so often find themselves rushing to get a release out on time. When it comes time for testing, the software works fine in the lab. But, when it's released, customers report a bunch of bugs. How does this happen? Why weren't the flaws found in QA?
Welcome to defect fatigue, a common issue that occurs when testers execute the same repetitive automated and manual tests and as a result, skip over or miss defects. Testers need to get creative and investigative to find these well-hidden defects before they slip past QA and into the hands of customers.
Be an Investigator and Break Things
The purpose of exploratory testing is to find defects by breaking application functionality using manual and automated techniques without repetition. The "without repetition" piece is key, and the idea is that teams test to break, rather than confirm. Testers should manipulate connectivity, security, configuration settings, and different user navigation, among others. Other techniques include:
■ creating mind maps to find testing areas to investigate
■ forcing the application to function outside the known paths
■ triggering unexpected errors to discover missing error messaging paths
■ exercising back-end processing and third-party software integrations to see what can be interrupted or failed by unexpected user actions
If an application supports different user roles, testing should be done from these different perspectives and with their respective settings. Testers can also utilize existing browser development tools to find errors that are not always visible in the application UI, and to test and edit to see how the application responds.
Consider the People Element
Testers are also people that use applications every day. They should draw on their own personal experiences with typical application defects to try and break functionality. They should also consider the habits and behaviors of the members of the software development team.
As developers and product managers work more with an application over time, they start to develop habits that may influence how they interact with the software. For example, some developers may only develop code on a local machine while others may only do code reviews instead of pre-testing in a test environment. These are work habits that can lead to defects. On the product side, many product managers habitually create user stories and requirements in the same way, unintentionally leaving out a relevant workflow or configuration setting.
Finding hidden defects requires testing against the grain rather than verifying a function performs as expected. It also requires testing all possible paths that customers might take. Crowdtesting can supplement existing techniques by using real people to serve as proxies for customers. They can test for quality, user-experience and functionality outside the lab, and provide instant, useful feedback.
Testing repeatedly only to have bugs unearthed later by customers is a frustrating and potentially costly endeavor. When testers mix existing techniques with creativity and an understanding of human behavior, they will be able to dig deeper to find bugs and friction points that ultimately improve quality and customer experience before release.
The Latest
Part 4 covers OpenTelemetry: Next year, we're going to see more embrace of OpenTelemetry across the entire industry — opening up the future of instrumentation ...
Part 3 covers even more on Observability: Observability will move up the organization to support the sustainability and FinOps drive. The combined pressure of needing to adopt more sustainable practices and tackle rising cloud costs will catapult observability from an IT priority to a business requirement in 2024 ...
Part 2 covers more on Observability: In 2024, observability platforms will embrace and innovate with new technologies like GenAI for real-time analytics, becoming the fulcrum for digital experience management ...
The Holiday Season means it is time for APMdigest's annual list of Application Performance Management (APM) predictions, covering IT performance topics. Industry experts — from analysts and consultants to the top vendors — offer thoughtful, insightful, and often controversial predictions on how APM, Observability, AIOps and related technologies will evolve and impact business in 2024. Part 1 covers APM and Observability ...
To help you stay on top of the ever-evolving tech scene, Automox IT experts shake the proverbial magic eight ball and share their predictions about tech trends in the coming year. From M&A frenzies to sustainable tech and automation, these forecasts paint an exciting picture of the future ...
Incident management processes are not keeping pace with the demands of modern operations teams, failing to meet the needs of SREs as well as platform and ops teams. Results from the State of DevOps Automation and AI Survey, commissioned by Transposit, point to an incident management paradox. Despite nearly 60% of ITOps and DevOps professionals reporting they have a defined incident management process that's fully documented in one place and over 70% saying they have a level of automation that meets their needs, teams are unable to quickly resolve incidents ...
Today, in the world of enterprise technology, the challenges posed by legacy Virtual Desktop Infrastructure (VDI) systems have long been a source of concern for IT departments. In many instances, this promising solution has become an organizational burden, hindering progress, depleting resources, and taking a psychological and operational toll on employees ...
Within retail organizations across the world, IT teams will be bracing themselves for a hectic holiday season ... While this is an exciting opportunity for retailers to boost sales, it also intensifies severe risk. Any application performance slipup will cause consumers to turn their back on brands, possibly forever. Online shoppers will be completely unforgiving to any retailer who doesn't deliver a seamless digital experience ...
Black Friday is a time when consumers can cash in on some of the biggest deals retailers offer all year long ... Nearly two-thirds of consumers utilize a retailer's web and mobile app for holiday shopping, raising the stakes for competitors to provide the best online experience to retain customer loyalty. Perforce's 2023 Black Friday survey sheds light on consumers' expectations this time of year and how developers can properly prepare their applications for increased online traffic ...