2022 App Stability Report: Driving Quality with Visibility
September 20, 2022

Michael Olechna
SmartBear

Share this

Users today expect a seamless, uninterrupted experience when interacting with their web and mobile apps. Their expectations have continued to grow in tandem with their appetite for new features and consistent updates. Mobile apps have responded by increasing their release cadence by up to 40%, releasing a new full version of their app every 4-5 days, as determined in this year's SmartBear State of Software Quality | Application Stability Index report.

When examining last year's report, mobile apps were on average issuing a new release once a week, about once every seven days. To accommodate the market's new standard of faster releases, a growing number of mobile apps are adopting progressive delivery practices, like feature flags and experiments, to accelerate the release of new features while minimizing the risk of releasing new errors to their user base that would impact the stability of their applications.

Stability score measures the percentage of app sessions that are crash-free, providing visibility into app health as well as user experience. It can be thought of as a barometer of quality and quantity: the lower the number of errors in your app, the higher your stability score is and the quality of your app.

Overall, there is a continuing trend of increasing stability among web and mobile apps with the industry striving for five nines or 99.999% stability. In last year's report, mobile apps had a median stability score of 99.80%. In the 2020 report, the last direct comparison of web and mobile app stability score, mobile apps outscored web apps by a significant margin, 99.63% to 99.39%. Perhaps the most surprising finding of this year's report is the revelation web apps had a higher stability score, 99.94%, than their mobile counterparts score of 99.88%.

Diving deeper into the data provides some insight into why web app scores were much higher than in 2020 and against this year's mobile median score. The top two industries by stability score in the report were Media and Entertainment, 99.97% and e-commerce, 99.94%. Media and Entertainment had a strong web app presence, especially with the takeoff of streaming media in the past year. As many newcomers attempt to grow their users, it remains essential for them to provide an optimal, uninterrupted experience. Meanwhile, to retain their massive subscriber base against increased competition, streaming giants seek to strike a balance between delivering a seamless experience and consistently offering new features to enhance their application — across a range of devices.

On the other hand, perhaps no better example of the link between stability and revenue can be thought of than e-commerce applications. The last moment any organization wants their app to crash is during the checkout process. As worldwide e-commerce revenue expects to climb past $5.5 trillion in 2022, one can assume there is a lot of money in customers' carts when they arrive at checkout. Giving customers a smooth experience is paramount, as crashes directly impact revenue.

These two industries provide a model that the lowest scoring industries in the report can learn from. As in previous reports, Gaming was the lowest scoring industry at 99.60%, with the widest range of score distribution between apps. Health and Wellness did not fare much better, scoring the second-lowest at 99.71%. The low stability score of Health and Wellness combined with its median release cadence of every other day and the widest release distribution of all industries demonstrates a balance must be reached between roadmap agility and app stability.

With the user experience becoming increasingly dominant to app success, app stability has evolved into application observability as the need for visibility into software releases has grown. Perhaps most importantly, we're learning that visibility into app stability is key for innovating quickly and delivering apps with speed and confidence.

Michael Olechna is Product Marketing Manager at SmartBear
Share this

The Latest

October 03, 2022

IT engineers and executives are responsible for system reliability and availability. The volume of data can make it hard to be proactive and fix issues quickly. With over a decade of experience in the field, I know the importance of IT operations analytics and how it can help identify incidents and enable agile responses ...

September 30, 2022

For businesses with vast and distributed computing infrastructures, one of the main objectives of IT and network operations is to locate the cause of a service condition that is having an impact. The more human resources are put into the task of gathering, processing, and finally visual monitoring the massive volumes of event and log data that serve as the main source of symptomatic indications for emerging crises, the closer the service is to the company's source of revenue ...

September 29, 2022

Our digital economy is intolerant of downtime. But consumers haven't just come to expect always-on digital apps and services. They also expect continuous innovation, new functionality and lightening fast response times. Organizations have taken note, investing heavily in teams and tools that supposedly increase uptime and free resources for innovation. But leaders have not realized this "throw money at the problem" approach to monitoring is burning through resources without much improvement in availability outcomes ...

September 28, 2022

Although 83% of businesses are concerned about a recession in 2023, B2B tech marketers can look forward to growth — 51% of organizations plan to increase IT budgets in 2023 vs. a narrow 6% that plan to reduce their spend, according to the 2023 State of IT report from Spiceworks Ziff Davis ...

September 27, 2022

Users have high expectations around applications — quick loading times, look and feel visually advanced, with feature-rich content, video streaming, and multimedia capabilities — all of these devour network bandwidth. With millions of users accessing applications and mobile apps from multiple devices, most companies today generate seemingly unmanageable volumes of data and traffic on their networks ...

September 26, 2022

In Italy, it is customary to treat wine as part of the meal ... Too often, testing is treated with the same reverence as the post-meal task of loading the dishwasher, when it should be treated like an elegant wine pairing ...

September 23, 2022

In order to properly sort through all monitoring noise and identify true problems, their causes, and to prioritize them for response by the IT team, they have created and built a revolutionary new system using a meta-cognitive model ...

September 22, 2022

As we shift further into a digital-first world, where having a reliable online experience becomes more essential, Site Reliability Engineers remain in-demand among organizations of all sizes ... This diverse set of skills and values can be difficult to interview for. In this blog, we'll get you started with some example questions and processes to find your ideal SRE ...

September 21, 2022

US government agencies are bringing more of their employees back into the office and implementing hybrid work schedules, but federal workers are worried that their agencies' IT architectures aren't built to handle the "new normal." They fear that the reactive, manual methods used by the current systems in dealing with user, IT architecture and application problems will degrade the user experience and negatively affect productivity. In fact, according to a recent survey, many federal employees are concerned that they won't work as effectively back in the office as they did at home ...

September 20, 2022

Users today expect a seamless, uninterrupted experience when interacting with their web and mobile apps. Their expectations have continued to grow in tandem with their appetite for new features and consistent updates. Mobile apps have responded by increasing their release cadence by up to 40%, releasing a new full version of their app every 4-5 days, as determined in this year's SmartBear State of Software Quality | Application Stability Index report ...