2022 App Stability Report: Driving Quality with Visibility
September 20, 2022

Michael Olechna
SmartBear

Share this

Users today expect a seamless, uninterrupted experience when interacting with their web and mobile apps. Their expectations have continued to grow in tandem with their appetite for new features and consistent updates. Mobile apps have responded by increasing their release cadence by up to 40%, releasing a new full version of their app every 4-5 days, as determined in this year's SmartBear State of Software Quality | Application Stability Index report.

When examining last year's report, mobile apps were on average issuing a new release once a week, about once every seven days. To accommodate the market's new standard of faster releases, a growing number of mobile apps are adopting progressive delivery practices, like feature flags and experiments, to accelerate the release of new features while minimizing the risk of releasing new errors to their user base that would impact the stability of their applications.

Stability score measures the percentage of app sessions that are crash-free, providing visibility into app health as well as user experience. It can be thought of as a barometer of quality and quantity: the lower the number of errors in your app, the higher your stability score is and the quality of your app.

Overall, there is a continuing trend of increasing stability among web and mobile apps with the industry striving for five nines or 99.999% stability. In last year's report, mobile apps had a median stability score of 99.80%. In the 2020 report, the last direct comparison of web and mobile app stability score, mobile apps outscored web apps by a significant margin, 99.63% to 99.39%. Perhaps the most surprising finding of this year's report is the revelation web apps had a higher stability score, 99.94%, than their mobile counterparts score of 99.88%.

Diving deeper into the data provides some insight into why web app scores were much higher than in 2020 and against this year's mobile median score. The top two industries by stability score in the report were Media and Entertainment, 99.97% and e-commerce, 99.94%. Media and Entertainment had a strong web app presence, especially with the takeoff of streaming media in the past year. As many newcomers attempt to grow their users, it remains essential for them to provide an optimal, uninterrupted experience. Meanwhile, to retain their massive subscriber base against increased competition, streaming giants seek to strike a balance between delivering a seamless experience and consistently offering new features to enhance their application — across a range of devices.

On the other hand, perhaps no better example of the link between stability and revenue can be thought of than e-commerce applications. The last moment any organization wants their app to crash is during the checkout process. As worldwide e-commerce revenue expects to climb past $5.5 trillion in 2022, one can assume there is a lot of money in customers' carts when they arrive at checkout. Giving customers a smooth experience is paramount, as crashes directly impact revenue.

These two industries provide a model that the lowest scoring industries in the report can learn from. As in previous reports, Gaming was the lowest scoring industry at 99.60%, with the widest range of score distribution between apps. Health and Wellness did not fare much better, scoring the second-lowest at 99.71%. The low stability score of Health and Wellness combined with its median release cadence of every other day and the widest release distribution of all industries demonstrates a balance must be reached between roadmap agility and app stability.

With the user experience becoming increasingly dominant to app success, app stability has evolved into application observability as the need for visibility into software releases has grown. Perhaps most importantly, we're learning that visibility into app stability is key for innovating quickly and delivering apps with speed and confidence.

Michael Olechna is Product Marketing Manager for BugSnag at SmartBear
Share this

The Latest

February 29, 2024

Despite the growth in popularity of artificial intelligence (AI) and ML across a number of industries, there is still a huge amount of unrealized potential, with many businesses playing catch-up and still planning how ML solutions can best facilitate processes. Further progression could be limited without investment in specialized technical teams to drive development and integration ...

February 28, 2024

With over 200 streaming services to choose from, including multiple platforms featuring similar types of entertainment, users have little incentive to remain loyal to any given platform if it exhibits performance issues. Big names in streaming like Hulu, Amazon Prime and HBO Max invest thousands of hours into engineering observability and closed-loop monitoring to combat infrastructure and application issues, but smaller platforms struggle to remain competitive without access to the same resources ...

February 27, 2024

Generative AI has recently experienced unprecedented dramatic growth, making it one of the most exciting transformations the tech industry has seen in some time. However, this growth also poses a challenge for tech leaders who will be expected to deliver on the promise of new technology. In 2024, delivering tangible outcomes that meet the potential of AI, and setting up incubator projects for the future will be key tasks ...

February 26, 2024

SAP is a tool for automating business processes. Managing SAP solutions, especially with the shift to the cloud-based S/4HANA platform, can be intricate. To explore the concerns of SAP users during operational transformations and automation, a survey was conducted in mid-2023 by Digitate and Americas' SAP Users' Group ...

February 22, 2024

Some companies are just starting to dip their toes into developing AI capabilities, while (few) others can claim they have built a truly AI-first product. Regardless of where a company is on the AI journey, leaders must understand what it means to build every aspect of their product with AI in mind ...

February 21, 2024

Generative AI will usher in advantages within various industries. However, the technology is still nascent, and according to the recent Dynatrace survey there are many challenges and risks that organizations need to overcome to use this technology effectively ...

February 20, 2024

In today's digital era, monitoring and observability are indispensable in software and application development. Their efficacy lies in empowering developers to swiftly identify and address issues, enhance performance, and deliver flawless user experiences. Achieving these objectives requires meticulous planning, strategic implementation, and consistent ongoing maintenance. In this blog, we're sharing our five best practices to fortify your approach to application performance monitoring (APM) and observability ...

February 16, 2024

In MEAN TIME TO INSIGHT Episode 3, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at Enterprise Management Associates (EMA) discusses network security with Chris Steffen, VP of Research Covering Information Security, Risk, and Compliance Management at EMA ...

February 15, 2024

In a time where we're constantly bombarded with new buzzwords and technological advancements, it can be challenging for businesses to determine what is real, what is useful, and what they truly need. Over the years, we've witnessed the rise and fall of various tech trends, such as the promises (and fears) of AI becoming sentient and replacing humans to the declaration that data is the new oil. At the end of the day, one fundamental question remains: How can companies navigate through the tech buzz and make informed decisions for their future? ...

February 14, 2024

We increasingly see companies using their observability data to support security use cases. It's not entirely surprising given the challenges that organizations have with legacy SIEMs. We wanted to dig into this evolving intersection of security and observability, so we surveyed 500 security professionals — 40% of whom were either CISOs or CSOs — for our inaugural State of Security Observability report ...