According to eMarketer, as of 2014 Americans consume more media using mobile devices than laptops and desktops combined. This shift in consumer behavior is also occurring within corporations, as employees increasingly rely on mobile devices for their work.
With such a surge in mobile usage there is a growing need for corporations to ensure that their mobile experience is high quality and not broken.
Since 86% of mobile experiences occur within apps and not mobile browsers [source: Flurry], focusing on improving app performance has a larger impact on mobile quality.
The following are 4 key differences that companies monitoring their server (and website) performance should consider when selecting a mobile app performance monitoring solution.
1. Different Team, Different Needs
At most companies, mobile teams are not part of the server/website teams. Instead mobile teams are completely separate and in many cases they are an outsourced team.
The mobile teams have unique pain points when releasing mobile apps that are different from those of web and backend developers (more on this below). Solutions that slightly tweak the interface of a server performance monitoring service do not cut it. These teams require solutions designed from the ground up to solve their problems.
2. Scaling vs. Fragmentation Challenge
Developers on server teams face scaling problems. When a website or backend developer writes a line of code they need to ensure that it performs well as traffic grows and lots of users hit that code.
On the other hand developers on mobile teams face fragmentation problems. When a mobile developer writes a line of code they need to ensure that it will run well on thousands of device configurations, including varying device types, connection types, and OS versions.
A recent study by OpenSignal found that there are over 18,000 types of Android devices. How does a mobile developer confirm that their app code doesn’t break across all these devices? There is only one way, monitor production performance using a service that makes it easy to slide and dice the live performance.
3. Network vs. Device Performance
Server teams are primarily concerned with network performance. When the network is slow the bits don’t get downloaded to the thin client, usually a browser, and the end user suffers.
Mobile teams however are concerned with much more than just the network performance; they are dealing with low-end devices running their evolving client code base.
Unique challenges for mobile app developers include:
- How smooth are the interactions (e.g. scrolling)?
- Are apps hitting memory limits on certain devices hurting the user experience?
- Are users on lower end devices waiting an unreasonable amount of time for calculations to finish?
- Is the app draining the battery at an unreasonable rate?
A performance solution for mobile developers needs to be much more comprehensive in the type of metrics captured, and go beyond simply reporting on network issues.
4. Greater Variability of User Experiences
Unlike desktops and laptops, which are high-powered devices often used indoors on reliable networks, mobile devices have more chaotic environments with a wide range of capabilities running on top of unreliable networks.
Since mobile has more variability, performance monitoring solutions need to remove noise from the data to make it usable. For example, the ability to slice and dice the data to view the data that matters, like performance in the US of the latest app version on older but popular handsets.
Mobile performance monitoring solutions should also provide the ability to handle noise introduced by outliers that distort the average performance. This can be addressed by metrics like 95th percentile performance, which are more representative of a slow experience, and 50th percentile performance, to better measure the typical experience.
Finally, noise is created by interrupted app sessions like answering a phone call in the middle of a session. Solutions that detect and handle interruptions present a clearer picture of true performance.
As users migrate to using mobile apps, businesses face a challenge ensuring the same high quality experiences provided on the Web. In selecting a mobile performance monitoring service to help discover and prioritize outstanding issues, businesses should consider the unique pain points their mobile teams face as outlined above.
ABOUT Ofer Ronen
Ofer Ronen is the Co-founder and CEO of Pulse.io, a performance monitoring service for mobile app developers. The service monitors over 400 monthly sessions for companies of all sizes. It is unique in the level of performance metrics reported, ensuring that issues are not missed. Ronen previously was CEO of Sendori (sold to IAC), a mobile and web ad network. He received a computer engineering MS/BS from Michigan, and MBA from Cornell.
Many pitfalls await CIOs on the journey to the cloud. In fact, a majority of companies have been only partially successful, while some are outright failing. To learn more about this migration, Business Performance Innovation (BPI) Network surveyed IT and business executives and conducted in-depth interviews ...
The online retail industry has yet to have a Black Friday/Cyber Monday weekend unscathed by web performance (speed and availability) problems. Luckily, performance during 2019's hyper-critical online holiday shopping weekend was better than in years past, as we did not see any systemic, lengthy outages. While no website went completely down, several retailers did experience significant problems. Why have online retailers yet to figure out how to be crash-free during this all-important peak traffic period? We've identified several reasons for this ...
Gartner highlighted the trends that infrastructure and operations (I&O) leaders must start preparing for to support digital infrastructure in 2020 ...
Edge computing usage is starting to increase. The obvious follow-up question is, "So, what can I do with edge computing?" I'm glad you asked. There are lots of things you can do ...
Industry experts offer predictions on how Network Performance Management (NPM) and related technologies will evolve and impact business in 2020. Part 2 offers predictions about 5G and more ...
Industry experts offer predictions on how Network Performance Management (NPM) and related technologies will evolve and impact business in 2020 ...
With AI on the edge, companies will more easily monitor desktops, tablets and other end-user devices. AIOps will enable IT to guide employees on improving productivity from the applications installed on their devices while delivering greater visibility and control around the entire IT environment ...
2020 will see AIOps adoption going mainstream as use cases crystallize for improving IT efficiencies and supporting faster decision-making. Expect AI-enhanced automation to become smarter and more contextual, move towards the edge, and used increasingly for customer and user experience analysis. Yet there are significant challenges and cautions, which will shape AI's development in not only IT but across business and society ...
Industry experts offer predictions on how Digital Transformation will evolve and impact business in 2020 ...
Industry experts offer predictions on how ITSM and related technologies will evolve and impact business in 2020 ...