According to eMarketer, as of 2014 Americans consume more media using mobile devices than laptops and desktops combined. This shift in consumer behavior is also occurring within corporations, as employees increasingly rely on mobile devices for their work.
With such a surge in mobile usage there is a growing need for corporations to ensure that their mobile experience is high quality and not broken.
Since 86% of mobile experiences occur within apps and not mobile browsers [source: Flurry], focusing on improving app performance has a larger impact on mobile quality.
The following are 4 key differences that companies monitoring their server (and website) performance should consider when selecting a mobile app performance monitoring solution.
1. Different Team, Different Needs
At most companies, mobile teams are not part of the server/website teams. Instead mobile teams are completely separate and in many cases they are an outsourced team.
The mobile teams have unique pain points when releasing mobile apps that are different from those of web and backend developers (more on this below). Solutions that slightly tweak the interface of a server performance monitoring service do not cut it. These teams require solutions designed from the ground up to solve their problems.
2. Scaling vs. Fragmentation Challenge
Developers on server teams face scaling problems. When a website or backend developer writes a line of code they need to ensure that it performs well as traffic grows and lots of users hit that code.
On the other hand developers on mobile teams face fragmentation problems. When a mobile developer writes a line of code they need to ensure that it will run well on thousands of device configurations, including varying device types, connection types, and OS versions.
A recent study by OpenSignal found that there are over 18,000 types of Android devices. How does a mobile developer confirm that their app code doesn’t break across all these devices? There is only one way, monitor production performance using a service that makes it easy to slide and dice the live performance.
3. Network vs. Device Performance
Server teams are primarily concerned with network performance. When the network is slow the bits don’t get downloaded to the thin client, usually a browser, and the end user suffers.
Mobile teams however are concerned with much more than just the network performance; they are dealing with low-end devices running their evolving client code base.
Unique challenges for mobile app developers include:
- How smooth are the interactions (e.g. scrolling)?
- Are apps hitting memory limits on certain devices hurting the user experience?
- Are users on lower end devices waiting an unreasonable amount of time for calculations to finish?
- Is the app draining the battery at an unreasonable rate?
A performance solution for mobile developers needs to be much more comprehensive in the type of metrics captured, and go beyond simply reporting on network issues.
4. Greater Variability of User Experiences
Unlike desktops and laptops, which are high-powered devices often used indoors on reliable networks, mobile devices have more chaotic environments with a wide range of capabilities running on top of unreliable networks.
Since mobile has more variability, performance monitoring solutions need to remove noise from the data to make it usable. For example, the ability to slice and dice the data to view the data that matters, like performance in the US of the latest app version on older but popular handsets.
Mobile performance monitoring solutions should also provide the ability to handle noise introduced by outliers that distort the average performance. This can be addressed by metrics like 95th percentile performance, which are more representative of a slow experience, and 50th percentile performance, to better measure the typical experience.
Finally, noise is created by interrupted app sessions like answering a phone call in the middle of a session. Solutions that detect and handle interruptions present a clearer picture of true performance.
Summary
As users migrate to using mobile apps, businesses face a challenge ensuring the same high quality experiences provided on the Web. In selecting a mobile performance monitoring service to help discover and prioritize outstanding issues, businesses should consider the unique pain points their mobile teams face as outlined above.
ABOUT Ofer Ronen
Ofer Ronen is the Co-founder and CEO of Pulse.io, a performance monitoring service for mobile app developers. The service monitors over 400 monthly sessions for companies of all sizes. It is unique in the level of performance metrics reported, ensuring that issues are not missed. Ronen previously was CEO of Sendori (sold to IAC), a mobile and web ad network. He received a computer engineering MS/BS from Michigan, and MBA from Cornell.
The Latest
Most organizations suffer from some form of alert noise. Alert noise is only going to increase as organizations support cloud-native applications spanning multiple public and private clouds, including ephemeral deployments and more. It's not going to get easier for organizations to understand the signal from all those alerts being sent. So what can be done about it? ...
This blog presents the case for a radical new approach to basic information technology (IT) education. This conclusion is based on a study of courses and other forms of IT education which purport to cover IT "fundamentals" ...
To achieve maximum availability, IT leaders must employ domain-agnostic solutions that identify and escalate issues across all telemetry points. These technologies, which we refer to as Artificial Intelligence for IT Operations, create convergence — in other words, they provide IT and DevOps teams with the full picture of event management and downtime ...
APMdigest and leading IT research firm Enterprise Management Associates (EMA) are partnering to bring you the EMA-APMdigest Podcast, a new podcast focused on the latest technologies impacting IT Operations. In Episode 2 - Part 1 Pete Goldin, Editor and Publisher of APMdigest, discusses Network Observability with Shamus McGillicuddy, Vice President of Research, Network Infrastructure and Operations, at EMA ...
CIOs have stepped into the role of digital leader and strategic advisor, according to the 2023 Global CIO Survey from Logicalis ...
Synthetic monitoring is crucial to deploy code with confidence as catching bugs with E2E tests on staging is becoming increasingly difficult. It isn't trivial to provide realistic staging systems, especially because today's apps are intertwined with many third-party APIs ...
Recent EMA field research found that ServiceOps is either an active effort or a formal initiative in 78% of the organizations represented by a global panel of 400+ IT leaders. It is relatively early but gaining momentum across industries and organizations of all sizes globally ...
Managing availability and performance within SAP environments has long been a challenge for IT teams. But as IT environments grow more complex and dynamic, and the speed of innovation in almost every industry continues to accelerate, this situation is becoming a whole lot worse ...
Harnessing the power of network-derived intelligence and insights is critical in detecting today's increasingly sophisticated security threats across hybrid and multi-cloud infrastructure, according to a new research study from IDC ...
Recent research suggests that many organizations are paying for more software than they need. If organizations are looking to reduce IT spend, leaders should take a closer look at the tools being offered to employees, as not all software is essential ...
