The Internet of Things (IoT) is in position to become one of the greatest application performance management challenges faced by IT. APMdigest asked experts across the industry – including analysts, consultants and vendors – for their recommendations on how to ensure performance for IoT applications. Part 2 covers data and analytics.
7. REAL-TIME DATA
The IoT is still too new and the technologies and protocols too diverse to ensure anything, let alone performance – but that doesn't mean you can't get started. The first step: realizing the IoT operates in real-time. Any performance management for the IoT will have to deal with an ongoing deluge of real-time data.
User engagement is fundamentally changing. The broad scale onset of smart sensors, voice interaction, AR/VR is creating an increasingly connected world where customer engagement spans across digital and physical touch points. To ensure optimal business outcomes, it is imperative for businesses to measure near-live time performance of software across devices, connecting microservices, and the clouds supporting the uniform experience.
GM, Emerging Technologies, AppDynamics
We scaled orders of magnitude when we transformed from Client-Server to Internet. This caused dramatic changes how we built, tested, measured, and maintained our systems. With IoT, it's about to happen again. Sensors and tags aren't clients. They're emitters. IoT will demand capture, analytics, and querying millions of data points an hour, in real time. Anything less would be like claiming data that fits on a laptop is a big data problem.
Product Manager, SOASTA
Big Data flowing from IoT-connected devices helps organizations be more responsive, adaptive and competitive in a constantly changing business environment. The ability to analyze massive volumes of data as they are collected allows businesses to predict and respond to trends with superior accuracy and precision. Data becomes more actionable and reliable the closer it is analyzed to real-time, and for this reason, organizations cannot afford bottlenecks anywhere in the IoT data collection and analysis process.
CEO and Founder, Catchpoint
8. ADVANCED ANALYTICS
People wrongly assume that connectivity is the biggest challenge facing IoT initiatives, when in fact, this is getting easier everyday. The real challenge isn't accessing data, it's gaining knowledge from the data. The more devices we connect, the more noise we create, and — effectively — the more garbage we churn out. Without establishing an intelligent way to make sense of this information, we're simply going to drown in noise.
Advanced analytics is not only critical to maintaining IoT performance, it also influences business, technology and investment decisions. The best way to help IT teams learn what is happening with edge computing and IoT — such as what devices are interacting with others, what levels of performance are normal, and what are anomalies—is to gather operational data from these log files, and use advanced analytics to move from reactive to proactive problem solving. Log files are a source of the truth and advanced analytics can be used to identify pattern, decrease mean time to identification and predict potential issues before they happen. By understanding critical usage system trends, proactive decisions can be made that positively influence the business and ensure the best customer experiences.
Ramin Sayar, CEO of Sumo Logic
President & CEO, Sumo Logic
9. ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING
IoT is going to make Big Data into Giant Data. It's the next level of scale, but what will the impact be? Companies will no longer be able to manage the hundreds of millions of connected devices … you simply can't hire enough people to chase down that many alarms. This is where AI and machine learning becomes a "must have" for IT operations tools. AI learns what is normal and abnormal behavior, then will be able to heal itself before an anomaly causes an incident. AI and machine learning will power the growth of IoT and vice versa.
JF Huard, Ph.D.
Founder and CTO, Perspica
10. DATA BATCHES
One of the biggest challenges of building an IoT application is collating the data from various sources. But when an application makes many repetitive requests to different IoT devices to obtain data, it can slow app performance. As such, the best way to ensure performance of IoT applications is to consolidate data into batches. Data can be pushed to the application at low latency in small chunks, as it becomes available. At the same time, deploying an application through a web browser makes it's usable across an extremely wide variety of devices.
Sales Engineer, Sencha
11. ADHERE TO LAWS OF DATA GRAVITY
IoT is a big contributor to Big Data, generating massive real-time data streams. Therefore, in order to build high-performing IoT applications, it's important to adhere to the laws of data gravity. Data gravity refers to the nature of data and its ability to attract additional applications and services. Developers must bring their applications as close to the (IoT) data as possible, versus the other way around. Cloud and open, extensible platforms are absolutely key to doing this in a quick and cost-effective manner.
12. LINK DATA TO BUSINESS GOALS
Organizations that link their IoT sensor data to a specific business process or target ensure that their results will gain visibility with the most important IoT champions in an organization – Operational Teams. These OT groups are focused on the delivery and improvement of the operational activities associated with an organization. For energy companies, this takes the form of efficient and predictable distributed energy production. By using sensor information associated with solar collection and daylight hours, or wind speed and direction associated with turbine performance, an IoT initiative provides information directly to the OT team operating the distributed power production and managing the efficient use of non-renewal energy sources. With this context, IoT initiatives link directly to operation productivity and OT team goals for maximum value.
John L Myers
Managing Research Director, Enterprise Management Associates (EMA)
Read Top Recommendations to Ensure Performance for the IoT - Part 3, covering app design and development.
The requirements of an APM tool are now much more complex than they've ever been. Not only do they need to trace a user transaction across numerous microservices on the same system, but they also need to happen pretty fast ...
Performance monitoring is an old problem. As technology has advanced, we've had to evolve how we monitor applications. Initially, performance monitoring largely involved sending ICMP messages to start troubleshooting a down or slow application. Applications have gotten much more complex, so this is no longer enough. Now we need to know not just whether an application is broken, but why it broke. So APM has had to evolve over the years for us to get there. But how did this evolution take place, and what happens next? Let's find out ...
There are some IT organizations that are using DevOps methodology but are wary of getting bogged down in ITSM procedures. But without at least some ITSM controls in place, organizations lose their focus on systematic customer engagement, making it harder for them to scale ...
If you have deployed a Java application in production, you've probably encountered a situation where the application suddenly starts to take up a large amount of CPU. When this happens, application response becomes sluggish and users begin to complain about slow response. Often the solution to this problem is to restart the application and, lo and behold, the problem goes away — only to reappear a few days later. A key question then is: how to troubleshoot high CPU usage of a Java application? ...
Operations are no longer tethered tightly to a main office, as the headquarters-centric model has been retired in favor of a more decentralized enterprise structure. Rather than focus the business around a single location, enterprises are now comprised of a web of remote offices and individuals, where network connectivity has broken down the geographic barriers that in the past limited the availability of talent and resources. Key to the success of the decentralized enterprise model is a new generation of collaboration and communication tools ...
To better understand the AI maturity of businesses, Dotscience conducted a survey of 500 industry professionals. Research findings indicate that although enterprises are dedicating significant time and resources towards their AI deployments, many data science and ML teams don't have the adequate tools needed to properly collaborate on, build and deploy AI models efficiently ...
Digital transformation, migration to the enterprise cloud and increasing customer demands are creating a surge in IT complexity and the associated costs of managing it. Technical leaders around the world are concerned about the effect this has on IT performance and ultimately, their business according to a new report from Dynatrace, based on an independent global survey of 800 CIOs, Top Challenges for CIOs in a Software-Driven, Hybrid, Multi-Cloud World ...
APM tools are your window into your application's performance — its capacity and levels of service. However, traditional APM tools are now struggling due to the mismatch between their specifications and expectations. Modern application architectures are multi-faceted; they contain hybrid components across a variety of on-premise and cloud applications. Modern enterprises often generate data in silos with each outflow having its own data structure. This data comes from several tools over different periods of time. Such diversity in sources, structure, and formats present unique challenges for traditional enterprise tools ...
Today's organizations clearly understand the value of digital transformation and its ability to spark innovation. It's surprising that fewer than half of organizations have undertaken a digital transformation project. Workfront has identified five of the top challenges that IT teams face in digital transformation — and how to overcome them ...