The New APM All-Stars: Automation and Artificial Intelligence
February 13, 2018

Chris Farrell
Instana

Share this

With the NBA All-Star game just ahead and the NHL game just behind, it made me consider the All-Stars of Application Monitoring — Automation and Artificial Intelligence (AI).

Automation is the workhorse that does all the little things: In basketball terms, that means rebounding and setting screens. For hockey, that's killing penalties and floor-checking.

For APM, "Automation" supports tasks like Discovery, Setup, Configuration, Reporting.

Then there's the superstar playmaker — the player that sees the whole field of play, understands what will happen beforehand and places resources in the right position to make the winning plays. For the new generation of APM, that's AI.

AI sees everything; analyzes everything. AI recognizes strengths and weaknesses. AI sees events and problems before they actually occur and takes actions as needed to address the situation.

A Brave New World

Today's digitally transformed organizations have embraced Agile and DevOps to help them quickly and efficiently deploy dynamic applications using containers and microservice architectures. Developing applications at an increasingly rapid pace with these new technologies helps businesses succeed, but it adds tremendous complexity to the application and IT environments.

Automation and AI technologies are critical to the next step in APM evolution

Operations teams can no longer manually monitor and manage today's applications due to their dynamic and complex nature, as well as the speed of development and deployment. APM had to evolve to keep pace with development velocity and maintain the service quality for the modern applications born out of digital transformation.

Automation and artificial intelligence (AI) technologies are critical to the next step in APM evolution, helping to address speed, scalability and intelligence demands.

Automation and AI are Better Together

On basketball and hockey teams, when each star does their job together with their teammates, it's a winning combination. APM is no different when AI and Automation get together. Unlike a sports team, though, "losing a game" for APM owners can be catastrophic.

Today's businesses ARE their applications. If an application isn't running well, users (employees, partners, or customers) are unhappy and the business suffers. If an application completely breaks, it can severely impact the bottom line.

For APM to work, it needs more than data. It needs actionable information to analyze and manage application performance.

Early APM tools did pretty well managing applications that were 3-tiered monoliths or SOA-based. But with the growth of cloud, microservices and containers, monitoring and managing today's applications requires increased speed, scalability and intelligence.

Unfortunately, the development velocity (approaching continuous delivery) and application complexity make it impossible for humans (even experts) to analyze all the necessary information and take appropriate actions to keep applications performing properly.

Enter the two new APM all-stars — AI and Automation — the only way for any organization to regain control over their complex applications. Why are both of these great concepts required, and required to work together?

1. To match the speed and scalability of the modern dynamic applications

2. To analyze the massive amounts of data gathered and measured from each application

3. To take appropriate actions to adjust the infrastructure, platform or microservices to ensure the application performs as needed

Proper automation sets the stage for AI to analyze and act on application performance through:

Continuous discovery and mapping: Proper application of AI requires completely accurate data, especially dependency information. Otherwise, you're wasting time analyzing bad data. With automated, continuous discovery, application maps are always accurate and always reflect reality.

To deliver actionable information, AI has to start with Hi-Fidelity data

Hi-Fidelity data: To deliver actionable information, AI has to start with Hi-Fidelity data. After automatically discovering the components and mapping the application, monitoring can begin. But the information must be in real-time. As fast as applications change, operations teams need to those updates — in one second or less. This ensures AI is applied to the most accurate data possible.

A full stack application model: Because true AI can only operate with the deepest visibility, understanding the dependencies and configurations among the physical and logical components — in real-time — is critical.

Accommodating container and microservice fluidity: Modern applications are in constant change, are deployed in hybrid environments and will likely include multiple programming languages, middleware and databases, especially if using microservices. Automated discovery with zero configuration will help operations keep pace with development teams and application change.

With automation providing up-to-the-second, high-quality data; a full understanding of the application component dependencies; and the ability to handle modern development and deployment paradigms such as microservices and containers, AI confidently can be engaged to provide:

Real-time, AI-driven incident monitoring and prediction: DevOps teams need accurate and actionable information within seconds after change occurs. That type of information also is invaluable when a performance problem is imminent. Applying real-time AI to the monitoring data, which is coming in real-time, delivers analysis and performance insights in less than three seconds.

AI-powered troubleshooting and resolution: Modern applications are simply too complex for humans to effectively manage on their own. Because of the dynamic nature of their structure, their complex dependencies and the sheer scale, machines learning and AI must be applied. The application intelligence generated provides a baseline for problem prediction and resolution.

Automation and AI working together (and operating in seconds, not minutes) are the core components for managing modern applications. They can combine to create a democratized APM solution capable of handling the speed, scalability and intelligence that today's dynamic applications require.

Chris Farrell is Technical Director and APM Strategist at Instana
Share this

The Latest

June 25, 2020

I've had the opportunity to work with a number of organizations embarking on their AIOps journey. I always advise them to start by evaluating their needs and the possibilities AIOps can bring to them through five different levels of AIOps maturity. This is a strategic approach that allows enterprises to achieve complete automation for long-term success ...

June 24, 2020

Sumo Logic recently commissioned an independent market research study to understand the industry momentum behind continuous intelligence — and the necessity for digital organizations to embrace a cloud-native, real-time continuous intelligence platform to support the speed and agility of business for faster decision-making, optimizing security, driving new innovation and delivering world-class customer experiences. Some of the key findings include ...

June 23, 2020

When it comes to viruses, it's typically those of the computer/digital variety that IT is concerned about. But with the ongoing pandemic, IT operations teams are on the hook to maintain business functions in the midst of rapid and massive change. One of the biggest challenges for businesses is the shift to remote work at scale. Ensuring that they can continue to provide products and services — and satisfy their customers — against this backdrop is challenging for many ...

June 22, 2020

Teams tasked with developing and delivering software are under pressure to balance the business imperative for speed with high customer expectations for quality. In the course of trying to achieve this balance, engineering organizations rely on a variety of tools, techniques and processes. The 2020 State of Software Quality report provides a snapshot of the key challenges organizations encounter when it comes to delivering quality software at speed, as well as how they are approaching these hurdles. This blog introduces its key findings ...

June 18, 2020

For IT teams, run-the-business, commodity areas such as employee help desks, device support and communication platforms are regularly placed in the crosshairs for cost takeout, but these areas are also highly visible to employees. Organizations can improve employee satisfaction and business performance by building unified functions that are measured by employee experience rather than price. This approach will ultimately fund transformation, as well as increase productivity and innovation ...

June 17, 2020

In the agile DevOps framework, there is a vital piece missing; something that previous approaches to application development did well, but has since fallen by the wayside. That is, the post-delivery portion of the toolchain. Without continuous cloud optimization, the CI/CD toolchain still produces massive inefficiencies and overspend ...

June 16, 2020

The COVID-19 pandemic has exponentially accelerated digital transformation projects. To better understand where IT professionals are turning for help, we analyzed the online behaviors of IT decision-makers. Our research found an increase in demand for resources related to APM, microservices and dependence on cloud services ...

June 15, 2020

The rush to the public cloud has now slowed as organizations realized that it is not a "one size fits all" solution. The main issue is the lack of deep visibility into the performance of applications provided by the host. Our own research has recently revealed that 32% of public cloud resources are currently under-utilized, and without proper direction and guidance, this will remain the case ...

June 11, 2020

The global shift to working from home (WFH) enforced by COVID-19 stay-at-home orders has had a massive impact on everyone's working lives, not just in the way they remotely interact with their teams and IT systems, but also in how they spend their working days. With both governments and businesses committed to slowly opening up offices, it's increasingly clear that a high prevalence of remote work will continue throughout 2020 and beyond. This situation begets important questions ...

June 10, 2020
In recent years, with the emergence of newer technologies ranging from the cloud to machine learning, IT modernization has evolved from a replacement of end-of-life infrastructure to an enabler of innovation and business value. It is a complex process that can take months or even years, but a recent survey shows that the effort begins to deliver measurable results almost as soon as an organization executes the first steps on its roadmap ...