Q&A Part Two: IBM Talks About Predictive Analytics
January 31, 2012

In Part Two of APMdigest's exclusive interview, Matthew Ellis, IBM Vice President of Service Availability and Performance, discusses predictive analytics.

Click here to start with Part One of the Q&A with IBM VP Matthew Ellis.

APM: Why is predictive analytics gaining so much momentum recently, especially with respect to APM?

ME: Analytics is important to all phases of operations. In all areas of business it is axiomatic that more data enables better decisions, and operations and application management are no exceptions.

Just as important, however, is sorting that data to identify the critical context for decision makers to act on, and this is where analytics come in.

IBM is investing in analytics very seriously, and from an operations management perspective, we apply analytics in three categories: Simplify Operations Management, Avoid Business Disruption, and Enable Optimization.

Simplify Operations Management is a class of analytics technology that enables our customers to do the work that they do today more easily. This includes historical analysis of data to recommend and establish dynamic thresholds, and trending of performance and capacity data to identify areas that may become bottlenecks based on historical behavior.

Avoid Business Disruption is the key driver for the predictive analytics component. The goal is early identification of environmental changes that indicate a significant change in the behavior of an application or service, and to bring this information to the attention of the operations management team so that problems can be identified and addressed before they ever impact a customer. We have identified emerging problems days before traditional management tools saw signs of trouble and in some situations, discovered problems in unmonitored resources that were affecting the behavior of critical applications.

Enable Optimization is the ability to mine collected data across multiple dimensions enabling insight and optimization of services and applications by enabling rich insight. It is also known as business analytics.

APM: What specific functionality should an organization look for in predictive analytics technology?

ME: At IBM, we believe there are three key capabilities that any analytics solution must have to provide maximum predictive capability:

1. Algorithms: Multivariate Analytic techniques are critical to identifying emerging problems early, while all metric data is still well within their normal range.

The key to this statistical approach is to monitor the relationships of important related data metrics and raise an exception when the relationships of data change in significant ways. Any single metric displays a wide range of variability during a normal day, increasing and decreasing with changing workloads, and daily, weekly and seasonal behavior.

In general, however, related metrics will follow the same pattern all the time in a healthy system. Successfully identifying these relationships, and accurately determining when these relationships diverge in an important way is key to accurate early identification of problems.

Our algorithms are developed and refined by one of the largest private math departments in the world; the same organization that developed Watson to win at Jeopardy.

2. Scalability: Analytics solutions work better when they have more data upon which to base their conclusions. The IBM analytics solutions directly leverage proven data collection technologies that have been in use for most of a decade and have seen continual refinement. This capability is proven to be able to collect millions of data points per second, and deliver that data to the analytics engine with very low latency offering real-time evaluation of very large data streams. We believe that the data collection technology we are using is the most scalable and high performance in the industry.

3. Breadth of Monitored Resources: One of our design requirements was to deliver an easily extensible mediation capability allowing customers (or our services teams) to connect any data source to our data collection solution in a matter of hours or days.

During our pilot, we have worked with many products from non-IBM vendors and our team has found that almost all data integration work can be done in a very short time without ever requiring a visit to the customer site, saving time and money while maximizing data availability for analysis.

APM: How do you see Predictive Analytics evolving over the next few years?

ME: IBM expects that analytics tools, and the organizations that use them, will evolve rapidly over the next few years. IBM is investing heavily in providing highly scalable, flexible, and robust systems for identifying emerging problems as early as possible.

We expect analytics to evolve along multiple dimensions:

1. Improvements in analytics learning and data exchange with existing application and service discovery, topology, and CMDB data to combine the strengths of traditional IT tools with analytics learning solutions. This will accelerate the statistical learning process and allow the learned relationships to be built back into the visible topology of the environment.

2. Apply analytics solutions to additional IT management domains to include Smarter Infrastructures, improved detection of security problems, asset management and maintenance scheduling and additional problems

3. Further improve feedback and integration of learning technologies, process optimization, and analytics in general with operations processes.

About Matthew Ellis

Matthew Ellis is the Vice President of Development for Tivoli's Service Availability & Performance Management product portfolio with IBM. This product suite enables monitoring and modeling the utilization, performance, capacity and energy-use of distributed, mainframe and virtualized platforms and associated application software. Ellis joined IBM in 2006 through the Micromuse acquisition, where he was the Vice President of Software Development.

Click here to read Part One of the Q&A with IBM VP Matthew Ellis.

The Latest

February 12, 2016

Valentine’s Day is an opportunity for technology users across the globe to express their love and appreciation for that special someone(s) … their IT team. With the constant evolution of new technologies and innovative tools, it is more important than ever to show a little love on this day to the heart of your organization who keeps it all running efficiently ...

February 12, 2016

On Valentine's Day it's important to show the love for the most important people – or networks – in our lives. In honor of the upcoming holiday, SolarWinds recently asked IT pros: "If you could say one thing to your network, what would it be?" ...

February 11, 2016

Moogsoft conducted an IT monitoring survey with attendees at AppDynamics AppSphere. A variety of questions were asked, from the number of monitoring tools they use, to the time it takes to detect and resolve incidents, to what they hope to see from vendors in the future. While some responses were predictable, some were actually rather surprising ...

February 10, 2016

To optimize application performance, IT teams need to proactively ensure the optimized performance of every underlying infrastructure component, including physical and virtual servers, networks, storage devices, databases, end-user services and cloud and big data environments. It is imperative that they not only identify and resolve issues quickly, but also pre-empt potential issue before there's an adverse impact on the user experience. Below are six key requirements that can help you achieve these objectives ...

February 09, 2016

SDN is not expected to truly catch on in 2016, according to some experts on APMdigest's 2016 predictions list, however a recent International Data Corporation (IDC) forecast says: the worldwide software-defined networking (SDN) market — comprising physical network infrastructure, virtualization/control software, SDN applications (including network and security services), and professional services — will have a compound annual growth rate (CAGR) of 53.9% from 2014 to 2020 and will be worth nearly $12.5 billion in 2020 ...

February 08, 2016

Just seconds after her Super Bowl performance (and subsequent tour teaser), Beyonce found her website "slayed" by an onslaught of traffic and connection failures. This outage illustrates that even the biggest celebrities and brands can easily find their digital performance put to the test ...

February 05, 2016

As the Super Bowl approaches, an equally epic game is taking place in cyberspace. The Super Bowl is the "moment of truth" for the NFL, sports media, advertisers, restaurants (especially pizza joints), food delivery services and gambling sites. They have to be ready in order to capitalize on unpredictably "spiky" traffic and the transactions before, during and, for some, after the game. To better evaluate the impact of the Super Bowl on ecommerce and website traffic, SOASTA conducted a survey that examined the online and mobile habits and preferences of Americans watching this year's big game ...

February 04, 2016

It’s hard to define software-defined networking (SDN) as one thing, given that it is applied to so many different areas of networking: Data centers, enterprise campus, the WAN, radio access networks, etc. And each vendor that introduces an SDN product to the market is working from a definition that fits into its own strategy. But … what do those people who deploy SDN have to say? ...

February 03, 2016

Remember the adage "beauty is in the eye of the beholder?" Similarly, service quality is in the eye of the user. So, to understand service quality, we should be measuring end-user experience (EUE). You may already be measuring EUE. Some of your applications – particularly those based on Java and .NET – may already be instrumented with agent-based APM solutions. But there are a few challenges to an agent-based approach to EUE ...

February 02, 2016

IT and business executives agree that digital transformation and the use of hybrid clouds are key to competitive success in the digital age, according to a new study conducted by IDG Research Services ...

Share this