Ignore Big Data in 2013 At Your Own Peril
December 20, 2012

Pete Goldin

Share this

In the Inc. special report on How (and Where) to Make Money in 2013 (and Beyond), author Erik Sherman places Big Data on the list of 5 Trends to Ignore in 2013. In contrast, I suggest that ignoring Big Data is not a business savvy move in 2013.

Sherman says: "Everyone needs big data, if you read the business and technology magazines. But the term has become an amorphous catch phrase that covers everything. Real big data involves millions or even billions of data points. We're talking complicated tasks like predicting the weather, or Google looking for trends among all the search queries it sees day in, day out."

"That level of data analysis is probably nowhere near what you need for your business," he adds. "Most decisions are built on small data: dozens or hundreds or maybe thousands of data points. If you don't have systems in place that let you regularly and predictably make effective use of the data you already have, then looking at big data is like saying you want to jump into the ocean to avoid getting damp from a summer shower."

Application Performance Management is the perfect example of why Sherman is wrong. IT monitoring can produce millions and even billions of metrics. And the technology is out there to crunch those metrics and analyze them, and help improve application performance.

In an article about a Big Data survey, I said: With the growth of IT infrastructure, as well as the growth of applications and their complexity, comes an increase in performance metrics. In fact, 83% of respondents agreed with Gartner’s estimate that metric collection has increased 300% or more in the last four years. And one respondent from a large corporation has seen the IT estate grow tenfold, to the point where they now collect over a billion metrics daily.

Several respondents also confirmed that APM tools are part of the huge explosion in metric collection, generating thousands of KPIs per application.

Today, analytics technologies are emerging that can make sense out of this Big Data. This technology has a starring role in APMdigest's APM Predictions for 2013.

“There’s no question that Big Data has become a driver for Advanced Performance Analytics (APA), where capabilities for processing tens of millions of KPIs or data points in real time or near real time is becoming more and more common,” said Dennis Drogseth, VP, Application and Business Services at EMA, in an APMdigest article.

In an APMdigest blog Graham Gillen of Netuitive says: "The results are well documented with one global telco reporting that it is using Behavior Learning technology and predictive analytics to analyze more than a million metrics simultaneously allowing it to eliminate 3,480 hours annually in service degradation representing a business savings of $18 million."

APM is just one example of why businesses should be paying attention to Big Data in 2013.

I would say that ignoring Big Data in business in 2013 is like ignoring a locomotive while standing on the tracks.

Share this

The Latest

July 22, 2019

Many organizations are unsure where to begin with AIOps, but should seriously consider adopting an AIOps strategy and solution. To get started, it's important to identify the key capabilities of AIOps that are needed to realize maximum value from your investments ...

July 18, 2019

Organizations that are working with artificial intelligence (AI) or machine learning (ML) have, on average, four AI/ML projects in place, according to a recent survey by Gartner, Inc. Of all respondents, 59% said they have AI deployed today ...

July 17, 2019

The 11th anniversary of the Apple App Store frames a momentous time period in how we interact with each other and the services upon which we have come to rely. Even so, we continue to have our in-app mobile experiences marred by poor performance and instability. Apple has done little to help, and other tools provide little to no visibility and benchmarks on which to prioritize our efforts outside of crashes ...

July 16, 2019

Confidence in artificial intelligence (AI) and its ability to enhance network operations is high, but only if the issue of bias is tackled. Service providers (68%) are most concerned about the bias impact of "bad or incomplete data sets," since effective AI requires clean, high quality, unbiased data, according to a new survey of communication service providers ...

July 15, 2019

Every internet connected network needs a visibility platform for traffic monitoring, information security and infrastructure security. To accomplish this, most enterprise networks utilize from four to seven specialized tools on network links in order to monitor, capture and analyze traffic. Connecting tools to live links with TAPs allow network managers to safely see, analyze and protect traffic without compromising network reliability. However, like most networking equipment it's critical that installation and configuration are done properly ...

July 11, 2019

The Democratic presidential debates are likely to have many people switching back-and-forth between live streams over the coming months. This is going to be especially true in the days before and after each debate, which will mean many office networks are likely to see a greater share of their total capacity going to streaming news services than ever before ...

July 10, 2019

Monitoring of heating, ventilation and air conditioning (HVAC) infrastructures has become a key concern over the last several years. Modern versions of these systems need continual monitoring to stay energy efficient and deliver satisfactory comfort to building occupants. This is because there are a large number of environmental sensors and motorized control systems within HVAC systems. Proper monitoring helps maintain a consistent temperature to reduce energy and maintenance costs for this type of infrastructure ...

July 09, 2019

Shoppers won’t wait for retailers, according to a new research report titled, 2019 Retailer Website Performance Evaluation: Are Retail Websites Meeting Shopper Expectations? from Yottaa ...

June 27, 2019

Customer satisfaction and retention were the top concerns for a majority (58%) of IT leaders when suffering downtime or outages, according to a survey of top IT leaders conducted by AIOps Exchange. The effect of service interruptions on customers outweighed other concerns such as loss of revenue, brand reputation, negative press coverage, or the impact on IT Ops teams.

June 26, 2019

It is inevitable that employee productivity and the quality of customer experiences suffer as a consequence of the poor performance of O365. The quick detection and rapid resolution of problems associated with O365 are top of mind for any organization to keep its business humming ...