Ignore Big Data in 2013 At Your Own Peril
December 20, 2012

Pete Goldin
APMdigest

Share this

In the Inc. special report on How (and Where) to Make Money in 2013 (and Beyond), author Erik Sherman places Big Data on the list of 5 Trends to Ignore in 2013. In contrast, I suggest that ignoring Big Data is not a business savvy move in 2013.

Sherman says: "Everyone needs big data, if you read the business and technology magazines. But the term has become an amorphous catch phrase that covers everything. Real big data involves millions or even billions of data points. We're talking complicated tasks like predicting the weather, or Google looking for trends among all the search queries it sees day in, day out."

"That level of data analysis is probably nowhere near what you need for your business," he adds. "Most decisions are built on small data: dozens or hundreds or maybe thousands of data points. If you don't have systems in place that let you regularly and predictably make effective use of the data you already have, then looking at big data is like saying you want to jump into the ocean to avoid getting damp from a summer shower."

Application Performance Management is the perfect example of why Sherman is wrong. IT monitoring can produce millions and even billions of metrics. And the technology is out there to crunch those metrics and analyze them, and help improve application performance.

In an article about a Big Data survey, I said: With the growth of IT infrastructure, as well as the growth of applications and their complexity, comes an increase in performance metrics. In fact, 83% of respondents agreed with Gartner’s estimate that metric collection has increased 300% or more in the last four years. And one respondent from a large corporation has seen the IT estate grow tenfold, to the point where they now collect over a billion metrics daily.

Several respondents also confirmed that APM tools are part of the huge explosion in metric collection, generating thousands of KPIs per application.

Today, analytics technologies are emerging that can make sense out of this Big Data. This technology has a starring role in APMdigest's APM Predictions for 2013.

“There’s no question that Big Data has become a driver for Advanced Performance Analytics (APA), where capabilities for processing tens of millions of KPIs or data points in real time or near real time is becoming more and more common,” said Dennis Drogseth, VP, Application and Business Services at EMA, in an APMdigest article.

In an APMdigest blog Graham Gillen of Netuitive says: "The results are well documented with one global telco reporting that it is using Behavior Learning technology and predictive analytics to analyze more than a million metrics simultaneously allowing it to eliminate 3,480 hours annually in service degradation representing a business savings of $18 million."

APM is just one example of why businesses should be paying attention to Big Data in 2013.

I would say that ignoring Big Data in business in 2013 is like ignoring a locomotive while standing on the tracks.

Pete Goldin is Editor and Publisher of APMdigest
Share this

The Latest

April 16, 2024

Organizations are continuing to embrace multicloud environments and cloud-native architectures to enable rapid transformation and deliver secure innovation. However, despite the speed, scale, and agility enabled by these modern cloud ecosystems, organizations are struggling to manage the explosion of data they create, according to The state of observability 2024: Overcoming complexity through AI-driven analytics and automation strategies, a report from Dynatrace ...

April 15, 2024

Organizations recognize the value of observability, but only 10% of them are actually practicing full observability of their applications and infrastructure. This is among the key findings from the recently completed Logz.io 2024 Observability Pulse Survey and Report ...

April 11, 2024

Businesses must adopt a comprehensive Internet Performance Monitoring (IPM) strategy, says Enterprise Management Associates (EMA), a leading IT analyst research firm. This strategy is crucial to bridge the significant observability gap within today's complex IT infrastructures. The recommendation is particularly timely, given that 99% of enterprises are expanding their use of the Internet as a primary connectivity conduit while facing challenges due to the inefficiency of multiple, disjointed monitoring tools, according to Modern Enterprises Must Boost Observability with Internet Performance Monitoring, a new report from EMA and Catchpoint ...

April 10, 2024

Choosing the right approach is critical with cloud monitoring in hybrid environments. Otherwise, you may drive up costs with features you don’t need and risk diminishing the visibility of your on-premises IT ...

April 09, 2024

Consumers ranked the marketing strategies and missteps that most significantly impact brand trust, which 73% say is their biggest motivator to share first-party data, according to The Rules of the Marketing Game, a 2023 report from Pantheon ...

April 08, 2024

Digital experience monitoring is the practice of monitoring and analyzing the complete digital user journey of your applications, websites, APIs, and other digital services. It involves tracking the performance of your web application from the perspective of the end user, providing detailed insights on user experience, app performance, and customer satisfaction ...

April 04, 2024
Modern organizations race to launch their high-quality cloud applications as soon as possible. On the other hand, time to market also plays an essential role in determining the application's success. However, without effective testing, it's hard to be confident in the final product ...
April 03, 2024

Enterprises are experiencing a 13% year-over-year increase in customer-facing incidents, reflecting rising levels of complexity and risk as businesses drive operational transformation at scale, according to the 2024 State of Digital Operations study from PagerDuty ...

April 02, 2024

According to Grafana Labs' 2024 Observability Survey, it doesn't matter what industry a company is in or the number of employees they have, the truth is: the more mature their observability practices are, the more time and money they save. From AI to OpenTelemetry — here are four key takeaways from this year's report ...

April 01, 2024

In an age where technology evolves at a breakneck pace, it's crucial to explore how AI assistants can revolutionize our work processes and daily lives, ultimately enhancing overall performance ...