"Data, data everywhere, and not a drop to drink." All businesses are fully aware of how much data they're swimming through on a daily basis. And because its buzzy and trendy, most of these businesses are looking to do more with their data, striving to implement cool sounding technologies like machine learning and predictive analytics.
How many, exactly? 41% of executives in a recent 451 Research survey of advanced analytics are looking to begin implementing applications such as Machine Learning or Predictive Modeling in the next 12 months, and an additional 14% plan to do so in the next 24.
And why shouldn't they? These sophisticated programs are highly efficient and represent the future of many different verticals supported by the technology industry.
Yet as enterprises and their leadership see these initiatives on the horizon, a startling number are overlooking a crucial factor that could make or break the success of these investments: the quality of their own data. With some enterprises curating up to 200 disparate data sources, ensuring data quality is no easy task. But getting it right can literally make the difference between a very public crash 'n' burn, or being the standard that everyone tries to emulate.
Here are three reasons why the average enterprise isn't properly prepared for an advanced analytics strategy.
Reason 1: Medieval Methods for Managing Data Quality
According to the survey, 37% of enterprises employ a manual data cleansing process. Given current data volumes, manually cleaning something isn't so 1990s, it's actually more like 1500s. Many of these enterprises are starting to look towards algorithmic automation – but how can they successfully automate advanced processes when their back-end data quality checks remain manual?
44.5% of respondents are in a reactive mode, meaning they only deal with their data quality when it becomes a problem … that they notice (and by the way, their customers noticed way before they did).
The majority of respondents (65%) acknowledge up to 50% of business value can be lost to poor data quality – think that number is going to decrease when the number of initiatives that rely on clean data increases?
Reason 2: Businesses Don't Know The Exact Quality of Their Data
Because of these current Data Quality Management "strategies", IT departments and C-suite executives have a lack of faith in the actual quality of their data.
Over half (57%) of respondents in this survey were "somewhat confident", "unaware", or "less than confident" in the state of their data. Not exactly a resounding endorsement.
This feeling is compounded by the dependency on manual effort to drive remediation in many enterprises' data quality process. Manual entry was the leading cause of poor data quality, also coming in at 57%.
To be fair, you can't blame employees for making mistakes in data entry or processing, but you can blame their management for not providing them with the right tools to handle the volume of data they face every day.
Reason 3: The Stream of Data Today is About to Become a Tsunami
If proper preparations aren't undertaken right now with the relatively manageable amount of data that currently exists, it will be not just be harder, it will be impossible to get a handle on it at the rate that data sources and volumes will continue to expand over the next 3-5 years.
95% of survey respondents acknowledge they expect data to increase (the other 5% presumably in businesses that won't be around in five years).
70% expect data volumes to grow by 70%, while nearly all of the remaining 30% expect it to grow by more than 75%. Chances are, all of them are underestimating what's headed in their direction.
The problems faced by the enterprise today are significant, but can be managed if IT executives deal with the data quality issue now. Tools and technologies are available to ensure viable data quality, which becomes the foundation for growth and value-add, but the choice to act now or quickly get buried is in our collective face, and requires immediate action.
Dan Ortega is VP of Marketing at Blazent.
Achieving audit compliance within your IT ecosystem can be an iterative process, and it doesn't have to be compressed into the five days before the audit is due. Following is a four-step process I use to guide clients through the process of preparing for and successfully completing IT audits ...
Network performance issues come in all shapes and sizes, and can require vast amounts of time and resources to solve. Here are three examples of painful network performance issues you're likely to encounter this year, and how NPMD solutions can help you overcome them ...
"Scale up" versus "scale out" doesn't just apply to hardware investments, it also has an impact on product features. "Scale up" promotes buying the feature set you think you need now, then adding "feature modules" and licenses as you discover additional feature requirements are needed. Often as networks grow in size they also grow in complexity ...
Network Packet Brokers play a critical role in gaining visibility into new complex networks. They deliver the packet data and information IT and security teams need to identify problems, recognize security issues, and ensure overall network performance. However, not all Packet Brokers are created equal when it comes to scalability. Simply "scaling up" your network infrastructure at every growth point is a more complex and more expensive endeavor over time. Let's explore three ways the "scale up" approach to infrastructure growth impedes NetOps and security professionals (and the business as a whole) ...
Loyal users are the key to your service desk's success. Happy users want to use your services and they recommend your services in the organization. It takes time and effort to exceed user expectations, but doing so means keeping the promises we make to our users and being careful not to do too much without careful consideration for what's best for the organization and users ...
What's the difference between user satisfaction and user loyalty? How can you measure whether your users are satisfied and will keep buying from you? How much effort should you make to offer your users the ultimate experience? If you're a service provider, what matters in the end is whether users will keep coming back to you and will stay loyal ...
What if I said that a 95% reduction in the amount of IT noise, 99% reduction in ticket volume and 99% L1 resolution rate are not only possible, but that some of the largest, most complex enterprises in the world see these metrics in their environments every day, thanks to Artificial Intelligence (AI) and Machine Learning (ML)? Would you dismiss that as belonging to the realm of science fiction? ...
Of those surveyed, 96% of organizations have a digital transformation strategy, with 57% approaching it as an enterprise-wide priority, with a clear emphasis on speed of business, costs, risk, and customer satisfaction, according to IDC’s Aligning IT Strategies and Business Expectations for Digital Transformation Success, sponsored by EasyVista ...
One of my ongoing areas of focus is analytics, AIOps, and the intersection with AI and machine learning more broadly. Within this space, sad to say, semantic confusion surrounding just what these terms mean echoes the confusions surrounding ITSM ...