Industry experts — from analysts and consultants to users and the top vendors — offer thoughtful, insightful, and often controversial predictions on how APM and related technologies will evolve and impact business in 2018. Part 6 covers ITOA and data.
The amount of data facing ITOps practitioners is only going to grow in the coming year and teams will be faced with the increased challenge of finding the signal in the noise — and fast — to resolve incidents. As a result, it will be necessary for ITOps to reexamine previous assumptions around automation and responsibility.
Head of DevOps, PagerDuty
By utilizing smart data, which distills the essence of the traffic flows that traverse the service delivery infrastructure in a distributed fashion, close to the source, and compresses it into metadata, businesses can ensure they only store the information that holds real value. This information can then be used to gain meaningful and actionable insights, helping organizations to gain a competitive edge while driving efficiencies by enabling data to be rapidly compressed, and substantially reducing the volume of data stored by an order of magnitude or more. Smart data is already used to power a range of service, operations and business analytics across different industries including automotive, manufacturing and healthcare, and we expect its usage to increase dramatically in 2018. With the proliferation of IoT sensors, mobile devices and digital services creating an abundance of data used by the various applications and services that rely on hybrid cloud infrastructure, having the ability to convert smart data into meaningful and actionable IT and business insights, will help corporations to thrive in 2018 and beyond.
Area VP, Strategy, NetScout
APM CONVERGED DATA STORES
Today's APM tools and monitoring, in general, have discreet silos of data for time-series, transactions, and logs. In 2018 We will begin to see the first converged data stores, which will unlock the ability to answer questions significantly more easily than today's tools.
VP of Market Development and Insights, AppDynamics
Read Jonah Kowall's Blog: Looking Back at 2017 APM Predictions - Did They Come True?
APPLICATION-CENTRIC APPROACH TO BIG DATA
In the past, people were focused on learning the various big data technologies. It took time for users to understand, differentiate, and ultimately deploy them. There was a lot of debate and plenty of hype. Now that organizations have cut through the noise and figured all that out, they're concerned about actually putting their data to use. The enterprise doesn't really care about the technology being used. It's not important which distribution or database or analytics they're using, what matters is the result. The enterprise has realized this and we can expect to see an increased adoption of an application-centric approach to big data in the coming year.
CEO, Unravel Data
NEW PERFORMANCE METRICS
We'll see new patterns of backend performance problems stemming from the broader adoption of containers and microservices architecture. Our performance palette will be expanded to include new measurements like micro pause delays, herd effects, cold start time etc.
Sr. Product Manager, Riverbed
DBA TAKES ON IT OPS ROLE
The New Job Description: DBAs Take on New Responsibilities. One of the most significant changes we will see in 2018 will be toward a more collaborative relationship between IT infrastructure managers and database administrators (DBAs). As more applications are run in the cloud, senior DBA managers will be able to take more of a central role in troubleshooting problems and improving efficiency. DBAs will be looking beyond just the application and database to find and fix issues. Both IT and application teams will need tools that look deeply into the cloud infrastructure to identify causes of performance and availability issues and provide accurate recommendations for addressing them.
President & CEO, SIOS Technology
2018 will see a de-emphasis on centralized cloud-based management and traditional data-lakes, and a shift towards distributed analysis. This will be driven not only by explosive growth in IoT, but also by the support of edge computing by major cloud vendors
RESTFUL API DRIVES ITOA
The advent of efficient RESTful APIs on many services and applications coupled with the maturation of time-series databases such as OpenTSDB and InfluxDB will drive IT operations analytics to use more quantitative approaches, and lead to advances in root cause analysis. This is due to the high storage efficiency of the time series databases, and the speed with which the optimize-on-write approaches they use can accept data. It is now increasingly practical to track large quantitative data volumes. RESTful API endpoints from applications and cloud services are rich in metrics, and the same types of APIs are efficient at accepting such metrics in data streams. With these large volumes of contemporaneous, high-cardinality time series data sources, operations analysis will become possible at a higher scale than previously possible. Cross-correlation will yield forensic insight into failures. In contrast, predictive time series analysis based on auto-regressive/moving average models, while mathematically practical, will fail to lead to any significantly valuable results on operations data, with rare exceptions.
Director of Sales Engineering, GroundWork
IOT INFLECTION POINT
IoT apps need to get out of the hype cycle and deal with real world pain points. Their devices are still a hassle to set up and they solve too few real world cases. Alexa has shown promise, but IoT platforms as a whole are too fragmented for developers to invest in learning them. Hardware manufacturers will agree on a common set of protocols and open up APIs for devices to work seamlessly.
In my opinion, the biggest occurrence in 2017 was that IoT reached peak hype, giving way to new hype-cycles for machine learning (actually, an offshoot of IoT) and for Artificial Intelligence (a familiar topic area, and one that requires IoT data as fuel for its intelligence). We saw a combination of several companies making very large investments in IoT, while others are scaling back or reorganizing their IoT teams. This combination of investment push and pull means that we're at an inflection point. For IoT, this means we're now at a point where projects have to deliver results. IoT vendors invested ahead of demand, with all sorts of claims of IoT one-stop shopping. With more capacity in the industry than there is demand, I expect we will see players drop off or shift focus.
Chief Architect, IoT, Red Hat
We've now passed the point where we know that the human brain can no longer cope with the complexity of modern applications. Meanwhile, businesses have never relied on digital services more than they do today. Today, every company is a digital company and every critical IT issue has become a business issue. Therefore, APM solutions must evolve from just being early performance-issue detection tools to providing much more insights into the other phases of the resolution process. This includes not only root cause diagnostic and identification capabilities, but also self-teaching capabilities that leverage big data and AI-based algorithms and require very limited initial configuration to deliver actionable insights and recommended remediation actions. This will allow DevOps teams to make the best possible decisions to resolve performance issues.
Senior Director of Product Marketing, IT Response Automation, Everbridge
Read 2018 Network Performance Management Predictions, the final installment.
Business leaders are in the unique position of having immediate access to huge amounts of data in today's smartphone and laptop-dominated world. They are also under pressure to make data-driven decisions and mobile business intelligence can one of the most valuable decision making tools in their arsenal ...
Unlike some AI initiatives, AIOps doesn't always necessitate the use of a data scientist, so don't let hiring expenses put your AIOps initiatives on hold. It is always nice to have IT team members with AI skills, but this becomes less critical as more intelligent solutions come into prominence that offer AIOps features out of the box, a readily deployable option for IT ...
AIOps is rapidly becoming a de-facto option for enterprises' IT strategies, with nearly immeasurable benefits to be provided. However, AIOps is still a relatively new discipline and misconceptions surrounding the technology's capabilities and uses have caused bottlenecks and roadblocks in its widespread adoption. So, what should organizations expect from AIOps? How can organizations that want to digitally transform their IT pursue AIOps for maximum benefit? ...
In response to the global pandemic, companies have given their workforce the tools they need to work remote. And research shows it has increased their engagement and productivity. But these gains are on the brink of being wiped out. According to a new study from Citrix Systems, Inc., employees feel they've been given too many tools and not enough efficient ways to execute. And it's hindering their ability to get things done ...
The third installment of Aptum's four-part Cloud Impact Study, A Bright Forecast on Cloud, presents data showing the benefits organizations gain from cloud computing, as well as mistakes to avoid during migration. As organizations migrate workloads to different cloud platforms, they often run into unexpected challenges due to a lack of proactive planning. Here are a few key findings from Part 3 of the Cloud Impact Study ...
Currently, (and most likely well into the future) the overwhelming majority of organizations still need to monitor and maintain enterprise applications. Moreover, where these are complex systems developed, debugged and refined over years, often decades, around a business's core processes, there can also be very strong practical arguments for viewing them as classics. They can offer a valuable legacy, one best left where it is, doing what it does, how it always has done ...
Anti-patterns involve realizing a problem and implementing a non-optimal solution that is broadly embraced as the go-to method for solving that problem. This solution sounds good in theory, but for one reason or another it is not the best means of solving the problem. Anti-patterns are common across IT as well, especially around application monitoring and observability. One that is particularly prevalent is in response to the increasing complexity of cloud-native infrastructure and applications ...
The introduction of the latest technology — such as AI and machine learning — can be seen as a way for organizations to accelerate growth, increase efficiency, and improve customer service. However, the truth is that the technology alone will do little to deliver on these business outcomes. AI for IT operations (AIOps) is one area where the application of technology, if not matched with organizational maturity readiness, will fail to deliver all the promised benefits ...
SREs that fail to deliver customer value run the risk of being stuck in an operational toil rut. Conversely, businesses failing to recognize the bi-modal nature and importance of SRE activities run the risk of losing talented employees and their competitive edge ...
As part of digital transformation initiatives, IT teams are quickly adopting AIOps solutions to accommodate a new multifaceted infrastructure. However, there are still several roadblocks IT leaders must overcome when adopting AIOps — namely, understanding how to showcase ROI and changing their team's cultural mindset around adopting a new strategy ...