Skip to main content

What's Ahead for the Software Testing Industry in 2018?

Sven Hammar

As we enter 2018, businesses are busy anticipating what the new year will bring in terms of industry developments, growing trends, and hidden surprises. In 2017, the increased use of automation within testing teams (where Agile development boosted speed of release), led to QA becoming much more embedded within development teams than would have been the case a few years ago. As a result, proper software testing and monitoring assumes ever greater importance.

The natural question is – what next? Here are some of the changes we believe will happen within our industry in 2018:

AI Breakthroughs Will Begin

Organizations will make breakthroughs with machine learning and artificial intelligence in 2018, especially when it comes to using this technology to get a better understanding of their collected data.

Often, it's hard to see the physical manifestation of wider concepts like AI, but in our space, physical objects – “intelligent things” – fill that gap. Previously, IoT devices sent data for limited onward processing; now, machine learning means devices are capable of transforming that same data into actionable insight. Realtime feedback will change the behavior of our IoT devices for good.

Focus on Quality, Security and Resilience

Businesses will need to address the overall quality of their services as the competitive landscape evens out

Given the high level of major outages in 2017, it is evident that the industry has not been moving fast enough to address the explosive growth of the IoT and API economy. There are organizations that are leading the way and achieving great things in both testing and monitoring; however, most are still disproportionally focusing on speed rather than quality, security and resilience.

Looking into 2018, businesses will need to address the overall quality of their services as the competitive landscape evens out. This will result in a refocus on the monitoring of the customer experience and the need for extensive end-to-end testing, embedded within the delivery lifecycle.

Services Will be a Key Differentiator

In 2018, services will become more of the differentiating factor, as capabilities become more similar. Differentiation of services will come down to availability, ease of use and consistency of a quality experience.

The increased reliance on IoT devices, their data and their management will also drive the need for high availability of the API services that these devices will talk to. Monitoring the availability of these APIs will be the critical factor in ensuring that business can continue to run (especially in the manufacturing space), and that business intelligence data can be trusted by decision makers.

Customer Experience Will Become More Important Than Ever

Software testing and monitoring has historically been the realm of the IT team, be that the development teams for testing, or operations on the monitoring side.

In 2018, the digital transformation drive is underway in most enterprises, combined with the explosion of IoT devices and the data processing that derives from them. This will draw the focus onto both the quality of the application and the overall customer experience.

Consequently, both testing and monitoring should be of significant interest to the Chief Operating Officer and the Chief Marketing Officer within organizations, resulting in more rounded testing with team members coming from different parts of the business. That's a potential step change in the type of testing that would be carried out, as well as in the visibility within the business of monitoring results and testing success.

The Way We Validate Results Will Change

2018 will see the adoption of AI, in the form of machine learning, by major software vendors who will be embedding it within their core applications. This machine learning will also become a standard platform for data analytics for new development initiatives. The IoT market will take greatest advantage from this adoption, as the volume of data needing analysis grows exponentially.

This is going to challenge the testing community as new ways of testing and validating the results from AI need to be identified and embedded within the development lifecycle.

Hot Topics

The Latest

For decades, traditional observability tools have forced IT professionals to sift through endless dashboards, turning a flood of alerts into actionable insight and driving widespread burnout. While enterprises adopted AI to eliminate this friction, most still deploy it reactively rather than proactively ... As systems become more complex and IT moves to the center of business strategy, a reactive posture is unsustainable ...

Ask an operations team what they monitor and you will hear a familiar list: latency, errors, throughput, uptime. Those signals still matter for AI, but they no longer answer the most important question. As Krishna Sai, CTO of SolarWinds, puts it: "Traditional observability tells you a system is running. AI observability tells you whether it's still reasoning soundly. Those are completely different questions" ...

AI observability serves several roles across an organization. AI engineers use it to build, evaluate, and improve AI systems. SREs use it to operate those systems reliably and efficiently in production, including managing their cost. Leaders need it to connect AI behavior and operational performance to business outcomes. The common need is a clear understanding of whether AI systems are delivering the intended result ...

Part 4 outlines the challenges enterprise face when adopting AI observability. The main challenge is that AI complexity compounds at every stage of maturity. LLM-based applications introduce new behavior, dependencies, and quality considerations, while Agentic AI adds further failure modes as systems make decisions and take actions ...

Part 3 reports on the current state of AI observability. Most experts agree: enterprises are moving faster with AI than they are with the operational discipline needed to run it safely ...

When discussing AI Observability, one of the first questions that arises: Is this just an extension of traditional observability or is this a whole new type of tool? Part 2 compares traditional observability with AI observability ...

In this extensive 14-part series that will post over the next three weeks, experts across observability and AI will provide insight and opinions on the need for AI Observability, the challenges, the benefits, the current state, and predictions for the future ...

Amid rising complexity, organizations are moving quickly toward agent-driven operations: AgenticOps, according to The Impact of Agentic AI on Network Operations, a new report from Cisco ...

AI, automation, and enterprise software give organizations an extraordinary amount of leverage. Work that once required hours can happen in minutes. Information buried across systems can be analyzed almost instantly. Complex workflows can be coordinated across teams with far less manual intervention. That leverage creates a temptation to start with the technology ...

Everyone wants to talk about models. Compute clusters. Benchmark scores that climb a fraction of a point and make headlines anyway. It's an easy conversation to have because it's measurable. But it's also increasingly beside the point ...

What's Ahead for the Software Testing Industry in 2018?

Sven Hammar

As we enter 2018, businesses are busy anticipating what the new year will bring in terms of industry developments, growing trends, and hidden surprises. In 2017, the increased use of automation within testing teams (where Agile development boosted speed of release), led to QA becoming much more embedded within development teams than would have been the case a few years ago. As a result, proper software testing and monitoring assumes ever greater importance.

The natural question is – what next? Here are some of the changes we believe will happen within our industry in 2018:

AI Breakthroughs Will Begin

Organizations will make breakthroughs with machine learning and artificial intelligence in 2018, especially when it comes to using this technology to get a better understanding of their collected data.

Often, it's hard to see the physical manifestation of wider concepts like AI, but in our space, physical objects – “intelligent things” – fill that gap. Previously, IoT devices sent data for limited onward processing; now, machine learning means devices are capable of transforming that same data into actionable insight. Realtime feedback will change the behavior of our IoT devices for good.

Focus on Quality, Security and Resilience

Businesses will need to address the overall quality of their services as the competitive landscape evens out

Given the high level of major outages in 2017, it is evident that the industry has not been moving fast enough to address the explosive growth of the IoT and API economy. There are organizations that are leading the way and achieving great things in both testing and monitoring; however, most are still disproportionally focusing on speed rather than quality, security and resilience.

Looking into 2018, businesses will need to address the overall quality of their services as the competitive landscape evens out. This will result in a refocus on the monitoring of the customer experience and the need for extensive end-to-end testing, embedded within the delivery lifecycle.

Services Will be a Key Differentiator

In 2018, services will become more of the differentiating factor, as capabilities become more similar. Differentiation of services will come down to availability, ease of use and consistency of a quality experience.

The increased reliance on IoT devices, their data and their management will also drive the need for high availability of the API services that these devices will talk to. Monitoring the availability of these APIs will be the critical factor in ensuring that business can continue to run (especially in the manufacturing space), and that business intelligence data can be trusted by decision makers.

Customer Experience Will Become More Important Than Ever

Software testing and monitoring has historically been the realm of the IT team, be that the development teams for testing, or operations on the monitoring side.

In 2018, the digital transformation drive is underway in most enterprises, combined with the explosion of IoT devices and the data processing that derives from them. This will draw the focus onto both the quality of the application and the overall customer experience.

Consequently, both testing and monitoring should be of significant interest to the Chief Operating Officer and the Chief Marketing Officer within organizations, resulting in more rounded testing with team members coming from different parts of the business. That's a potential step change in the type of testing that would be carried out, as well as in the visibility within the business of monitoring results and testing success.

The Way We Validate Results Will Change

2018 will see the adoption of AI, in the form of machine learning, by major software vendors who will be embedding it within their core applications. This machine learning will also become a standard platform for data analytics for new development initiatives. The IoT market will take greatest advantage from this adoption, as the volume of data needing analysis grows exponentially.

This is going to challenge the testing community as new ways of testing and validating the results from AI need to be identified and embedded within the development lifecycle.

Hot Topics

The Latest

For decades, traditional observability tools have forced IT professionals to sift through endless dashboards, turning a flood of alerts into actionable insight and driving widespread burnout. While enterprises adopted AI to eliminate this friction, most still deploy it reactively rather than proactively ... As systems become more complex and IT moves to the center of business strategy, a reactive posture is unsustainable ...

Ask an operations team what they monitor and you will hear a familiar list: latency, errors, throughput, uptime. Those signals still matter for AI, but they no longer answer the most important question. As Krishna Sai, CTO of SolarWinds, puts it: "Traditional observability tells you a system is running. AI observability tells you whether it's still reasoning soundly. Those are completely different questions" ...

AI observability serves several roles across an organization. AI engineers use it to build, evaluate, and improve AI systems. SREs use it to operate those systems reliably and efficiently in production, including managing their cost. Leaders need it to connect AI behavior and operational performance to business outcomes. The common need is a clear understanding of whether AI systems are delivering the intended result ...

Part 4 outlines the challenges enterprise face when adopting AI observability. The main challenge is that AI complexity compounds at every stage of maturity. LLM-based applications introduce new behavior, dependencies, and quality considerations, while Agentic AI adds further failure modes as systems make decisions and take actions ...

Part 3 reports on the current state of AI observability. Most experts agree: enterprises are moving faster with AI than they are with the operational discipline needed to run it safely ...

When discussing AI Observability, one of the first questions that arises: Is this just an extension of traditional observability or is this a whole new type of tool? Part 2 compares traditional observability with AI observability ...

In this extensive 14-part series that will post over the next three weeks, experts across observability and AI will provide insight and opinions on the need for AI Observability, the challenges, the benefits, the current state, and predictions for the future ...

Amid rising complexity, organizations are moving quickly toward agent-driven operations: AgenticOps, according to The Impact of Agentic AI on Network Operations, a new report from Cisco ...

AI, automation, and enterprise software give organizations an extraordinary amount of leverage. Work that once required hours can happen in minutes. Information buried across systems can be analyzed almost instantly. Complex workflows can be coordinated across teams with far less manual intervention. That leverage creates a temptation to start with the technology ...

Everyone wants to talk about models. Compute clusters. Benchmark scores that climb a fraction of a point and make headlines anyway. It's an easy conversation to have because it's measurable. But it's also increasingly beside the point ...