Evaluating Commercial vs. Open Source APM
January 17, 2017

Chris Bloom
Savvius

Share this

Choosing an application performance monitoring (APM) solution can be a daunting task. A quick Google search will show popular products, but there's also a long list of less-well-known open source products available, too. So how do you choose the right solution?

The advantages and disadvantages of open source software versus commercial software are part of an age-old debate. Which is better or worse? Which is more or less buggy? Which is faster or slower? And what about documentation and support, and a million other possible differences? The truth is that they have very little to do with whether the software is open source or not.

Cost and Support

Characteristics like support and cost are of course very important, and can vary greatly between the two. The cost of open source may be something you pay to ramp up on the learning curve, and to tweak the software yourself, or pay somebody else to do it for you.

Support of open source can be very good, if the solution becomes popular within the community. On the other hand, a commercial product may have very polished, organized documentation and well-established support. In other words, aside from the quality of the product itself, a big part of the decision to go with open source or not is your preference on when to invest money in the product and how to get support. With open source, you have a lot of flexibility about when and what you spend your money on.
 
With many open source projects there are the completely free options, usually posted on Github as source. There are also commercial components and support provided for a fee from a company supporting the project. This can make getting started reasonably inexpensive if the open source project's functionality satisfies your requirements. As your requirements change and grow, you can develop new functionality yourself, buy components from others, or just wait until somebody else does the work.

One of the biggest benefits of open source from a cost perspective is that once you have something that works for you, you don't have to keep paying for it annually, like you would for a commercial product. On the other hand, paying for a commercial product gives you a well-defined set of features and characteristics that you can count on, and somebody to call and complain to otherwise.

APM Performance: Speed and Scalability

 
Performance is another good example of a software characteristic that cannot be determined by open source or commercial availability. Performance for APM software is defined by speed and scalability, mostly on the back-end. Sure, the front-end UI must be fast, but the real question and challenge for this type of software is how much analysis it can do on network traffic or flow data.

For smaller networks, let's say 100Mbps or less, this is not much of an issue. But when you start to get above that, the overwhelming volume of packets and flows that must be processed every second exceeds the limits of a single thread. This is where you need to consider whether the solution is multi-threaded or not.

And for networks with speeds in the 10Gbps arena and up, even multi-threaded software on a single server is not going to be enough. In this case, the solution needs to scale by distributing the load across several servers, and aggregating the results into a single pane of glass. In my own experience, I have found open source solutions to be more scalable than commercial products, or at least accessible to more people, mainly because of the invention of open source technologies like Hadoop, and the growing number of open source projects that use them.

Commercial Open Source Hybrids

This brings up an important point, though, because commercial products can use open source components as well. These kinds of commercial products are hybrids, and the fact that you can plug open source components into them says something about the architecture and APIs of the product, which is an important point to consider.

As an example, I like to use the open source ELK stack on my company's appliances, allowing disk space to be shared between packets and events. With ELK, which includes the Elasticsearch, Logstash and Kibana components, an appliance can be used to capture and analyze packets while doing double duty as a SIEM for any security events that are generated as a result of analyzing those packets. Similar set-ups in the APM domain are also very plausible.

The Front End

Now let's turn to the front-end. Ideally, the UI is easy to use. This is where commercial products often come out ahead, while the UI for open source projects might not be as polished.

More importantly, the UI has to perform well and be responsive. Nobody wants to wait 10 minutes for their daily dashboard to populate with charts, or 30 minutes to generate a report on last week's performance. This is a tough one to test as well, because it takes time to collect network data for a week, or a month. So no matter which APM software you are evaluating, test it long enough that you're able to analyze long-term reporting performance before making a choice.
 
These are all tough questions and important considerations to keep in mind when choosing an APM solution. While open source is certainly not free of cost, it is also not necessarily more expensive, and commercial software is not necessarily better. Many other characteristics like cost, support, and performance have to be considered in order to make a well-informed decision.

Chris Bloom is Senior Manager of Technical Alliances at Savvius
Share this

The Latest

March 18, 2024

Gartner has highlighted the top trends that will impact technology providers in 2024: Generative AI (GenAI) is dominating the technical and product agenda of nearly every tech provider ...

March 15, 2024

In MEAN TIME TO INSIGHT Episode 4 - Part 1, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at Enterprise Management Associates (EMA) discusses artificial intelligence and network management ...

March 14, 2024

The integration and maintenance of AI-enabled Software as a Service (SaaS) applications have emerged as pivotal points in enterprise AI implementation strategies, offering both significant challenges and promising benefits. Despite the enthusiasm surrounding AI's potential impact, the reality of its implementation presents hurdles. Currently, over 90% of enterprises are grappling with limitations in integrating AI into their tech stack ...

March 13, 2024

In the intricate landscape of IT infrastructure, one critical component often relegated to the back burner is Active Directory (AD) forest recovery — an oversight with costly consequences ...

March 12, 2024

eBPF is a technology that allows users to run custom programs inside the Linux kernel, which changes the behavior of the kernel and makes execution up to 10x faster(link is external) and more efficient for key parts of what makes our computing lives work. That includes observability, networking and security ...

March 11, 2024

Data mesh, an increasingly important decentralized approach to data architecture and organizational design, focuses on treating data as a product, emphasizing domain-oriented data ownership, self-service tools and federated governance. The 2024 State of the Data Lakehouse report from Dremio presents evidence of the growing adoption of data mesh architectures in enterprises ... The report highlights that the drive towards data mesh is increasingly becoming a business strategy to enhance agility and speed in problem-solving and innovation ...

March 07, 2024
In this digital era, consumers prefer a seamless user experience, and here, the significance of performance testing cannot be overstated. Application performance testing is essential in ensuring that your software products, websites, or other related systems operate seamlessly under varying conditions. However, the cost of poor performance extends beyond technical glitches and slow load times; it can directly affect customer satisfaction and brand reputation. Understand the tangible and intangible consequences of poor application performance and how it can affect your business ...
March 06, 2024

Too much traffic can crash a website ... That stampede of traffic is even more horrifying when it's part of a malicious denial of service attack ... These attacks are becoming more common, more sophisticated and increasingly tied to ransomware-style demands. So it's no wonder that the threat of DDoS remains one of the many things that keep IT and marketing leaders up at night ...

March 05, 2024

Today, applications serve as the backbone of businesses, and therefore, ensuring optimal performance has never been more critical. This is where application performance monitoring (APM) emerges as an indispensable tool, empowering organizations to safeguard their applications proactively, match user expectations, and drive growth. But APM is not without its challenges. Choosing to implement APM is a path that's not easily realized, even if it offers great benefits. This blog deals with the potential hurdles that may manifest when you actualize your APM strategy in your IT application environment ...

March 04, 2024

This year's Super Bowl drew in viewership of nearly 124 million viewers and made history as the most-watched live broadcast event since the 1969 moon landing. To support this spike in viewership, streaming companies like YouTube TV, Hulu and Paramount+ began preparing their IT infrastructure months in advance to ensure an exceptional viewer experience without outages or major interruptions. New Relic conducted a survey to understand the importance of a seamless viewing experience and the impact of outages during major streaming events such as the Super Bowl ...