As we know, virtual environments consist of many moving pieces and are generally complex to setup. Typically, IT environments, depending on the size of the organization, can have several hundred VMs down to a handful of VMs. For such virtual infrastructure deployments, it helps to monitor the performance of VM and VM usage. It's also equally important to ensure the health of your virtual appliances are always in check and to immediately know when something goes wrong.
What you really don't want is to have alerts paging you 24/7, especially when they're not critical situations. Alert management can be a subtle, but dangerous activity. Additionally, manually setting alert thresholds can be an extremely time consuming task. Alternatively, using static thresholds that don't reflect real performance problems often result in alert storms, where administrators stop watching alerts carefully. This is where the "dangerous" part comes in and often true critical alerts can be lost in the noise and missed. As a result, intelligent, dynamic alerting can be critical for both staff efficiency and system reliability.
False Alerts: Reasons Why You Get Them and How to Avoid Them
Here are a few examples why your virtual environment may trigger alerts more frequently than normal:
■ Events that frequently occur, such as resource consumption can trigger alerts more often than most other virtual components.
■ You can get "spam" alerts from VMs or hosts that are no longer in use or that have been discharged.
■ Not properly tuning threshold levels can lead to a sudden spike in alerts.
Having intelligent alerting processes help ensure irrelevant alerts are not generated. This gives virtual admins time to look at "real" alerts and fix them. Here's what you can do to avoid alerting errors:
■ Set up alerts for specific VMs that you think are really going to impact your users or your business.
■ Leverage dynamic thresholds based on historical baseline trends whenever possible to set more realistic thresholds for your clusters, hosts, VMs, and datastore.
■ Establish well-defined threshold settings—this way you can optimize the kind of alerts you receive during the day and ensure that you're not bothered after work hours.
■ Set the right dependencies to significantly lower the amount of alerts you receive.
■ Forward specific alerts to the defined teams, since they understand the severity of the alert and can fix it right away.
Determine What to Monitor and Why
Most admins have to monitor hundreds of virtual appliances, which means you're probably dealing with plenty of alerts. Under these circumstances you'll have to determine a few things:
■ Go over each host to see if all VMs under the host must be monitored or if only a few critical VMs need to be monitored for alerts.
■ Talk to your business groups or users and understand what the impact will be. This will give you a sense of how many VMs and datastores have to be setup for alerts. They may have mission critical applications running inside them, which may affect business performance.
Statistical Thresholds: A Better Way to Set Baseline Values for your Virtual Environment
Normally, you would have to monitor the performance of hosts, VMs, and datastores for several weeks in order to know what the ideal or optimum baseline is to set warning and critical thresholds. However, integrated virtualization management tools can automatically calculate performance of clusters, hosts, VMs, and datastores and determine the baseline values.
IStatistical thresholds allow you to look at the following processes:
■ Applying thresholds to clusters, hosts, VMs, and datastores.
■ Understanding baseline statistics using standard deviation calculation for day and night system performance.
■ Gaining statistical insights into performance metrics and how they vary over time. Look at how stats are collected for higher and lower threshold values for individual VMs and hosts.
■ Calculating thresholds from historical performance data saves time in adjusting thresholds and provides more intelligent alerts.
■ Setting the right threshold values using the built-in baseline calculator. This calculates and applies the recommended threshold values for warning and critical stages for clusters, hosts, VMs, and datastores.
While this won't completely eliminate "spam" alerts, it will quickly let you get to a much smaller set for the administrator to deal with. In turn, it will let them spend more time and attention on striking that balance between monitoring your VM usage and hypervisor performance, and setting the right threshold values.
Karthik Ramachandran is Product Marketing Specialist at SolarWinds.
Evaluating which products and vendors can meet today's modern and complex IT business requirements is a challenge. To help, I'd like to explore 10 key questions every IT admin should be asking when evaluating or working with network performance tools ...
During the 18 months of COVID, Aternity tracked the pandemic's impact on the workplace, office reopening plans remained murky, but what is clear is the permanent way in which various industries have changed. In healthcare, telehealth is here to stay. In retail, online commerce and curbside delivery are permanently shifting where back-office work gets done. These business model adjustments have a lasting effect on corporate technology investments ...
The Internet played a greater role than ever in supporting enterprise productivity over the past year-plus, as newly remote workers logged onto the job via residential links that, it turns out, left much to be desired in terms of enabling work ...
The world's appetite for cloud services has increased but now, more than 18 months since the beginning of the pandemic, organizations are assessing their cloud spend and trying to better understand the IT investments that were made under pressure. This is a huge challenge in and of itself, with the added complexity of embracing hybrid work ...
After a year of unprecedented challenges and change, tech pros responding to this year’s survey, IT Pro Day 2021 survey: Bring IT On from SolarWinds, report a positive perception of their roles and say they look forward to what lies ahead ...
One of the key performance indicators for IT Ops is MTTR (Mean-Time-To-Resolution). MTTR essentially measures the length of your incident management lifecycle: from detection; through assignment, triage and investigation; to remediation and resolution. IT Ops teams strive to shorten their incident management lifecycle and lower their MTTR, to meet their SLAs and maintain healthy infrastructures and services. But that's often easier said than done, with incident triage being a key factor in that challenge ...
Achieve more with less. How many of you feel that pressure — or, even worse, hear those words — trickle down from leadership? The reality is that overworked and under-resourced IT departments will only lead to chronic errors, missed deadlines and service assurance failures. After all, we're only human. So what are overburdened IT departments to do? Reduce the human factor. In a word: automate ...
On average, data innovators release twice as many products and increase employee productivity at double the rate of organizations with less mature data strategies, according to the State of Data Innovation report from Splunk ...
While 90% of respondents believe observability is important and strategic to their business — and 94% believe it to be strategic to their role — just 26% noted mature observability practices within their business, according to the 2021 Observability Forecast ...
Let's explore a few of the most prominent app success indicators and how app engineers can shift their development strategy to better meet the needs of today's app users ...