The Data Center: IT's Halloween Fear Factory
October 31, 2016

Kong Yang
SolarWinds

Share this

I was working in the data center, late one night
When my eyes beheld an eerie sight
For my infrastructure began to screech
And suddenly there was a breach …

 
Hey, it's Halloween, how could I not take advantage of the opportunity for a little IT-style "Monster Mash?"

The spookiest day of the year is here, and Halloween is actually a good reminder that trouble in the data center is always lurking just beneath the application surface, ready to wreak havoc at any moment.

So, in the spirit of Halloween, SolarWinds recently asked our THWACK community of IT professionals their deepest, darkest IT fears. While some are definitely good for a chuckle, and you'll probably just nod your head in agreement at others, the responses simply allude to the fact that in IT, if things can go wrong, they usually will, and how important it is to be prepared to address the many challenges that exist.

Here are a handful of the responses we got:

■ Stupidity. Yes, my number one fear is stupidity. Not mine, mind you, but others'. For example, I recently walked into a client's site and found a ton of power strips laying on the floor behind their telecom racks. It would have been so easy for someone to have simply tripped over one, unplugging it in the process. Doing so would have caused an outage to an entire manufacturing plant.

■ My greatest IT fear (and fear is general) is clowns on backhoes digging all around our facility looking for that undocumented fiber or twisted pair. (Shudder.)

■ My greatest fear is upper management not understanding the importance of redundancy. Our ERP system is at headquarters and all plants communicate with it almost nonstop for labels and shipping information to get product out. Having headquarters' WAN connection die and then needing to wait for hardware to arrive to replace it would bring business to a halt.

■ My leading fear is our monitoring software either taking an unscheduled dirt nap for some reason or otherwise becoming unavailable. Flying blind in this day and age is a scary proposition. It would indeed be a dark day.

■ Human error can be the worst nightmare of all. I've seen overly enthusiastic electricians and phone technicians cut lines they weren't supposed to.

■ Aside from my technological nightmares, my biggest fear is a server fan eating my beard. There are some devices out there (NexSAN SATABeast, anyone?) that have massive fans, and I've come close to being eaten alive a few times. Aside from the immediate pain, the call to support to get a replacement fan would be quite awkward...

■ My biggest fear? That a "new" and as of yet undetected vulnerability is wreaking havoc in my environment, letting bad guys take whatever data they want even as I write this … and that it then ends up on every news channel with our company logo big and bold.

■ Natural disasters are especially frightening to me as an IT professional, whether it be hurricanes, tornadoes or particularly earthquakes. I'm both curious (and not interested) in finding out the technological ramifications an earthquake would have in our data center and the subsequent ripple (no pun intended … OK, pun intended) effect throughout the organization. Not just server racks, but the smaller stuff, too, like all the creative ways an earthquake would kill spinning hard drives. (Though, if racks are just falling over, hard drives would probably be the least of our worries.)

■ I'm deathly afraid that there's ransomware living on some of our critical production and backup data without us knowing it, and then someone decides to pull the trigger and poof! All of our production and backup data are encrypted.

■ Weather in general has me always freaked out! Water and data centers don't mix well.

While data center-destroying clowns may not be so likely, some of these fears are definitely legitimate. Another fear many systems administrators have is staying relevant today and into the future, especially considering the continual and rapid rate of change we see in the data center (think hyperconvergence, the cloud and hybrid IT, microservices, containers, DevOps, serverless architecture, etc.). So, in closing, I thought I'd provide some advice I think may help:

Develop an application-centric mindset

What matters to the business most is that applications are working well all the time, because every business, and every component of every business, is now dependent on applications. The modern systems administrator needs to think about application uptime and performance first and foremost — end user experience metrics are now part of the CIO's SLA.

Use monitoring with discipline to be the "silent hero"

Given the importance of application uptime and performance, systems and application monitoring needs to become second nature. Systems administrators must implement and manage comprehensive monitoring solutions in order to optimize application performance, realign resources, identify early warning signs of problems and take proactive action. By finding and solving a problem before any end users even know there is a problem, the systems administrator becomes the "silent hero."

Embrace the role of strategic adviser rather than simply remaining a problem fixer

Thanks to the consumerization of technology, the control of many technology decisions has shifted from systems administrator to the end user. This means systems administrators should look to provide insight and advice to all parts of the business to help end users and department leaders make intelligent choices, rather than just responding to tickets.

Learn how to make the right technology decisions for the business

There is a myriad new technologies available to IT: from those mentioned above to IoT to big data. Systems administrators must be smart about choosing the technologies that can truly add value to the business and be able to integrate them when they reach the right level of maturity.

Always keep security top of mind

Whatever a systems administrator does, security needs to be a top priority. The sophistication of attacks is increasing and evolving just as quickly as organizations can prepare for them, sometimes faster. Exacerbating the issue is how much sensitive information companies are storing in today's era of Big Data. And the weakest link remain the end users. Today's systems administrators must continually take steps to ensure the security of their organizations' digital infrastructure.

Kong Yang is a Head Geek at SolarWinds.

Share this

The Latest

July 25, 2024

The 2024 State of the Data Center Report from CoreSite shows that although C-suite confidence in the economy remains high, a VUCA (volatile, uncertain, complex, ambiguous) environment has many business leaders proceeding with caution when it comes to their IT and data ecosystems, with an emphasis on cost control and predictability, flexibility and risk management ...

July 24, 2024

In June, New Relic published the State of Observability for Energy and Utilities Report to share insights, analysis, and data on the impact of full-stack observability software in energy and utilities organizations' service capabilities. Here are eight key takeaways from the report ...

July 23, 2024

The rapid rise of generative AI (GenAI) has caught everyone's attention, leaving many to wonder if the technology's impact will live up to the immense hype. A recent survey by Alteryx provides valuable insights into the current state of GenAI adoption, revealing a shift from inflated expectations to tangible value realization across enterprises ... Here are five key takeaways that underscore GenAI's progression from hype to real-world impact ...

July 22, 2024
A defective software update caused what some experts are calling the largest IT outage in history on Friday, July 19. The impact reverberated through multiple industries around the world ...
July 18, 2024

As software development grows more intricate, the challenge for observability engineers tasked with ensuring optimal system performance becomes more daunting. Current methodologies are struggling to keep pace, with the annual Observability Pulse surveys indicating a rise in Mean Time to Remediation (MTTR). According to this survey, only a small fraction of organizations, around 10%, achieve full observability today. Generative AI, however, promises to significantly move the needle ...

July 17, 2024

While nearly all data leaders surveyed are building generative AI applications, most don't believe their data estate is actually prepared to support them, according to the State of Reliable AI report from Monte Carlo Data ...

July 16, 2024

Enterprises are putting a lot of effort into improving the digital employee experience (DEX), which has become essential to both improving organizational performance and attracting and retaining talented workers. But to date, most efforts to deliver outstanding DEX have focused on people working with laptops, PCs, or thin clients. Employees on the frontlines, using mobile devices to handle logistics ... have been largely overlooked ...

July 15, 2024

The average customer-facing incident takes nearly three hours to resolve (175 minutes) while the estimated cost of downtime is $4,537 per minute, meaning each incident can cost nearly $794,000, according to new research from PagerDuty ...

July 12, 2024

In MEAN TIME TO INSIGHT Episode 8, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses AutoCon with the conference founders Scott Robohn and Chris Grundemann ...

July 11, 2024

Numerous vendors and service providers have recently embraced the NaaS concept, yet there is still no industry consensus on its definition or the types of networks it involves. Furthermore, providers have varied in how they define the NaaS service delivery model. I conducted research for a new report, Network as a Service: Understanding the Cloud Consumption Model in Networking, to refine the concept of NaaS and reduce buyer confusion over what it is and how it can offer value ...