Skip to main content

Preparing Network Infrastructure for AI Starts with the Basics

Tre Ewell
California Institute of Applied Technology (CIAT)

AI is usually talked about as a software tool, but it also depends heavily on the network behind it. Whether a company is using AI for chatbots, automation, monitoring, analytics, or employee support, all of that information has to move across the network in a reliable and secure way.

That means AI is not just an application decision. It is also an infrastructure decision.

Before organizations rush into AI, they should ask a simple question: Is our network ready to support it?

My background is in systems and network engineering, technical contracting, and IT instruction. I am also a technology enthusiast and gamer who has supported larger-scale esports events, where reliable infrastructure is the difference between a smooth experience and a very visible problem.

The first thing organizations should look at is capacity. AI tools can create more traffic than teams expect. They may need to pull information from file systems, databases, cloud services, monitoring tools, internal applications, and user devices. That can put extra pressure on internet connections, wireless networks, switches, and cloud connections.

This does not mean every company needs to rebuild its entire network. It means teams should plan ahead.

Where will the AI tool get its information?

Who will use it?

Will it be used in one office, across multiple locations, or by remote workers?

Will it need access to large files or real-time data?

These questions help organizations understand whether their current network can support the workload.

The second thing to consider is access. AI tools are only useful if they can reach information, but that also creates risk. If an AI system has access to too much data, or if the network is too open, the organization may expose information that should have been better protected.

This is why network separation matters. Sensitive systems, employee devices, guest networks, development environments, and production systems should not all be treated the same. Organizations should make sure users and tools only have access to what they actually need. That basic idea can prevent a lot of future problems.

The third area is visibility. Teams need to know what is happening on their network. If an AI tool slows down, fails, or starts creating unusual traffic, someone should be able to investigate it. That means having useful logs, monitoring, and alerts in place.

This is one of the points I emphasize when teaching networking. Troubleshooting is much harder when you do not know what normal looks like. If a team does not understand its regular traffic patterns, it will be difficult to spot when something unusual is happening. Good monitoring helps teams see problems early instead of waiting for users to complain.

The fourth area is reliability. Once people start using an AI tool every day, they may quickly depend on it. What begins as a test project can become part of customer support, IT operations, training, documentation, or daily business workflows. When that happens, downtime matters.

Organizations should think through what happens if a connection fails, a cloud service is unavailable, or a system that feeds data into the AI tool goes offline. The goal is not to expect perfection. The goal is to have a plan, so the business is not surprised when something breaks.

Finally, organizations should invest in people. AI may be new, but the networking basics still matter. Routing, switching, DNS, DHCP, firewalls, identity, documentation, and troubleshooting are still the foundation. AI does not replace those skills. It makes them more important.

Network teams do not need to become AI experts overnight. But they do need to understand how AI changes the way data moves, how users connect, and how systems depend on each other.

The best way to prepare is to keep it simple: know what systems you have, understand where your data lives, limit access, monitor performance, and test what happens when something fails.

AI may feel like the future, but it still runs on infrastructure. If the network is not ready, the AI experience will not be ready either.

AI readiness starts with getting the basics right.

Tre Ewell is Faculty Member and Instructor at the California Institute of Applied Technology (CIAT)

The Latest

For decades, traditional observability tools have forced IT professionals to sift through endless dashboards, turning a flood of alerts into actionable insight and driving widespread burnout. While enterprises adopted AI to eliminate this friction, most still deploy it reactively rather than proactively ... As systems become more complex and IT moves to the center of business strategy, a reactive posture is unsustainable ...

Ask an operations team what they monitor and you will hear a familiar list: latency, errors, throughput, uptime. Those signals still matter for AI, but they no longer answer the most important question. As Krishna Sai, CTO of SolarWinds, puts it: "Traditional observability tells you a system is running. AI observability tells you whether it's still reasoning soundly. Those are completely different questions" ...

AI observability serves several roles across an organization. AI engineers use it to build, evaluate, and improve AI systems. SREs use it to operate those systems reliably and efficiently in production, including managing their cost. Leaders need it to connect AI behavior and operational performance to business outcomes. The common need is a clear understanding of whether AI systems are delivering the intended result ...

Part 4 outlines the challenges enterprise face when adopting AI observability. The main challenge is that AI complexity compounds at every stage of maturity. LLM-based applications introduce new behavior, dependencies, and quality considerations, while Agentic AI adds further failure modes as systems make decisions and take actions ...

Part 3 reports on the current state of AI observability. Most experts agree: enterprises are moving faster with AI than they are with the operational discipline needed to run it safely ...

When discussing AI Observability, one of the first questions that arises: Is this just an extension of traditional observability or is this a whole new type of tool? Part 2 compares traditional observability with AI observability ...

In this extensive 14-part series that will post over the next three weeks, experts across observability and AI will provide insight and opinions on the need for AI Observability, the challenges, the benefits, the current state, and predictions for the future ...

Amid rising complexity, organizations are moving quickly toward agent-driven operations: AgenticOps, according to The Impact of Agentic AI on Network Operations, a new report from Cisco ...

AI, automation, and enterprise software give organizations an extraordinary amount of leverage. Work that once required hours can happen in minutes. Information buried across systems can be analyzed almost instantly. Complex workflows can be coordinated across teams with far less manual intervention. That leverage creates a temptation to start with the technology ...

Everyone wants to talk about models. Compute clusters. Benchmark scores that climb a fraction of a point and make headlines anyway. It's an easy conversation to have because it's measurable. But it's also increasingly beside the point ...

Preparing Network Infrastructure for AI Starts with the Basics

Tre Ewell
California Institute of Applied Technology (CIAT)

AI is usually talked about as a software tool, but it also depends heavily on the network behind it. Whether a company is using AI for chatbots, automation, monitoring, analytics, or employee support, all of that information has to move across the network in a reliable and secure way.

That means AI is not just an application decision. It is also an infrastructure decision.

Before organizations rush into AI, they should ask a simple question: Is our network ready to support it?

My background is in systems and network engineering, technical contracting, and IT instruction. I am also a technology enthusiast and gamer who has supported larger-scale esports events, where reliable infrastructure is the difference between a smooth experience and a very visible problem.

The first thing organizations should look at is capacity. AI tools can create more traffic than teams expect. They may need to pull information from file systems, databases, cloud services, monitoring tools, internal applications, and user devices. That can put extra pressure on internet connections, wireless networks, switches, and cloud connections.

This does not mean every company needs to rebuild its entire network. It means teams should plan ahead.

Where will the AI tool get its information?

Who will use it?

Will it be used in one office, across multiple locations, or by remote workers?

Will it need access to large files or real-time data?

These questions help organizations understand whether their current network can support the workload.

The second thing to consider is access. AI tools are only useful if they can reach information, but that also creates risk. If an AI system has access to too much data, or if the network is too open, the organization may expose information that should have been better protected.

This is why network separation matters. Sensitive systems, employee devices, guest networks, development environments, and production systems should not all be treated the same. Organizations should make sure users and tools only have access to what they actually need. That basic idea can prevent a lot of future problems.

The third area is visibility. Teams need to know what is happening on their network. If an AI tool slows down, fails, or starts creating unusual traffic, someone should be able to investigate it. That means having useful logs, monitoring, and alerts in place.

This is one of the points I emphasize when teaching networking. Troubleshooting is much harder when you do not know what normal looks like. If a team does not understand its regular traffic patterns, it will be difficult to spot when something unusual is happening. Good monitoring helps teams see problems early instead of waiting for users to complain.

The fourth area is reliability. Once people start using an AI tool every day, they may quickly depend on it. What begins as a test project can become part of customer support, IT operations, training, documentation, or daily business workflows. When that happens, downtime matters.

Organizations should think through what happens if a connection fails, a cloud service is unavailable, or a system that feeds data into the AI tool goes offline. The goal is not to expect perfection. The goal is to have a plan, so the business is not surprised when something breaks.

Finally, organizations should invest in people. AI may be new, but the networking basics still matter. Routing, switching, DNS, DHCP, firewalls, identity, documentation, and troubleshooting are still the foundation. AI does not replace those skills. It makes them more important.

Network teams do not need to become AI experts overnight. But they do need to understand how AI changes the way data moves, how users connect, and how systems depend on each other.

The best way to prepare is to keep it simple: know what systems you have, understand where your data lives, limit access, monitor performance, and test what happens when something fails.

AI may feel like the future, but it still runs on infrastructure. If the network is not ready, the AI experience will not be ready either.

AI readiness starts with getting the basics right.

Tre Ewell is Faculty Member and Instructor at the California Institute of Applied Technology (CIAT)

The Latest

For decades, traditional observability tools have forced IT professionals to sift through endless dashboards, turning a flood of alerts into actionable insight and driving widespread burnout. While enterprises adopted AI to eliminate this friction, most still deploy it reactively rather than proactively ... As systems become more complex and IT moves to the center of business strategy, a reactive posture is unsustainable ...

Ask an operations team what they monitor and you will hear a familiar list: latency, errors, throughput, uptime. Those signals still matter for AI, but they no longer answer the most important question. As Krishna Sai, CTO of SolarWinds, puts it: "Traditional observability tells you a system is running. AI observability tells you whether it's still reasoning soundly. Those are completely different questions" ...

AI observability serves several roles across an organization. AI engineers use it to build, evaluate, and improve AI systems. SREs use it to operate those systems reliably and efficiently in production, including managing their cost. Leaders need it to connect AI behavior and operational performance to business outcomes. The common need is a clear understanding of whether AI systems are delivering the intended result ...

Part 4 outlines the challenges enterprise face when adopting AI observability. The main challenge is that AI complexity compounds at every stage of maturity. LLM-based applications introduce new behavior, dependencies, and quality considerations, while Agentic AI adds further failure modes as systems make decisions and take actions ...

Part 3 reports on the current state of AI observability. Most experts agree: enterprises are moving faster with AI than they are with the operational discipline needed to run it safely ...

When discussing AI Observability, one of the first questions that arises: Is this just an extension of traditional observability or is this a whole new type of tool? Part 2 compares traditional observability with AI observability ...

In this extensive 14-part series that will post over the next three weeks, experts across observability and AI will provide insight and opinions on the need for AI Observability, the challenges, the benefits, the current state, and predictions for the future ...

Amid rising complexity, organizations are moving quickly toward agent-driven operations: AgenticOps, according to The Impact of Agentic AI on Network Operations, a new report from Cisco ...

AI, automation, and enterprise software give organizations an extraordinary amount of leverage. Work that once required hours can happen in minutes. Information buried across systems can be analyzed almost instantly. Complex workflows can be coordinated across teams with far less manual intervention. That leverage creates a temptation to start with the technology ...

Everyone wants to talk about models. Compute clusters. Benchmark scores that climb a fraction of a point and make headlines anyway. It's an easy conversation to have because it's measurable. But it's also increasingly beside the point ...