Skip to main content

GenAI in the Enterprise: Why Data Security Is at Risk

Todd Thorsen
CrashPlan

Enterprise data sprawl — vast amounts of critical information scattered across endpoints and siloed within SaaS applications — already challenges companies' ability to protect and back up their data. Much of this information is never fully secured, leaving organizations vulnerable. Now, as generative AI (GenAI) platforms emerge as yet another environment where enterprise data is consumed, transformed, and created, this fragmentation is set to intensify. Without effective data governance, large swaths of corporate information may not be backed up at all. Instead, that data could be uploaded to external GenAI systems, putting sensitive information and intellectual property at risk and amplifying the already formidable complexities of data protection.

 

Image
Crashplan

 

Use of Unregulated GenAI Spikes

GenAI platforms have increased in popularity, and enterprises need help to control how their employees interact with them. New data shows that 72% of workers who uploaded data to GenAI platforms did so without employers providing licenses. The same study found that 65% of organizations lack clear policies on using data with or from AI platforms. Experimenting with GenAI raises security concerns at the employee and employer levels.

For example, the US Patent and Trademark Office banned the use of GenAI tools last year due to security concerns with the technology and some of these tools exhibiting unpredictable behaviors. While there is a ban on using platforms like ChatGPT for work purposes, USPTO employees can use "state-of-the-art generative AI models" only inside the agency's internal test environment.

While this might be considered a cautious approach, it indicates how workplaces will likely evaluate how they implement and interact with GenAI platforms.

Unregulated GenAI Use Comes with Security Risks

The rapid adoption of GenAI tools has raised concerns about data privacy and security within organizations. But what exactly are these risks, and what implications can companies face?

  • Data breaches: AI tools may not have sufficient security controls in place which can lead to exposure of sensitive or proprietary data to malicious actors.
  • Intellectual property theft: Any data uploaded to GenAI platforms is stored and can be used to train the models, leaving IP and trade secrets in the public domain.
  • Regulatory violations: Depending on the data involved, geography and industry regulations like GDPR, HIPAA, and CCPA can come into play, meaning there are strict data governance regulations. Non-compliance of these can result in fines or legal action.

Using unregulated GenAI can have severe consequences, which re-emphasizes the need for clear guidelines, ethical safeguards, and responsible deployment to ensure companies and employees benefit from these technologies while managing the associated risks.

Addressing the Risks of GenAI

Responsible governance requires a combination of technology, policy, education, and collaboration to foster a culture of responsible innovation and allow enterprises to minimize risks. So, what can companies do to ensure their data is protected? Develop actionable plans that include:

  • Clear GenAI policies: Establish guidelines for how GenAI platforms can be used, including approved cases. Prohibit sensitive or proprietary data from being uploaded and implement an approval process for using GenAI tools. Enterprises must define how they expect employees to use these platforms.
  • Licensed access: Ensure employees can access and use licensed GenAI tools vetted for security and compliance purposes. This provides greater control over the types of platforms being used by employees.
  • Data security training: Whether it's periodic training or in-the-moment reminders, employees need to be educated about the implications of leveraging an unregulated GenAI platform and using company data. Since these platforms use data to train their models, safeguarding IP and sensitive data is crucial.
  • Track GenAI activity: Organizations can monitor and manage how employees interact with GenAI platforms and look for red flags like high-volume uploads or using unapproved tools.

Uploading sensitive company data to unapproved third-party GenAI platforms can leave companies vulnerable to many consequences and potential regulatory violations. Organizations must establish policies and appropriately vet tools to help minimize risk and ensure responsible use.

As GenAI accelerates the creation and dispersion of enterprise data, the risks of data sprawl and insufficient backups increase dramatically. If left unmanaged, GenAI usage could lead to critical corporate information living outside secure ecosystems — never fully backed up, difficult to govern, and vulnerable to theft or misuse. By implementing robust policies, ensuring licensed and controlled platform access, providing ongoing employee education, and maintaining visibility into GenAI interactions, enterprises can still harness the innovative power of these tools. In doing so, they not only mitigate data security and compliance risks but also ensure that data, no matter where it resides, remains protected, integral, and usable for driving sustainable business value.

Todd Thorsen is Chief Information Security Officer at CrashPlan

The Latest

Performance bottlenecks aren't uncommon when it comes to rolling out new technology, regardless of how capable or game-changing that technology might be. Every generation of new tech has encountered roadblocks that had to be overcome before it was truly able to shine. Virtualization forced organizations to rethink resource allocation, cloud transformation had us shift our focus toward scalability and elasticity, and microservices introduced entirely new challenges around observability and distributed systems. There's something different about AI, however ...

Consider a single order represented across order-management, execution, and settlement systems. Each database, message broker, and application may be online and processing its own records correctly. Yet the workflow has failed if related events arrive on different clocks, rely on inconsistent state, or cannot be reconciled before an operational decision must be made ...

AI now exists in almost every IT workflow. In a recent survey of more than 800 IT service professionals, all respondents indicated the use of AI in some form within their organization. But there's a growing paradox: if dashboards are clearing faster and alerts are resolved at unprecedented speed, why aren't IT service desks reporting lighter workloads? The research found that 71% of IT teams said their actual workload has remained flat or increased since adopting AI. This reality appears to contradict what we’ve been told about AI ...

Two years ago, almost every customer conversation about AI started with the same questions: Which model should we use? What can it do? Is it ready for the enterprise? Today, those discussions have moved on. CIOs are far more interested in how to govern AI, integrate it with existing systems, prepare their workforce and make it part of everyday operations. The challenge is no longer to prove that AI can deliver value. It's instead about how to embed AI into the business in a way that's secure, scalable and delivers measurable outcomes ...

Two things happened to production incidents between 2023 and now, and they did not happen at the same speed. The first is that a class of dependency that barely existed three years ago now accounts for one incident in ten. Incidents disclosed by AI model and AI application providers rose from 1.7% of all disclosed unplanned incidents in 2023 to 10.7% in 2026 year to date, roughly a sixfold rise; that counts only incidents at AI companies themselves, so the true share is higher. The second is that the time to close an incident has not come down ...

When an AI assistant gives an incomplete or incorrect answer, teams often blame the model. They adjust prompts, switch models, increase context windows or test a new retrieval strategy. However the model may not be a problem. In many enterprise AI workflows, the problem begins inside the document-ingestion pipeline ...

If you talk to any security or observability teams right now, they're all fighting the same fire: their tooling was built to ingest X, but their sources are pumping Y and soon to be doing Z. The knee-jerk reaction is always the same: we need more platform. However, this reaction is wrong. Let me explain why, because the solution to this problem is foundational, not financial. Instead of hurling yet more money at the problem, make sure you've done what's needed upstream ...

Rapid AI adoption and the unique ways AI workloads operate is redefining the scope and structure of what these teams must deliver. This shift is forcing organizations to rethink how they manage scale, automation, and control, according to The State of SRE and Platform Engineering 2026, a new report from Dynatrace ...

AI is usually talked about as a software tool, but it also depends heavily on the network behind it. Whether a company is using AI for chatbots, automation, monitoring, analytics, or employee support, all of that information has to move across the network in a reliable and secure way. That means AI is not just an application decision. It is also an infrastructure decision. Before organizations rush into AI, they should ask a simple question: Is our network ready to support it? ...

Enterprise AI often lacks governed access to where business processes actually execute. Without that access, AI agents may be able to reason, but they cannot operate reliably across enterprise workflows. For AI agents to effectively carry out workflows, they will require integration-layer context and controls. Organizations can implement these prerequisites by providing AI with managed access to the middleware layer ...

GenAI in the Enterprise: Why Data Security Is at Risk

Todd Thorsen
CrashPlan

Enterprise data sprawl — vast amounts of critical information scattered across endpoints and siloed within SaaS applications — already challenges companies' ability to protect and back up their data. Much of this information is never fully secured, leaving organizations vulnerable. Now, as generative AI (GenAI) platforms emerge as yet another environment where enterprise data is consumed, transformed, and created, this fragmentation is set to intensify. Without effective data governance, large swaths of corporate information may not be backed up at all. Instead, that data could be uploaded to external GenAI systems, putting sensitive information and intellectual property at risk and amplifying the already formidable complexities of data protection.

 

Image
Crashplan

 

Use of Unregulated GenAI Spikes

GenAI platforms have increased in popularity, and enterprises need help to control how their employees interact with them. New data shows that 72% of workers who uploaded data to GenAI platforms did so without employers providing licenses. The same study found that 65% of organizations lack clear policies on using data with or from AI platforms. Experimenting with GenAI raises security concerns at the employee and employer levels.

For example, the US Patent and Trademark Office banned the use of GenAI tools last year due to security concerns with the technology and some of these tools exhibiting unpredictable behaviors. While there is a ban on using platforms like ChatGPT for work purposes, USPTO employees can use "state-of-the-art generative AI models" only inside the agency's internal test environment.

While this might be considered a cautious approach, it indicates how workplaces will likely evaluate how they implement and interact with GenAI platforms.

Unregulated GenAI Use Comes with Security Risks

The rapid adoption of GenAI tools has raised concerns about data privacy and security within organizations. But what exactly are these risks, and what implications can companies face?

  • Data breaches: AI tools may not have sufficient security controls in place which can lead to exposure of sensitive or proprietary data to malicious actors.
  • Intellectual property theft: Any data uploaded to GenAI platforms is stored and can be used to train the models, leaving IP and trade secrets in the public domain.
  • Regulatory violations: Depending on the data involved, geography and industry regulations like GDPR, HIPAA, and CCPA can come into play, meaning there are strict data governance regulations. Non-compliance of these can result in fines or legal action.

Using unregulated GenAI can have severe consequences, which re-emphasizes the need for clear guidelines, ethical safeguards, and responsible deployment to ensure companies and employees benefit from these technologies while managing the associated risks.

Addressing the Risks of GenAI

Responsible governance requires a combination of technology, policy, education, and collaboration to foster a culture of responsible innovation and allow enterprises to minimize risks. So, what can companies do to ensure their data is protected? Develop actionable plans that include:

  • Clear GenAI policies: Establish guidelines for how GenAI platforms can be used, including approved cases. Prohibit sensitive or proprietary data from being uploaded and implement an approval process for using GenAI tools. Enterprises must define how they expect employees to use these platforms.
  • Licensed access: Ensure employees can access and use licensed GenAI tools vetted for security and compliance purposes. This provides greater control over the types of platforms being used by employees.
  • Data security training: Whether it's periodic training or in-the-moment reminders, employees need to be educated about the implications of leveraging an unregulated GenAI platform and using company data. Since these platforms use data to train their models, safeguarding IP and sensitive data is crucial.
  • Track GenAI activity: Organizations can monitor and manage how employees interact with GenAI platforms and look for red flags like high-volume uploads or using unapproved tools.

Uploading sensitive company data to unapproved third-party GenAI platforms can leave companies vulnerable to many consequences and potential regulatory violations. Organizations must establish policies and appropriately vet tools to help minimize risk and ensure responsible use.

As GenAI accelerates the creation and dispersion of enterprise data, the risks of data sprawl and insufficient backups increase dramatically. If left unmanaged, GenAI usage could lead to critical corporate information living outside secure ecosystems — never fully backed up, difficult to govern, and vulnerable to theft or misuse. By implementing robust policies, ensuring licensed and controlled platform access, providing ongoing employee education, and maintaining visibility into GenAI interactions, enterprises can still harness the innovative power of these tools. In doing so, they not only mitigate data security and compliance risks but also ensure that data, no matter where it resides, remains protected, integral, and usable for driving sustainable business value.

Todd Thorsen is Chief Information Security Officer at CrashPlan

The Latest

Performance bottlenecks aren't uncommon when it comes to rolling out new technology, regardless of how capable or game-changing that technology might be. Every generation of new tech has encountered roadblocks that had to be overcome before it was truly able to shine. Virtualization forced organizations to rethink resource allocation, cloud transformation had us shift our focus toward scalability and elasticity, and microservices introduced entirely new challenges around observability and distributed systems. There's something different about AI, however ...

Consider a single order represented across order-management, execution, and settlement systems. Each database, message broker, and application may be online and processing its own records correctly. Yet the workflow has failed if related events arrive on different clocks, rely on inconsistent state, or cannot be reconciled before an operational decision must be made ...

AI now exists in almost every IT workflow. In a recent survey of more than 800 IT service professionals, all respondents indicated the use of AI in some form within their organization. But there's a growing paradox: if dashboards are clearing faster and alerts are resolved at unprecedented speed, why aren't IT service desks reporting lighter workloads? The research found that 71% of IT teams said their actual workload has remained flat or increased since adopting AI. This reality appears to contradict what we’ve been told about AI ...

Two years ago, almost every customer conversation about AI started with the same questions: Which model should we use? What can it do? Is it ready for the enterprise? Today, those discussions have moved on. CIOs are far more interested in how to govern AI, integrate it with existing systems, prepare their workforce and make it part of everyday operations. The challenge is no longer to prove that AI can deliver value. It's instead about how to embed AI into the business in a way that's secure, scalable and delivers measurable outcomes ...

Two things happened to production incidents between 2023 and now, and they did not happen at the same speed. The first is that a class of dependency that barely existed three years ago now accounts for one incident in ten. Incidents disclosed by AI model and AI application providers rose from 1.7% of all disclosed unplanned incidents in 2023 to 10.7% in 2026 year to date, roughly a sixfold rise; that counts only incidents at AI companies themselves, so the true share is higher. The second is that the time to close an incident has not come down ...

When an AI assistant gives an incomplete or incorrect answer, teams often blame the model. They adjust prompts, switch models, increase context windows or test a new retrieval strategy. However the model may not be a problem. In many enterprise AI workflows, the problem begins inside the document-ingestion pipeline ...

If you talk to any security or observability teams right now, they're all fighting the same fire: their tooling was built to ingest X, but their sources are pumping Y and soon to be doing Z. The knee-jerk reaction is always the same: we need more platform. However, this reaction is wrong. Let me explain why, because the solution to this problem is foundational, not financial. Instead of hurling yet more money at the problem, make sure you've done what's needed upstream ...

Rapid AI adoption and the unique ways AI workloads operate is redefining the scope and structure of what these teams must deliver. This shift is forcing organizations to rethink how they manage scale, automation, and control, according to The State of SRE and Platform Engineering 2026, a new report from Dynatrace ...

AI is usually talked about as a software tool, but it also depends heavily on the network behind it. Whether a company is using AI for chatbots, automation, monitoring, analytics, or employee support, all of that information has to move across the network in a reliable and secure way. That means AI is not just an application decision. It is also an infrastructure decision. Before organizations rush into AI, they should ask a simple question: Is our network ready to support it? ...

Enterprise AI often lacks governed access to where business processes actually execute. Without that access, AI agents may be able to reason, but they cannot operate reliably across enterprise workflows. For AI agents to effectively carry out workflows, they will require integration-layer context and controls. Organizations can implement these prerequisites by providing AI with managed access to the middleware layer ...