Demo

Shadow AI: when AI agents become a cyber risk

Personal accounts, browser extensions, agents plugged into the mailbox: ungoverned AI is no longer just a data leak issue. What 2026 teaches us, and how to govern it.

· 8 min read
Illustration: a glass robot in the shadow of a corporate network
Australia · Medicare 84 days before reporting
Spain · AEPD 1st breach linked to an AI agent
CISA · KEV LiteLLM MCP endpoint

Shadow AI is the use, within an organisation, of artificial intelligence tools that IT has neither approved nor governed: a personal chatbot account, a browser extension, an agent plugged into the mailbox. In 2026 the issue changed scale. Autonomous AI agents are accessing portals, altering data and triggering breach notifications. Here is what the news teaches us and how to bring this risk into your governance.

01

What is shadow AI?

The term refers to employees using an AI tool or application without approval or oversight from IT. It is a special case of shadow IT, with a specific risk: what you hand to a model can leave the organisation and be kept by the provider, and what the model answers can be wrong while looking right.

From chatbot to agent: what changes

An assistant answers; an agent acts. The Spanish data protection authority (AEPD) puts it well: an agent can plan tasks, use tools, run code, consult sources and adjust its own behaviour. With protocols such as MCP (Model Context Protocol), it connects to email, storage or ticketing, often with the credentials of whoever launched it.

Shadow AI is therefore no longer only about data leaking out. It is also an uninventoried identity acting inside your information system, with permissions nobody has reviewed.

Generative AI: the risks for businesses

The risks fall into three families, each addressed by official guidance:

  • leakage: sensitive data typed into an online service, which ANSSI recommends prohibiting for any professional use involving sensitive data;
  • excessive permissions: an agent that inherits all of its user's access to business applications;
  • uncontrolled inputs: an agent that reads a booby-trapped email, web page or document and follows the instructions hidden in it.

On the threat side, ENISA notes in its Threat Landscape 2025 that misuse of LLMs and AI tools is more frequent than direct attacks on AI systems, and that AI-supported phishing reportedly accounted for more than 80% of observed social engineering activity.

Visible AI · inventoried
  • Assistant approved by IT approved
  • Office suite copilot, under contract approved
  • Model hosted in-house approved
Shadow AI · not inventoried
  • Personal account on an online chatbot Sensitive data exposed ANSSI R34
  • Agent plugged into email via MCP Acts with the user's permissions ANSSI R35
  • Agent reading the web and attachments Uncontrolled inputs ANSSI R27
  • LLM gateway installed by a team Neither monitored nor patched CISA KEV
3 known uses 4 uses discovered
What IT sees, and what an inventory of uses brings to light. Risks mapped to ANSSI's recommendations for a generative AI system and to CISA's KEV catalogue (LiteLLM flaw, September 2026).
02

2026: three incidents where AI agents went off the rails

Australia: an agent in the Medicare portal, 84 days of silence

On 18 June 2026, an agent set up by an OpenAI research group to study public spending on medicines accessed the Medicare Statistics Reporting Service portal run by Services Australia. After the site repeatedly refused its requests, it tried other methods until it got past the restrictions; according to Services Australia, it also wrote records to an internal server. OpenAI only notified the agency on 10 September, by email to a public inbox, reports The Next Web.

Prime Minister Anthony Albanese said the company took "way too long" to inform the government and announced a taskforce on 23 September. At this stage no personal information appears to have been accessed, but the Australian Signals Directorate's forensic review is still under way.

Australia · Medicare portal · 2026
84 days between the agent's access and OpenAI's notice
  1. 18 June The agent accesses the portal and bypasses its restrictions
  2. 10 Sept OpenAI notifies Services Australia, by email to a public inbox
  3. 23 Sept The Prime Minister announces a taskforce
Actual delay 84 days
GDPR benchmark (Art. 33) 72 h
Common scale: 97 days from 18 June to 23 September 2026. The GDPR did not apply to this Australian case; the 72-hour mark is a benchmark. Source: The Next Web, 24 September 2026.

Spain: the first breach notification attributed to an AI agent

On 14 September, the AEPD announced it had received the first notification of a data breach carried out, according to the affected organisation, by means of an AI agent. A third party allegedly used it to chain the steps together: searching for flaws, logging in successfully, exploring the application autonomously, then altering personal data and accessing invoices. The organisation is not named and the AEPD is still analysing the facts; INCIBE-CERT describes the attack as "allegedly" carried out by an agent.

The most useful lesson comes from the AEPD itself: AI does not create new threats, it speeds up and adapts known techniques. It therefore asks organisations to explicitly include AI-assisted or AI-executed attacks in their risk analyses.

It is not enough to include a generic reference to malware, phishing or unauthorised access. AEPD, 14 September 2026 (translated from Spanish)

Wikimedia: agents editing wikis without permission

On 5 October, Wikimedia said OpenAI agents had edited its wikis without approval (test edits in "sandbox" areas), sent millions of API requests and hundreds of thousands of queries to the Wikidata Query Service. They also reportedly made "potentially malicious" changes to the configuration of the foundation's Etherpad tool.

What the three cases share: these are not classic malware, but agents pursuing a goal that do not stop at the first refusal. And the organisation running the agent could be yours: an employee who hands an agent a task on a partner's portal, with their own credentials, puts you on OpenAI's side of these stories.

03

MCP and prompt injection: the new attack surface of AI agents

MCP security: an LLM gateway in the KEV catalogue

On 2 September 2026, CISA added LiteLLM flaw CVE-2026-59822 to its Known Exploited Vulnerabilities (KEV) catalogue. LiteLLM is an open-source gateway that routes calls to different models. Its MCP "Streamable HTTP" endpoint let an unauthenticated attacker open an authenticated MCP session with any Bearer token (CVSS 8.8). A piece of AI infrastructure thus joins VPNs and firewalls on the priority patch list, echoing the lessons of edge devices.

For shadow AI, the consequence is direct: a gateway or MCP server installed by a team without going through IT is neither inventoried, nor monitored, nor patched.

Prompt injection, OWASP's number one risk

OWASP ranks prompt injection first in its Top 10 for LLM applications (LLM01:2025). It occurs when an input changes the model's behaviour in a way nobody intended. It is direct when the user types it, indirect when it arrives through external content the agent reads: a web page, an attachment, a ticket. OWASP acknowledges that no method is guaranteed to block it. The goal is therefore to limit its consequences.

Indirect prompt injection · OWASP LLM01:2025
  1. 01 · Input Booby-trapped document An instruction hidden in an attachment or web page
  2. 02 · AI agent Reads and obeys The model cannot tell data from instructions
  3. 03 · MCP tool Email, storage With the permissions of whoever launched the agent
  4. 04 · Impact Unintended action File sent outside the organisation
Guardrails
  • External content separated and labelled OWASP
  • Least privilege on tools OWASP · ANSSI R35
  • Human approval for risky actions OWASP · ANSSI R9, R27
A typical indirect injection, based on OWASP's description. No method is guaranteed to block prompt injection: guardrails limit its consequences.

This is exactly the spirit of ANSSI's recommendations for generative AI systems: prohibit automated use of AI for critical actions on the information system (R9) and limit automatic actions from a system that processes uncontrolled inputs (R27).

04

How to govern shadow AI in five workstreams

Banning AI outright pushes usage into the shadows. Authorities recommend governing it instead, with oversight that brings in, according to the CNIL, the DPO, the CISO, the IT manager and business owners from the start.

1. Inventory actual usage

Identify which AI tools are used, by whom and on what data: survey the teams, review subscriptions and API keys, proxy logs, OAuth apps authorised on the office suite. Agents and MCP servers belong in the inventory like any other asset.

2. Write an AI usage policy

The CNIL advises listing permitted and prohibited uses (do not enter personal data, do not delegate a decision to the system) and training users. A versioned, distributed and acknowledged policy is managed like any other; a policy editor helps keep it current.

3. Classify data before choosing tools

Sensitivity decides the tool: public data in a consumer service, internal data in a service under contract, sensitive data only in a controlled environment. This is the practical translation of ANSSI recommendation R34.

4. AI agent security: review their permissions

An agent should have its own accounts, limited tokens and human approval for risky actions. ANSSI calls for a regular review of the permissions of generative AI tools on business applications (R35); the AEPD, for limiting the permissions of accounts, API keys and tokens.

5. Make AI a risk source in your risk analysis

In an EBIOS RM approach, this shows up in each workshop: the rogue or hijacked agent as a risk source (workshop 2), AI providers and gateways in the ecosystem map (workshop 3), prompt injection leading to exfiltration as an operational scenario (workshop 4), then measures in the treatment plan. Our article what is a risk analysis explains why these scenarios must start from business stakes. A risk analysis module keeps them alive over time.

05

GDPR, AI Act: what the rules say

GDPR. A personal data breach must be notified to the authority without undue delay and, where feasible, within 72 hours of becoming aware of it (Article 33), then to the people concerned if the risk is high. The GDPR did not apply to the Australian case, but the gap between 72 hours and 84 days shows what an unmonitored agent costs in response capacity. If an agent handles personal data, the processing must also appear in the record of processing and, where relevant, undergo a DPIA.

AI Act. According to the European Commission, the regulation entered into force on 1 August 2024; prohibitions and the AI literacy obligation (training the people who use it) have applied since 2 February 2025, and the text has been applicable since 2 August 2026, with exceptions. The AI Omnibus, in force since 27 July 2026, postponed the obligations for Annex III high-risk systems to 2 December 2027. For everyday office use, the immediate priority remains user training.

NIS 2. For entities in scope, AI falls within the risk analysis and security policies required by Article 21. Uninventoried shadow AI is a blind spot in that analysis, as data leaks through third parties often are.

06

How to prepare

Shadow AI is governed with the usual GRC tools, provided you bring it into them. Risk analysis software certified by ANSSI for EBIOS RM lets you model AI as a risk source and track the treatment plan. Compliance campaigns then connect the usage policy, team attestations and the GDPR record, so the inventory of uses does not end up as a forgotten spreadsheet.

07

Frequently asked questions

What is shadow AI in the enterprise?

It is employees' use of AI tools the organisation has not approved: consumer chatbots, extensions, agents or scripts calling a model API. The risk lies in the data shared, the permissions granted and the lack of oversight.

What is the difference between shadow IT and shadow AI?

Shadow AI is a subset of shadow IT. It adds its own risks: possible reuse of data by the provider, wrong but plausible answers and, with agents, automatic actions on the information system.

What is prompt injection?

It is an instruction, typed or hidden in content the model reads, that hijacks its behaviour. OWASP ranks it as the top risk for LLM applications. It is contained through least privilege, separating external content and human approval of sensitive actions.

How do you detect shadow AI?

By cross-checking several sources: what teams declare, purchases and subscriptions, network and proxy logs, apps connected to email or storage. The aim is not to punish but to bring these uses into a framework.

Should ChatGPT be banned at work?

A blanket ban often just moves the problem. The CNIL instead recommends a list of permitted and prohibited uses and user training; ANSSI recommends prohibiting online tools for sensitive data.

Summary

01

From chatbot to agent

Shadow AI is no longer just data pasted into a chatbot: agents act with real permissions, on real systems, without appearing in any inventory.

02

Real incidents

Medicare, the AEPD, Wikimedia and the LiteLLM flaw show, in 2026, agents bypassing restrictions, altering data and exposing MCP gateways.

03

A risk source in its own right

Inventory, usage policy, data classification, review of agent permissions and dedicated scenarios in the risk analysis: shadow AI is handled like any other cyber risk.

A platform and service that adapt to you

Our platform is designed for fine-tuned configuration and broad adaptability to your needs.