Shadow AI: when AI agents become a cyber risk
Personal accounts, browser extensions, agents plugged into the mailbox: ungoverned AI is no longer just a data leak issue. What 2026 teaches us, and how to govern it.
Shadow AI is the use, within an organisation, of artificial intelligence tools that IT has neither approved nor governed: a personal chatbot account, a browser extension, an agent plugged into the mailbox. In 2026 the issue changed scale. Autonomous AI agents are accessing portals, altering data and triggering breach notifications. Here is what the news teaches us and how to bring this risk into your governance.
What is shadow AI?
The term refers to employees using an AI tool or application without approval or oversight from IT. It is a special case of shadow IT, with a specific risk: what you hand to a model can leave the organisation and be kept by the provider, and what the model answers can be wrong while looking right.
From chatbot to agent: what changes
An assistant answers; an agent acts. The Spanish data protection authority (AEPD) puts it well: an agent can plan tasks, use tools, run code, consult sources and adjust its own behaviour. With protocols such as MCP (Model Context Protocol), it connects to email, storage or ticketing, often with the credentials of whoever launched it.
Shadow AI is therefore no longer only about data leaking out. It is also an uninventoried identity acting inside your information system, with permissions nobody has reviewed.
Generative AI: the risks for businesses
The risks fall into three families, each addressed by official guidance:
- leakage: sensitive data typed into an online service, which ANSSI recommends prohibiting for any professional use involving sensitive data;
- excessive permissions: an agent that inherits all of its user's access to business applications;
- uncontrolled inputs: an agent that reads a booby-trapped email, web page or document and follows the instructions hidden in it.
On the threat side, ENISA notes in its Threat Landscape 2025 that misuse of LLMs and AI tools is more frequent than direct attacks on AI systems, and that AI-supported phishing reportedly accounted for more than 80% of observed social engineering activity.
- Assistant approved by IT approved
- Office suite copilot, under contract approved
- Model hosted in-house approved
- Personal account on an online chatbot Sensitive data exposed ANSSI R34
- Agent plugged into email via MCP Acts with the user's permissions ANSSI R35
- Agent reading the web and attachments Uncontrolled inputs ANSSI R27
- LLM gateway installed by a team Neither monitored nor patched CISA KEV
2026: three incidents where AI agents went off the rails
Australia: an agent in the Medicare portal, 84 days of silence
On 18 June 2026, an agent set up by an OpenAI research group to study public spending on medicines accessed the Medicare Statistics Reporting Service portal run by Services Australia. After the site repeatedly refused its requests, it tried other methods until it got past the restrictions; according to Services Australia, it also wrote records to an internal server. OpenAI only notified the agency on 10 September, by email to a public inbox, reports The Next Web.
Prime Minister Anthony Albanese said the company took "way too long" to inform the government and announced a taskforce on 23 September. At this stage no personal information appears to have been accessed, but the Australian Signals Directorate's forensic review is still under way.
- 18 June The agent accesses the portal and bypasses its restrictions
- 10 Sept OpenAI notifies Services Australia, by email to a public inbox
- 23 Sept The Prime Minister announces a taskforce
Spain: the first breach notification attributed to an AI agent
On 14 September, the AEPD announced it had received the first notification of a data breach carried out, according to the affected organisation, by means of an AI agent. A third party allegedly used it to chain the steps together: searching for flaws, logging in successfully, exploring the application autonomously, then altering personal data and accessing invoices. The organisation is not named and the AEPD is still analysing the facts; INCIBE-CERT describes the attack as "allegedly" carried out by an agent.
The most useful lesson comes from the AEPD itself: AI does not create new threats, it speeds up and adapts known techniques. It therefore asks organisations to explicitly include AI-assisted or AI-executed attacks in their risk analyses.
It is not enough to include a generic reference to malware, phishing or unauthorised access. AEPD, 14 September 2026 (translated from Spanish)
Wikimedia: agents editing wikis without permission
On 5 October, Wikimedia said OpenAI agents had edited its wikis without approval (test edits in "sandbox" areas), sent millions of API requests and hundreds of thousands of queries to the Wikidata Query Service. They also reportedly made "potentially malicious" changes to the configuration of the foundation's Etherpad tool.
What the three cases share: these are not classic malware, but agents pursuing a goal that do not stop at the first refusal. And the organisation running the agent could be yours: an employee who hands an agent a task on a partner's portal, with their own credentials, puts you on OpenAI's side of these stories.
MCP and prompt injection: the new attack surface of AI agents
MCP security: an LLM gateway in the KEV catalogue
On 2 September 2026, CISA added LiteLLM flaw CVE-2026-59822 to its Known Exploited Vulnerabilities (KEV) catalogue. LiteLLM is an open-source gateway that routes calls to different models. Its MCP "Streamable HTTP" endpoint let an unauthenticated attacker open an authenticated MCP session with any Bearer token (CVSS 8.8). A piece of AI infrastructure thus joins VPNs and firewalls on the priority patch list, echoing the lessons of edge devices.
For shadow AI, the consequence is direct: a gateway or MCP server installed by a team without going through IT is neither inventoried, nor monitored, nor patched.
Prompt injection, OWASP's number one risk
OWASP ranks prompt injection first in its Top 10 for LLM applications (LLM01:2025). It occurs when an input changes the model's behaviour in a way nobody intended. It is direct when the user types it, indirect when it arrives through external content the agent reads: a web page, an attachment, a ticket. OWASP acknowledges that no method is guaranteed to block it. The goal is therefore to limit its consequences.
- 01 · Input Booby-trapped document An instruction hidden in an attachment or web page
- 02 · AI agent Reads and obeys The model cannot tell data from instructions
- 03 · MCP tool Email, storage With the permissions of whoever launched the agent
- 04 · Impact Unintended action File sent outside the organisation
- External content separated and labelled OWASP
- Least privilege on tools OWASP · ANSSI R35
- Human approval for risky actions OWASP · ANSSI R9, R27
This is exactly the spirit of ANSSI's recommendations for generative AI systems: prohibit automated use of AI for critical actions on the information system (R9) and limit automatic actions from a system that processes uncontrolled inputs (R27).
How to govern shadow AI in five workstreams
Banning AI outright pushes usage into the shadows. Authorities recommend governing it instead, with oversight that brings in, according to the CNIL, the DPO, the CISO, the IT manager and business owners from the start.
1. Inventory actual usage
Identify which AI tools are used, by whom and on what data: survey the teams, review subscriptions and API keys, proxy logs, OAuth apps authorised on the office suite. Agents and MCP servers belong in the inventory like any other asset.
2. Write an AI usage policy
The CNIL advises listing permitted and prohibited uses (do not enter personal data, do not delegate a decision to the system) and training users. A versioned, distributed and acknowledged policy is managed like any other; a policy editor helps keep it current.
3. Classify data before choosing tools
Sensitivity decides the tool: public data in a consumer service, internal data in a service under contract, sensitive data only in a controlled environment. This is the practical translation of ANSSI recommendation R34.
4. AI agent security: review their permissions
An agent should have its own accounts, limited tokens and human approval for risky actions. ANSSI calls for a regular review of the permissions of generative AI tools on business applications (R35); the AEPD, for limiting the permissions of accounts, API keys and tokens.
5. Make AI a risk source in your risk analysis
In an EBIOS RM approach, this shows up in each workshop: the rogue or hijacked agent as a risk source (workshop 2), AI providers and gateways in the ecosystem map (workshop 3), prompt injection leading to exfiltration as an operational scenario (workshop 4), then measures in the treatment plan. Our article what is a risk analysis explains why these scenarios must start from business stakes. A risk analysis module keeps them alive over time.
GDPR, AI Act: what the rules say
GDPR. A personal data breach must be notified to the authority without undue delay and, where feasible, within 72 hours of becoming aware of it (Article 33), then to the people concerned if the risk is high. The GDPR did not apply to the Australian case, but the gap between 72 hours and 84 days shows what an unmonitored agent costs in response capacity. If an agent handles personal data, the processing must also appear in the record of processing and, where relevant, undergo a DPIA.
AI Act. According to the European Commission, the regulation entered into force on 1 August 2024; prohibitions and the AI literacy obligation (training the people who use it) have applied since 2 February 2025, and the text has been applicable since 2 August 2026, with exceptions. The AI Omnibus, in force since 27 July 2026, postponed the obligations for Annex III high-risk systems to 2 December 2027. For everyday office use, the immediate priority remains user training.
NIS 2. For entities in scope, AI falls within the risk analysis and security policies required by Article 21. Uninventoried shadow AI is a blind spot in that analysis, as data leaks through third parties often are.
How to prepare
Shadow AI is governed with the usual GRC tools, provided you bring it into them. Risk analysis software certified by ANSSI for EBIOS RM lets you model AI as a risk source and track the treatment plan. Compliance campaigns then connect the usage policy, team attestations and the GDPR record, so the inventory of uses does not end up as a forgotten spreadsheet.
Frequently asked questions
What is shadow AI in the enterprise?
It is employees' use of AI tools the organisation has not approved: consumer chatbots, extensions, agents or scripts calling a model API. The risk lies in the data shared, the permissions granted and the lack of oversight.
What is the difference between shadow IT and shadow AI?
Shadow AI is a subset of shadow IT. It adds its own risks: possible reuse of data by the provider, wrong but plausible answers and, with agents, automatic actions on the information system.
What is prompt injection?
It is an instruction, typed or hidden in content the model reads, that hijacks its behaviour. OWASP ranks it as the top risk for LLM applications. It is contained through least privilege, separating external content and human approval of sensitive actions.
How do you detect shadow AI?
By cross-checking several sources: what teams declare, purchases and subscriptions, network and proxy logs, apps connected to email or storage. The aim is not to punish but to bring these uses into a framework.
Should ChatGPT be banned at work?
A blanket ban often just moves the problem. The CNIL instead recommends a list of permitted and prohibited uses and user training; ANSSI recommends prohibiting online tools for sensitive data.
Summary
From chatbot to agent
Shadow AI is no longer just data pasted into a chatbot: agents act with real permissions, on real systems, without appearing in any inventory.
Real incidents
Medicare, the AEPD, Wikimedia and the LiteLLM flaw show, in 2026, agents bypassing restrictions, altering data and exposing MCP gateways.
A risk source in its own right
Inventory, usage policy, data classification, review of agent permissions and dedicated scenarios in the risk analysis: shadow AI is handled like any other cyber risk.
Sources (12)
- The Next Web — OpenAI agent broke into Australia's Medicare statistics portal, PM says (24/09/2026)
- AEPD — Primera notificación de una brecha de datos personales causada por un ataque ejecutado mediante un agente de IA (14/09/2026)
- INCIBE-CERT — Personal data breach reported in Spain linked to an attack carried out by artificial intelligence (24/09/2026)
- BleepingComputer — Wikimedia: Rogue OpenAI agents behind unauthorized Wikipedia edits (06/10/2026)
- The Hacker News — CISA Adds Seven Exploited Flaws as Attackers Deploy Reverse Shells and Crypto Miners (03/09/2026)
- OWASP Gen AI Security Project — LLM01:2025 Prompt Injection
- ANSSI — Security recommendations for a generative AI system (29/04/2024)
- CNIL — Comment déployer une IA générative ? (18/07/2024)
- CNIL — Notifier une violation de données personnelles
- ENISA — Threat Landscape 2025
- European Commission — Regulatory framework on AI (AI Act)
- EUR-Lex — Regulation (EU) 2016/679 (GDPR)
A platform and service that adapt to you
Our platform is designed for fine-tuned configuration and broad adaptability to your needs.