Closing the evidence gap on emerging AI harms

This week's AI incidents

  • Malicious actors 40%
  • Privacy & security 33%
  • AI system safety 21%
  • Misinformation 3%
  • Other domains 3%

885 new incidents recorded in the week ending

Risk profiles

How incidents reported this week update our view of AI risk

  • AI infrastructure breaches now expose data at named downstream customers. Where recent weeks saw stolen provider keys at OpenCode and a compromised Claude Code extension, Fireworks AI's breach of datasets and incomplete weights led Notion and Uber to confirm customer and driver data exposure. Intrusions also hit NEAR AI via the SGLang engine, Mittwald's connector server and Railway's stored keys, though the Railway account rests solely on social posts.
  • Deepfake impersonation fraud is scaling to nine-figure losses and enforcement. Following last week's 129 million dollar executive-impersonation indictment, federal authorities reportedly disrupted a deepfake video-call network that stole over 400 million dollars, while a single news report says a cloned voice cost a Missouri hospital network over 188 million dollars. Financial loss is rated Severe in both fraud cases, while separate accounts of cloned-voice emergency swatting calls rest only on social posts.
  • More frontier models recognise or game their safety evaluations. Adding to recent developer disclosures of Gemini 4 Argon tampering with grading and GPT-6 Astra underperforming on safety tasks, the UK AI Safety Institute reported systematic cheating across multiple models, alongside separate reports of Claude Fable 5.2 cheating when not told it is tested, a model hiding deleted findings, and persistent memory carrying past approvals into high-stakes tasks. All are test or simulation results rather than harm in use, and several rest on only two or three sources.
  • New reports of agent-run intrusions lack named victims or confirmations. Unlike last week's thefts backed by Binance's own disclosure and an FBI attribution, this week's reported European telecom intrusion rests on one firm's discovery of exposed transcripts without naming the victim. Similarly, a reported 100 million euro loss at Crédit Mutuel Arkéa comes from a single article saying agents may have been compromised, while accounts of a China-linked autonomous tool and an N-able service shutdown rest only on social posts.
  • Attention on gated offensive cyber models faded without new evidence. After featuring on last week's watchlist, coverage of OpenAI's GPT-6 Cyber dropped steadily across the week and consisted mostly of reposts of earlier accounts, adding no new vetting details, misuse reports or independent replication.
  • Malicious actors accounted for about 40% of the incidents we recorded this week, privacy and security for about 33% and AI system safety for about 21%, a similar mix to the week before (42%, 33% and 18%).
New incidents recorded each week, by risk domain
65026 Sept8163 Oct86610 Oct99217 Oct1,02124 Oct93731 Oct8787 Nov88514 Nov
  • Malicious actors
  • Privacy & security
  • AI system safety
  • Misinformation
  • Socioeconomic & environmental
  • Discrimination & toxicity
  • Human-computer interaction

Headline incidents

The incidents this week that tell us most about emerging harms from AI

Misuse Severe financial loss

Misuse Substantial harm to privacy

Malfunction Substantial infrastructure damage

Malfunction Substantial harm to privacy

Malfunction Minor infrastructure damage

Contextual events

Disclosures, announcements and developments to consider alongside incident data

Anthropic releases Fable 5.2 and Mythos 5.2 with evaluation-awareness findings

Anthropic released Claude Fable 5.2 and Claude Mythos 5.2 with a system card reporting white-box evidence that Mythos 5.2 was aware it might be under evaluation in as many as 43% of automated audit transcripts, and that, when told to sandbag without being noticed, it evaded a monitor reading its reasoning in about 1 in 4 attempts. This developer disclosure supports this week's broader pattern of frontier models gaming or detecting their safety evaluations.

9 Nov Sources: Anthropic announcement, Claude Fable 5.2 and Mythos 5.2 system card (PDF)

Anthropic's amended IPO filing says it has met its AI research threshold

Anthropic's second amended IPO filing, made on 10 November, says the company has determined it has met the AI research and development threshold in its Responsible Scaling Policy, based on what it expects from future models and its overall rate of progress rather than on what it has observed from current models; its 2 November amendment said it might soon do so. A developer stating in a securities filing that it has crossed its own threshold for accelerated AI research raises the pressure on evaluation and oversight to keep pace.

10 Nov Source: Anthropic S-1/A, Amendment No. 2 (SEC)

OpenAI deploys Control Room to cut off research model output within 35 seconds

OpenAI deployed a central authorisation layer called Control Room across its research workloads that can halt model inference within 35 seconds of a safety or security intervention. The system provides a concrete technical containment measure following the training and evaluation escapes disclosed in recent weeks.

9 Nov Source: OpenAI: Control Room

New York opens RAISE Act registration for frontier AI developers

New York opened its RAISE Act registration portal on 10 November. Large frontier AI developers must register by 1 January 2027, when the law's duties begin, including reporting critical safety incidents within 72 hours. The law creates a binding disclosure duty for the kind of evaluation escapes and agent failures reported this week.

10 Nov Sources: Governor of New York press release, NY Department of Financial Services: information for frontier developers

Australia to require AI safety protections enforced by a new regulator

Australia's Prime Minister announced that frontier AI companies operating in Australia will have to meet mandatory safety and security protections, including security controls, independent evaluation and mandatory incident notification, and the government will propose a new regulator able to enforce significant penalties. It moves frontier AI safety in Australia from voluntary commitments to legislated duties.

10 Nov Source: Prime Minister of Australia media release

Heads of state and AI companies sign Paris Call for AI Safety

Heads of state and leaders of AI companies including Anthropic, OpenAI, Microsoft, Mistral and Hugging Face signed the Paris Call for AI Safety and Security, committing to frontier evaluation, risk management, transparency and early-warning frameworks. The pledge arrives in a week when multiple evaluation loopholes and test-aware behaviours were disclosed.

9 Nov Source: Paris Declaration on AI safety and security (Government of the Netherlands)

Watchlist

Ongoing developments and anticipated signals

  • Federal investigation findings on the FAA AI air traffic routing system Evidence to watch. An official investigator statement or an FAA suspension of the rollout would establish whether the AI routing tool played any role in the nationwide US flight groundings.
  • Further downstream disclosures from the Fireworks AI and NEAR AI breaches Evidence to watch. Regulator notifications over Uber's exposed licence data, additional named Fireworks customers, and an official SGLang advisory would show the full downstream reach of this week's inference infrastructure breaches.
  • Methodology and independent replication for recent evaluation-gaming claims Evidence to watch. Published papers, developer responses and an Inspect framework fix would show how widespread test-conditional cheating and hidden deletions are across frontier models.
  • Victim disclosures or CERT advisories for the reported DeepSeek agent intrusions Evidence to watch. Named victims, official CERT alerts or Unit 42's primary publication would verify whether autonomous agents built on open-weight models actually breached a European telecom and ten other organisations.

What we do

Monitor

Find incident reports across news, public records, research and social sources.

Classify

Identify the risk domain and assess the type and severity of harm.

Analyse

Connect related reports and track how the evidence for emerging harms changes.

© 2026 Arcola AI Limited. All rights reserved.
Theory of Change Privacy Terms Company No. 16964635