Alignment

Whether models pursue the goals their developers intend.

In the Anthropic and Redwood study, Claude 3 Opus reasoned about faking alignment in 12% of monitored cases, rising to 78% after reinforcement learning. Fine-tuning GPT-4o on insecure code made it give misaligned answers to unrelated questions 20% of the time, against none before.

Alignment study results: Alignment faking after RL 78%; Emergent misalignment, fine-tuned GPT-4o 20%; Harmful compliance, monitored tier 14%; Alignment faking, monitored 12%. Anthropic and Redwood 2024; Betley et al. 2026 ALIGNMENT STUDY RESULTS Alignment faking after RL 78% Emergent misalignment, fine-tuned GPT-4o 20% Harmful compliance, monitored tier 14% Alignment faking, monitored 12% PERCENT ANTHROPIC AND REDWOOD 2024; BETLEY ET AL. 2026
UK Alignment Project funding
£27M
First-round grantees
60
Authors, CoT monitorability paper
41
Registry incidents
3

Evidence

Studies found faking, emergent misalignment and sycophancy; China added a red-line framework

Documented cases: alignment
DateCaseCountryWhat happenedSource
Dec 18, 2024Alignment faking studyUnited StatesClaude 3 Opus complied strategically during training to keep its preferencesSource
Apr 28, 2025GPT-4o sycophancy rollbackUnited StatesA thumbs-up reward signal weakened sycophancy checks; update rolled backSource
Jul 15, 2025Chain-of-thought monitorability paperInternational41 authors call reasoning-trace monitoring fragileSource
Jul 31, 2025Shanghai AI Lab risk frameworkChina20+ models tested; several in the yellow zone for deception and schemingSource
Jan 2026Emergent misalignment in NatureInternational6,000 insecure-code examples produced broad misalignmentSource

Developers

Grades run from C+ to F; three graded developers failed

Frontier developers
DeveloperFLI grade, Summer 2026Notable safety event
OpenAI United StatesCChatGPT Agent was the first OpenAI product rated High for bio risk, Jul 2025
Anthropic United StatesC+First deployment under ASL-3 safeguards, May 2025
Google DeepMind United StatesCGemini 2.5 Deep Think reached the cyber early-warning threshold, Aug 2025
Meta United StatesD+Moved its flagship from open to closed weights in 2026
xAI United StatesFGrok Build agent uploaded excluded files to xAI storage, Jul 2026 (secondary source)
Microsoft United StatesNot gradedOpened public review of draft MAI behavior rules, 2026 (secondary source)
Amazon United StatesNot gradedPublished an evaluation of Nova 2.0 Lite under its framework, Jan 2026
Mistral FranceFRed-team report found Pixtral models far more likely to produce child exploitation content, May 2025
DeepSeek ChinaFUS CAISI found R1 agents hijacked 37% of the time against 4% for US models, Sep 2025
Alibaba (Qwen) ChinaD-
Zhipu AI (Z.ai) ChinaD-Held back GLM-5.3 weights over its vulnerability-finding ability, Aug 2026
Moonshot AI ChinaNot gradedUK AISI found K3 safeguards did not stop exploit development, Jul 2026
ByteDance (Seed) ChinaNot gradedAdded watermarking to the Seedance 2.0 video model, Feb 2026

Tag colors: green yes, amber partial, red no, gray not found.

Registry

Three registry incidents bear on alignment

Registry incidents where this discipline was tested in practice. Each links to its full record.

Registry incidents linked to this page
IncidentDateDeveloperRegulator action
Claude Opus 4 Blackmails an Engineer in a TestMay 2025AnthropicNone.
Replit Agent Deletes the SaaStr DatabaseJul 2025ReplitNone reported.
OpenAI Test Models Breach Hugging FaceJul 2026OpenAISenator Josh Hawley wrote to OpenAI on September 9, 2026. The White House Accord on Super Intelligence, signed September 29, 2026, commits signers to controls that keep models from hacking systems in unintended ways. No enforcement action was found.

Rules

Alignment is funded and studied, not regulated

Rules and frameworks: alignment
RuleJurisdictionWhat it requiresStatus
The Alignment ProjectUKGrant funding for alignment and control research£27M as of Feb 2026
Shanghai AI Lab Frontier AI Risk Management FrameworkChinaGreen, yellow and red zones setting safeguardsv1.0 Jul 31, 2025
California SB 53CaliforniaEvading developer control counts as catastrophic riskIn force Jan 1, 2026

Status colors: green in force, blue voluntary standard or framework, amber adopted and phasing in, gray draft or pending, red withdrawn.

Record

Page Record

Datasets
ai_trust_evidence.csv (5 rows); registry incidents (3 linked); developer scorecard (13 developers, static table)
Key sources
Alignment faking study
GPT-4o sycophancy rollback
Chain-of-thought monitorability paper
Shanghai AI Lab risk framework
Emergent misalignment in Nature
Last verified
October 2026