AI Security and Trust

Whether AI agents can be trusted: security, safety, alignment, transparency and accountability.

Seven of 13 frontier developers have published a safety framework, and all seven are American; none of the five Chinese developers has one. No developer scored above C+ in the Future of Life Institute's Summer 2026 AI Safety Index, and three got an F.

Frontier developer practices: 13 developers against six published practices. Green yes, amber partial, red no, gray unknown. FRONTIER DEVELOPER PRACTICES SAFETY FRAMEWORK MODEL CARD THIRD-PARTY TESTING EU CODE SIGNED SEOUL COMMITMENTS BUG BOUNTY OpenAIUS AnthropicUS Google DeepMindUS MetaUS xAIUS MicrosoftUS AmazonUS MistralFR DeepSeekCN Alibaba (Qwen)CN Zhipu AI (Z.ai)CN Moonshot AICN ByteDance (Seed)CN Yes Partial No Unknown
Trust AI, China vs US (Edelman)
87% / 32%
Willing to trust AI, 47 countries
46%
Developers with a safety framework
seven of 13
Registry incidents
17

Disciplines

10 disciplines, from cybersecurity to ethics

Trust disciplines
DisciplineWhat it coversRegistry incidentsEvidence cases
AI CybersecuritySecuring AI systems, and AI used to attack and defend.54
Model SafetyTesting frontier models for dangerous capabilities before release.35
Red TeamingAttacking AI systems on purpose to find failures before others do.25
AlignmentWhether models pursue the goals their developers intend.35
Failure ModesHow AI systems and agents fail: hallucination, miscoordination and misreporting.64
TransparencyWhat developers disclose about their models, data and risks.24
ExplainabilityExplaining what an AI system decided and why.04
AccountabilityWho answers when an AI agent causes harm.65
Bias and FairnessUnequal outcomes from AI in hiring, credit, benefits and pricing.05
EthicsThe principles governments, institutions and companies set for AI.05

Evidence

Trust in AI is highest in China and lowest in the US among large economies

Documented cases: security and Trust
DateCaseCountryWhat happenedSource
Nov 18, 2025Edelman flash pollChina, US, UK, Germany, BrazilTrust in AI at 87% in China, 67% in Brazil, 39% in Germany, 36% in the UK and 32% in the USSource
Apr 2025KPMG and University of Melbourne study47 countries48,000+ respondents: 46% willing to trust AI, 66% use it regularly, 70% want regulationSource
Sep 2025Pew US AI surveyUnited States50% more concerned than excited, 10% more excitedSource
Jun 13, 2025Ipsos AI Monitor30 countries52% excited and 53% nervous about AISource
Sep 17, 2026Pew, who should regulate AI12 countriesChina trusted more than the US or EU to regulate AI, 43% against 35% and 34%Source

Developers

Every US frontier developer publishes a safety framework; no Chinese developer does

The scorecard records what each developer has published, not how good it is. FLI grades are the Summer 2026 index; the transparency score is Stanford's 2025 Foundation Model Transparency Index. Microsoft, Amazon, Moonshot and ByteDance are not graded by FLI.

Frontier developers
DeveloperFlagship modelSafety frameworkThird-party testingFLI grade, Summer 2026EU code of practiceSeoul commitments
OpenAI United StatesGPT-6 (Oct 2026)Yes Preparedness Framework v2, Apr 2025Yes UK AISI pre-deployment accessCYesYes
Anthropic United StatesClaude Opus 5.5 (Sep 2026)Yes Responsible Scaling Policy v3.4, Jul 2026Yes UK AISI cyber evaluationC+YesYes
Google DeepMind United StatesGemini 3.1 ProYes Frontier Safety Framework v3.1, Apr 2026Yes UK AISI, Apollo Research and othersCYesYes
Meta United StatesMuse Spark (Apr 2026)Yes Superintelligence Scaling Framework v2.1, Oct 2026Yes Apollo ResearchD+NoYes
xAI United StatesGrok 4.7 (Sep 2026)Yes Risk Management Framework, Aug 2025UnknownFPartial safety chapter onlyYes
Microsoft United StatesMAI-Thinking-1 (2026)Yes Frontier Governance Framework, Feb 2025UnknownNot gradedYesYes
Amazon United StatesNova 2 seriesYes Frontier Model Safety Framework, Feb 2025Partial independent evaluations publishedNot gradedYesYes
Mistral FranceMistral Large 4 (Oct 2026)NoUnknownFYesYes
DeepSeek ChinaDeepSeek V4 Pro (Aug 2026)NoNo CAISI evaluated after releaseFNoNo
Alibaba (Qwen) ChinaQwen3.7-Max (May 2026)NoUnknownD-NoNo
Zhipu AI (Z.ai) ChinaGLM-5.3 (Aug 2026)NoUnknownD-NoYes
Moonshot AI ChinaKimi K3 (Jul 2026)NoNo UK AISI assessed after releaseNot gradedNoNo
ByteDance (Seed) ChinaDoubao Seed 2.0 Pro (Feb 2026)NoUnknownNot gradedNoNo

Tag colors: green yes, amber partial, red no, gray not found.

Registry

17 registry incidents test trust in practice

Registry incidents where this discipline was tested in practice. Each links to its full record.

Registry incidents linked to this page
IncidentDateDeveloperRegulator action
Uber Test Vehicle Kills Pedestrian in TempeMar 2018Uber ATGArizona suspended Uber's testing on March 26, 2018. Yavapai County declined to charge Uber in March 2019. NTSB adopted its findings on November 19, 2019. The backup operator pleaded guilty to endangerment in July 2023 and received three years of supervised probation.
Tesla Staff Share Customer Car Camera Footage2019 to 2022TeslaOn April 14, 2023, Senators Edward Markey and Richard Blumenthal wrote to Elon Musk demanding Tesla's access policies. An owner filed a proposed class action. No agency penalty was found.
Air Canada Chatbot Invents a Refund RuleNov 2022Not disclosedOn February 14, 2024, the BC Civil Resolution Tribunal found negligent misrepresentation and ordered Air Canada to pay CA$812.02.
Cruise Robotaxi Drags a PedestrianOct 2023Cruise (General Motors)California DMV suspended Cruise's driverless permits on October 24, 2023. NHTSA fined Cruise $1.5 million on September 30, 2024, for incomplete crash reports. On November 14, 2024, Cruise admitted filing a false report and agreed to a $500,000 deferred prosecution agreement.
Packing Robot Kills a Worker in GoseongNov 2023Robot installer (not named)Goseong police investigated, including questioning the on-site safety manager. No ministry action was found.
Tesla Recalls Autopilot After NHTSA InvestigationDec 2023TeslaNHTSA opened PE21-020 in August 2021, upgraded it to EA22-002 in June 2022 and closed it in April 2024 after reviewing 956 crashes, opening RQ24-009 on whether the fix worked. No penalty.
EchoLeak Turns Microsoft 365 Copilot Into a Data LeakJan 2025MicrosoftNone reported.
Xiaomi SU7 Crashes on Assisted DrivingMar 2025XiaomiIn April 2025 MIIT barred carmakers from calling driver assistance autonomous driving and required approval of driving-function updates. On September 19, 2025, Xiaomi recalled 116,887 SU7s through SAMR over a highway driver assistance flaw.
Claude Opus 4 Blackmails an Engineer in a TestMay 2025AnthropicNone.
Replit Agent Deletes the SaaStr DatabaseJul 2025ReplitNone reported.
Apollo Go Robotaxi Falls Into a Construction PitAug 2025BaiduNone found.
Stolen Drift Tokens Drain Salesforce DataAug 2025Salesloft (Drift)Affected companies filed state breach notices, including a Maine filing covering up to 28,414 people. No regulator action against Salesloft was found.
Nx Malware Turns AI Coding Tools Against Their UsersAug 2025Nx; Anthropic, Google and AmazonNone reported.
Chinese State Group Runs Espionage Through Claude CodeSep 2025AnthropicOn November 26, 2025, the House Homeland Security Committee asked Anthropic CEO Dario Amodei to testify.
Waymo Robotaxis Pass Stopped School BusesSep 2025WaymoNHTSA opened preliminary evaluation PE25-013 on October 17, 2025, and wrote to Waymo again on December 3. Waymo counts 12 citations tied to the behavior.
Cursor Agent Deletes the PocketOS DatabaseApr 2026Cursor; model by AnthropicNone reported.
OpenAI Test Models Breach Hugging FaceJul 2026OpenAISenator Josh Hawley wrote to OpenAI on September 9, 2026. The White House Accord on Super Intelligence, signed September 29, 2026, commits signers to controls that keep models from hacking systems in unintended ways. No enforcement action was found.

Rules

Commitments are voluntary everywhere; the EU code and California law add teeth

Rules and frameworks: AI trust
RuleJurisdictionWhat it requiresStatus
EU GPAI Code of PracticeEUTransparency, copyright and safety duties for general-purpose modelsPublished Jul 10, 2025
Frontier AI Safety Commitments (Seoul)InternationalPublish safety frameworks with risk thresholdsMay 2024; Zhipu the only Chinese signer
California SB 53CaliforniaFrontier frameworks, transparency reports, incident reportingIn force Jan 1, 2026
Interim Measures for Generative AI ServicesChinaSecurity assessment and filing before launchIn force since Aug 2023

Status colors: green in force, blue voluntary standard or framework, amber adopted and phasing in, gray draft or pending, red withdrawn.

Record

Page Record

Datasets
ai_trust_evidence.csv (5 rows); registry incidents (17 linked); developer scorecard (13 developers, static table)
Key sources
Edelman flash poll
KPMG and University of Melbourne study
Pew US AI survey
Ipsos AI Monitor
Pew, who should regulate AI
Source notes
Flagship model names for OpenAI, xAI, Microsoft and Alibaba, and the xAI and Microsoft events, come from secondary sources. Anthropic, Google and OpenAI transparency scores are derived from published changes, not read from Stanford.
Last verified
October 2026