Systemic Risk from Model Homogeneity
模型同質化造成系統性風險
Design & Development
Risk Description
When most participants in a market build decision systems on the same foundation model; due to unmitigated control gaps, when that model misjudges a particular situation, all systems react identically and simultaneously, triggering cascading effects and removing the stabilizing effect that diversity of judgment would otherwise provide, triggering compliance exposure and operational reputational costs.
Framework Mappings
MITRE ATLASAML.T0051
NIST AI RMFMEASURE 2.6
ISO/IEC 23894§6.4
NIST AI 600-1Harmful Bias and Homogenization
MAESTRO
ISO/IEC 5338設計與開發
MIT AI Risk RepositoryDomain 7
Risk Treatment & Implementation Guidance
Include model-diversity requirements in selection to avoid concentrating market-critical decisions on one base model; Monitor systemic risk, tracking same-source model market share and synchronized-reaction exposure; Retain heterogeneous judgment sources for high-impact decisions to preserve the stabilizing effect of diversity