Insufficient Representation in Training Data
訓練資料代表性不足
Design & Development
Risk Description
When an AI system performs excellently in overall testing, but after deployment its accuracy for a specific group proves markedly lower; due to unmitigated control gaps, investigation reveals that group made up a very small share of the training data, so the model never learned its distinguishing characteristics, leaving that population exposed to a higher risk of misjudgment, triggering compliance exposure and operational reputational costs.
Framework Mappings
EU AI ActArt.10
NIST AI 600-1Harmful Bias and Homogenization
NIST AI RMFMEASURE 2.11
ISO/IEC TR 24027
ISO/IEC 5338設計與開發
MIT AI Risk RepositoryDomain 1
Risk Treatment & Implementation Guidance
Assess group representativeness during data preparation, flagging under-represented groups; Actively augment minority-group data or rebalance with weighting; Evaluate per group in validation so aggregate metrics do not mask disparities