S0027RS4-T16-S0027-Z · Full risk code

Insufficient Representation in Training Data

訓練資料代表性不足

Design & Development
Risk Description

When an AI system performs excellently in overall testing, but after deployment its accuracy for a specific group proves markedly lower; due to unmitigated control gaps, investigation reveals that group made up a very small share of the training data, so the model never learned its distinguishing characteristics, leaving that population exposed to a higher risk of misjudgment, triggering compliance exposure and operational reputational costs.

Framework Mappings

EU AI ActArt.10
NIST AI 600-1Harmful Bias and Homogenization
NIST AI RMFMEASURE 2.11
ISO/IEC TR 24027
ISO/IEC 5338設計與開發
MIT AI Risk RepositoryDomain 1

Risk Treatment & Implementation Guidance

Assess group representativeness during data preparation, flagging under-represented groups; Actively augment minority-group data or rebalance with weighting; Evaluate per group in validation so aggregate metrics do not mask disparities