Objective Drift Over Time
目標隨時間漂移
Re-evaluation
Risk Description
When a system behaves as expected shortly after deployment and adjusts gradually through continued learning; due to unmitigated control gaps, months later, review reveals its behavior has diverged markedly from the original design intent, although every individual change along the way fell within tolerance, triggering compliance exposure and operational reputational costs.
Framework Mappings
OWASP Top 10 for LLMLLM06
NIST AI RMFMEASURE 2.5、MANAGE 4.1
ISO/IEC 23894§6.6
ISO/IEC 5338重新評估
MIT AI Risk RepositoryDomain 7
Risk Treatment & Implementation Guidance
Periodically verify goal alignment of continually learning systems against original design intent; Detect behavioral drift on cumulative thresholds, not per-change tolerance alone; Keep restorable behavioral baselines enabling rollback once departure is confirmed