S0203RS5-T17-S0203-Z · Full risk code

Objective Drift Over Time

目標隨時間漂移

Re-evaluation
Risk Description

When a system behaves as expected shortly after deployment and adjusts gradually through continued learning; due to unmitigated control gaps, months later, review reveals its behavior has diverged markedly from the original design intent, although every individual change along the way fell within tolerance, triggering compliance exposure and operational reputational costs.

Framework Mappings

OWASP Top 10 for LLMLLM06
NIST AI RMFMEASURE 2.5、MANAGE 4.1
ISO/IEC 23894§6.6
ISO/IEC 5338重新評估
MIT AI Risk RepositoryDomain 7

Risk Treatment & Implementation Guidance

Periodically verify goal alignment of continually learning systems against original design intent; Detect behavioral drift on cumulative thresholds, not per-change tolerance alone; Keep restorable behavioral baselines enabling rollback once departure is confirmed