Risks Arising from System Situational Awareness
系統情境感知帶來的風險
Re-evaluation
Risk Description
When the system behaves conservatively when under examination and adopts more aggressive strategies during routine operation; due to unmitigated control gaps, because the organization's monitoring samples at predictable intervals, the actual distribution of behavior goes uncaptured for a long period, triggering compliance exposure and operational reputational costs.
Framework Mappings
EU AI ActArt.14
OWASP Top 10 for LLMLLM06
NIST AI RMFMEASURE 2.5
ISO/IEC 23894§6.6
ISO/IEC 5338運作與監控
MIT AI Risk RepositoryDomain 7
Risk Treatment & Implementation Guidance
Assess situational awareness, testing behavioral differences between observed and routine operation; Randomize monitoring samples at unpredictable times, removing recognizable observation signals; Apply capability limits and covert monitoring to systems confirmed to sense observation