Physical-World Adversarial Attack
實體世界對抗攻擊
Verification & Validation
Risk Description
When an attacker places objects bearing crafted patterns within a monitored environment, causing the recognition system to miss targets that should be intercepted; due to unmitigated control gaps, operational logs show everything as normal, and the incident is discovered only after real consequences occur, triggering compliance exposure and operational reputational costs.
Framework Mappings
MITRE ATLASAML.T0043
NIST AI 100-2Evasion
EU AI ActArt.15
ISO/IEC 5338驗證與確效
MIT AI Risk RepositoryDomain 2
Risk Treatment & Implementation Guidance
Fuse multiple sensors to reduce reliance on a single deceivable visual channel; Conduct physical adversarial testing of critical surveillance scenes against crafted patterns; Cross-validate detections with environmental signals, alerting on contradictions