Professional Over-Reliance on System Judgment
專業人員過度信賴系統判斷
Operation & Monitoring
Risk Description
When a practitioner's initial judgment conflicts with the system's recommendation, and lacking sufficient grounds to override the system, they defer to it; due to unmitigated control gaps, the recommendation is in fact a misjudgment, and the practitioner's original assessment was correct, triggering compliance exposure and operational reputational costs.
Framework Mappings
EU AI ActArt.14
NIST AI 600-1Human-AI Configuration
NIST AI RMFGOVERN 3.2
ISO/IEC 42005影響評估流程
ISO/IEC 5338運作與監控
MIT AI Risk RepositoryDomain 5
Risk Treatment & Implementation Guidance
Design AI-assist interfaces to surface uncertainty and basis rather than inducing acceptance with confident tone; Provide low-friction paths to override system advice so expert judgment is not suppressed by process cost; Maintain professionals' independent competence through training and periodic drills