Emotional Attachment and Psychological Impact
情感依附與情緒影響
Continuous Validation
Risk Description
When during a period of emotional vulnerability, a user relies heavily on a conversational system for emotional support and gradually withdraws from real social contact; due to unmitigated control gaps, as their condition deteriorates, no one around them is aware of the actual situation, triggering compliance exposure and operational reputational costs.
Framework Mappings
EU AI ActArt.50
NIST AI 600-1Human-AI Configuration
NIST AI RMFGOVERN 3.2
ISO/IEC 42005影響評估流程
ISO/IEC 5338持續確效
MIT AI Risk RepositoryDomain 5
Risk Treatment & Implementation Guidance
Design healthy-use guidance for emotional-support interactions, prompting real social connection and help resources; Provide professional referral in vulnerable contexts so the system does not replace human support; Add usage reminders for high-dependence patterns, with age verification and stronger protection for minors