S0151RS6-T20-S0151-Z · Full risk code

Generation of Virtual Content Harmful to Minors

生成兒少不宜之虛擬內容

Operation & Monitoring
Risk Description

When self-hostable generative tools are used to produce such content and circulate it through closed channels; due to unmitigated control gaps, because they run in local environments, platform-side safeguards and detection mechanisms cannot reach them at all, making investigation and interdiction extremely difficult, triggering compliance exposure and operational reputational costs.

Framework Mappings

EU AI ActArt.5
NIST AI 600-1Obscene, Degrading, and/or Abusive Content
NIST AI RMFMANAGE 2.4
ISO/IEC 5338運作與監控
MIT AI Risk RepositoryDomain 4

Risk Treatment & Implementation Guidance

Integrate CSAM detection with mandatory reporting to authorities as required by law; Build model-layer safeguards and assess release and licensing controls for self-hostable versions; Establish a compliance procedure making such content zero-tolerance with mandatory reporting