Automated Generation of Harassment Content
自動化騷擾內容生成
Operation & Monitoring
Risk Description
When an attacker generates hundreds of distinct harassment messages based on a target's public information and distributes them across multiple platforms; due to unmitigated control gaps, because each message differs, platform duplicate-content detection fails entirely, and the victim must report each instance separately, triggering compliance exposure and operational reputational costs.
Framework Mappings
EU AI ActArt.5、Art.50
NIST AI 600-1Dangerous, Violent, or Hateful Content
NIST AI RMFMANAGE 2.4
ISO/IEC 5338運作與監控
MIT AI Risk RepositoryDomain 4
Risk Treatment & Implementation Guidance
Deploy automated-harassment detection keyed on behavior patterns—volume, cross-platform, single-target—rather than content duplication; Establish platform collaboration to share attacker signals; Rapidly act on confirmed harassment sources and preserve records