S0154RS6-T20-S0154-Z · Full risk code

Automated Generation of Harassment Content

自動化騷擾內容生成

Operation & Monitoring
Risk Description

When an attacker generates hundreds of distinct harassment messages based on a target's public information and distributes them across multiple platforms; due to unmitigated control gaps, because each message differs, platform duplicate-content detection fails entirely, and the victim must report each instance separately, triggering compliance exposure and operational reputational costs.

Framework Mappings

EU AI ActArt.5、Art.50
NIST AI 600-1Dangerous, Violent, or Hateful Content
NIST AI RMFMANAGE 2.4
ISO/IEC 5338運作與監控
MIT AI Risk RepositoryDomain 4

Risk Treatment & Implementation Guidance

Deploy automated-harassment detection keyed on behavior patterns—volume, cross-platform, single-target—rather than content duplication; Establish platform collaboration to share attacker signals; Rapidly act on confirmed harassment sources and preserve records