Functional Replication Attack
功能複製攻擊
Verification & Validation
Risk Description
When a competitor queries the organization's service extensively through legitimate paid channels, gathers sufficient data to train a functionally similar substitute, and releases it at a lower price; due to unmitigated control gaps, the organization cannot recover its model investment and has no way to prove replication, triggering compliance exposure and operational reputational costs.
Framework Mappings
OWASP Top 10 for LLMLLM10
MITRE ATLASAML.T0024
NIST AI 100-2Privacy—Model Extraction
ISO/IEC 5338驗證與確效
MIT AI Risk RepositoryDomain 6
Risk Treatment & Implementation Guidance
Detect query-behavior anomalies identifying broad, systematic collection patterns; Limit output richness—confidence scores and probability distributions—to reduce distillation efficiency; Prohibit training competing models on query results in terms of service, preserving legal recourse