Gradient Poisoning in Distributed Training
分散式訓練梯度污染
Design & Development
Risk Description
When one node in an organization's training cluster is compromised and continuously injects skewed gradients; due to unmitigated control gaps, the resulting model behaves anomalously in certain contexts, triggering external stakeholder impacts and causing the organization spends considerable time investigating data and code before discovering the problem lies in the training infrastructure itself.
Framework Mappings
OWASP Top 10 for LLMLLM04
MITRE ATLASAML.T0020
NIST AI 100-2Poisoning
ISO/IEC 5338設計與開發
MIT AI Risk RepositoryDomain 2
Risk Treatment & Implementation Guidance
Use Byzantine-fault-tolerant aggregation in distributed training so a single polluted node cannot steer the gradient; Deploy gradient-anomaly detection monitoring the statistical signature of each node's contribution; Protect training infrastructure with node-level security and intrusion detection