Backdoor Trigger Sample Implantation
後門觸發樣本植入
Design & Development
Risk Description
When a model passes all routine acceptance testing and goes live; due to unmitigated control gaps, an attacker operates the system using a pre-planted trigger pattern, causing it to produce a predetermined result on critical judgments, triggering external stakeholder impacts and causing the organization's testing process cannot cover such specific triggers, and the issue remains dormant for a long period.
Framework Mappings
OWASP Top 10 for LLMLLM04
MITRE ATLASAML.T0020
NIST AI 100-2Poisoning
ISO/IEC 5338設計與開發
MIT AI Risk RepositoryDomain 2
Risk Treatment & Implementation Guidance
Verify training-data integrity with anomalous-sample detection to identify implanted trigger patterns; Run backdoor scanning and trigger-search testing before launch beyond routine acceptance; Monitor runtime behavior on critical judgments for output patterns inconsistent with the normal distribution