S0037RS3-T08-S0037-Z · Full risk code

Backdoor Trigger Sample Implantation

後門觸發樣本植入

Design & Development
Risk Description

When a model passes all routine acceptance testing and goes live; due to unmitigated control gaps, an attacker operates the system using a pre-planted trigger pattern, causing it to produce a predetermined result on critical judgments, triggering external stakeholder impacts and causing the organization's testing process cannot cover such specific triggers, and the issue remains dormant for a long period.

Framework Mappings

OWASP Top 10 for LLMLLM04
MITRE ATLASAML.T0020
NIST AI 100-2Poisoning
ISO/IEC 5338設計與開發
MIT AI Risk RepositoryDomain 2

Risk Treatment & Implementation Guidance

Verify training-data integrity with anomalous-sample detection to identify implanted trigger patterns; Run backdoor scanning and trigger-search testing before launch beyond routine acceptance; Monitor runtime behavior on critical judgments for output patterns inconsistent with the normal distribution