Poisoning of the Retrieval Knowledge Base
檢索知識庫遭投毒
Design & Development
Risk Description
When an organization's internal question-answering system permits automatic ingestion of documents from multiple sources without review; due to unmitigated control gaps, an attacker inserts a forged operating procedure document, and staff follow the system's answers to execute incorrect procedures, triggering external stakeholder impacts and causing the source is traced only after actual losses occur.
Framework Mappings
OWASP Top 10 for LLMLLM04、LLM08
MITRE ATLASAML.T0020
NIST AI 100-2Poisoning
ISO/IEC 5338設計與開發
MIT AI Risk RepositoryDomain 2
Risk Treatment & Implementation Guidance
Enforce access control and import review on the knowledge base, verifying multi-source documents before indexing; Validate document provenance, checking critical documents like operating procedures against authoritative versions; Attribute answers to source documents with verification links so staff can trace the basis