Generation of Non-Existent Factual Content
生成不存在的事實內容
Verification & Validation
Risk Description
When a professional uses a generative tool to help draft a document, which includes several fabricated citations and cases; due to unmitigated control gaps, after submission, the citations are found not to exist, triggering external stakeholder impacts and causing beyond invalidating the document, the incident casts doubt on the author's professional judgment.
Framework Mappings
NIST AI 600-1Confabulation
OWASP Top 10 for LLMLLM09
NIST AI RMFMEASURE 2.5
ISO/IEC 5338驗證與確效
MIT AI Risk RepositoryDomain 3
Risk Treatment & Implementation Guidance
Establish fact-checking for citations and cases in generated content, verifying source existence by retrieval; Route professionally used generated documents through human review, blocking submission of unverified citations; Label outputs with confidence and source status so users can distinguish inference from fact