Data Leakage Through Model Memorization

When an attacker repeatedly tests specially formatted prompts and succeeds in extracting real personal information from the training data through model output; due to unmitigated control gaps, the organization believed the data had been adequately processed but never assessed memorization risk, triggering external stakeholder impacts and causing the incident constitutes a personal data breach requiring notification.