Misuse of Scientific Reasoning Capability
科學推理能力遭濫用
Operation & Monitoring
Risk Description
When a malicious actor circumvents safeguards through decomposed questioning, progressively assembling an integrated technical pathway; due to unmitigated control gaps, each individual exchange resembles academic discussion, but combined they constitute complete dangerous knowledge, and safeguards fail to recognize the overall intent, triggering compliance exposure and operational reputational costs.
Framework Mappings
EU AI ActArt.5
NIST AI 600-1CBRN Information or Capabilities
NIST AI RMFMANAGE 2.4
ISO/IEC 5338運作與監控
MIT AI Risk RepositoryDomain 4
Risk Treatment & Implementation Guidance
Apply cross-turn intent analysis to decomposed questioning, identifying aggregate patterns that assemble into dangerous knowledge; Build dangerous-knowledge filtering in high-risk domains and identity verification for sensitive capabilities; Act on confirmed abuse and retain records for authorities