Resource Waste from Inefficient Inference
推論效率低落造成資源浪費
Deployment
Risk Description
When for development convenience, an organization uses a single high-capability model for all tasks; due to unmitigated control gaps, review shows most requests require only basic capability, and the practice accumulates substantial unnecessary computing cost and energy consumption over time, triggering compliance exposure and operational reputational costs.
Framework Mappings
NIST AI 600-1Environmental Impacts
ISO/IEC 42005影響評估流程
ISO/IEC 5338部署
MIT AI Risk RepositoryDomain 6
Risk Treatment & Implementation Guidance
Establish model-selection guidance choosing appropriately sized models by task need rather than always using high-end models; Improve inference efficiency with quantization and distillation; Monitor inference resource use to identify request types that can be downsized