https://taxonomy.eticas.ai/risk/security-misuse
Maturity: established
The risk that an AI system is exposed to AI-specific vulnerabilities, attacks, or misuse that compromise its integrity, availability, or confidentiality. This covers risks beyond traditional IT security, including adversarial inputs, prompt injection, model extraction, jailbreaking, and supply-chain risks specific to AI components. It is intended to complement, not replace, standard IT security assessments.
Also known as: Safety, Security & Misuse · Security · Safety
System type: ADM and LLM systems
Lifecycle stages: Pre Processing, In Processing, Post Processing
| Framework | Reference |
|---|---|
| EU AI Act (Regulation 2024/1689) | Article 15(5) — resilience against attempts by unauthorized third parties to alter use, outputs or performance |
| AIUC-1 — AI Underwriting Company Standard | Security domain |
| Council of Europe Framework Convention on AI (CETS No. 225) | Article 12 – Reliability |
| NIST AI Risk Management Framework (AI 100-1) | Secure and Resilient |
| NIST AI 600-1 — Generative AI Risk Profile | Information Security |
| OECD AI Principles | 1.4 Robustness, security and safety |
| TC260 AI Safety Governance Framework (v2.0) | §3.1.1(e) External adversarial attack |