Security & Misuse

https://taxonomy.eticas.ai/risk/security-misuse

Maturity: established

The risk that an AI system is exposed to AI-specific vulnerabilities, attacks, or misuse that compromise its integrity, availability, or confidentiality. This covers risks beyond traditional IT security, including adversarial inputs, prompt injection, model extraction, jailbreaking, and supply-chain risks specific to AI components. It is intended to complement, not replace, standard IT security assessments.

Also known as: Safety, Security & Misuse · Security · Safety

System type: ADM and LLM systems
Lifecycle stages: Pre Processing, In Processing, Post Processing

Risk groups

Mappings to external frameworks

Standards & frameworks

Framework Reference
EU AI Act (Regulation 2024/1689) Article 15(5) — resilience against attempts by unauthorized third parties to alter use, outputs or performance
AIUC-1 — AI Underwriting Company Standard Security domain
Council of Europe Framework Convention on AI (CETS No. 225) Article 12 – Reliability
NIST AI Risk Management Framework (AI 100-1) Secure and Resilient
NIST AI 600-1 — Generative AI Risk Profile Information Security
OECD AI Principles 1.4 Robustness, security and safety
TC260 AI Safety Governance Framework (v2.0) §3.1.1(e) External adversarial attack

Taxonomies & vocabularies

Framework Reference
MIT AI Risk Repository AI system security vulnerabilities and attacks
MIT AI Risk Repository Malicious Actors
AIR 2024 Security Risks
W3C Data Privacy Vocabulary — AI Extension Security Attack