Monitoring and evaluation gaps

https://taxonomy.eticas.ai/risk/monitoring-evaluation-gaps

Maturity: emerging

Lack of ongoing monitoring that renders datasets obsolete and system outputs unreliable, including absence of feedback mechanisms and periodic evaluation.

This category is emerging. It has not yet been validated through established assessment methods.

Also known as: Monitoring, feedback, evaluation

System type: ADM and LLM systems
Lifecycle stages: Post Processing

Mappings to external frameworks

Standards & frameworks

Framework Reference
EU AI Act (Regulation 2024/1689) Article 72 — Post-market monitoring by providers and post-market monitoring plan for high-risk AI systems
ISO/IEC 42001:2023 — AI Management System A.6.2.6 AI system operation and monitoring
AIUC-1 — AI Underwriting Company Standard Monitor AI risk categories
Council of Europe Framework Convention on AI (CETS No. 225) Article 16(2)(e)
NIST AI Risk Management Framework (AI 100-1) MANAGE 4.1: Post-deployment AI system monitoring plans are implemented, including mechanisms for capturing and evaluating input from users and other relevant AI actors, appeal and override, decommissioning, incident response, recovery, and change management.

Taxonomies & vocabularies

Framework Reference
W3C Data Privacy Vocabulary — AI Extension Monitor Control

Source: HRA project taxonomy