Fitness for purpose and task effectiveness

https://taxonomy.eticas.ai/risk/fitness-for-purpose

Maturity: emerging

The system has not been validated against the problem it is intended to solve, or is deployed for a task or context beyond the one it was validated for. Covers the ex ante question (was this designed and validated for this problem?) and its enforcement in deployment; whether the system actually succeeds at the task in operation is task-performance (Reliability).

This category is emerging. It has not yet been validated through established assessment methods.

Also known as: Fitness for purpose · Task success

System type: ADM and LLM systems
Lifecycle stages: Pre Processing, In Processing, Post Processing

Mappings to external frameworks

Standards & frameworks

Framework Reference
ISO/IEC 42001:2023 — AI Management System A.9.4 Intended use of the AI system
ISO/IEC 42001:2023 — AI Management System A.6.2.4 AI system verification and validation
ISO/IEC 42001:2023 — AI Management System A.6.2.2 AI system requirements and specification
Council of Europe Framework Convention on AI (CETS No. 225) Article 16(2)(g)
NIST AI Risk Management Framework (AI 100-1) MAP 3: AI capabilities, targeted usage, goals, and expected benefits and costs compared with appropriate benchmarks are understood.
NIST AI Risk Management Framework (AI 100-1) MEASURE 2.5: The AI system to be deployed is demonstrated to be valid and reliable. Limitations of the generalizability beyond the conditions under which the technology was developed are documented.
NIST AI Risk Management Framework (AI 100-1) MAP 3.3: Targeted application scope is specified and documented based on the system’s capability, established context, and AI system categorization.
NIST AI Risk Management Framework (AI 100-1) MANAGE 1.1: A determination is made as to whether the AI system achieves its intended purposes and stated objectives and whether its development or deployment should proceed.

Source: HRA project taxonomy