Measurement validity

https://taxonomy.eticas.ai/risk/measurement-validity

Maturity: emerging

For systems that produce evaluative judgements or scores, the risk that the output does not validly measure the criterion, construct, or outcome it purports to assess. Distinct from hallucination (factual fabrication) and output-inconsistency (same-input variability) — a single output may be stable, internally consistent, and factually accurate yet still fail to measure what it claims. Especially salient for assessment, scoring, grading, and ranking systems, where the output IS a measurement. Follows the standard validity framework — content, criterion, construct, external, consequential validity (Lissitz & Samuelsen, 2007); subcategories below operationalise specific validity types as audit-tractable risks.

Subcategories

Source: Eticas (Wiselook engagement, 2026-06; restructured Usman Gohar, July 2026) project taxonomy