Home›Biases›IBI-00035
IBI-000354 - Severepublie

Annotation Bias

Biais d'annotation

IBI Score
7.5
out of 10
Severity4_grave
Frequencyfrequent
Scope groups4
Detection difficulty4
🇫🇷 Définition (FR)

Biais introduit par les préjugés subjectifs des annotateurs humains.

🇬🇧 Definition (EN)

Bias introduced by the subjective prejudices of human annotators.

TriAxis Taxonomy

Structural Classification

O
Origin
O3
Human-Cognitive
L
Lifecycle
L2
Representation
S
Specific
S05
Annotation bias
💡
Concrete Example

Les dialectes afro-américains sont classés comme toxiques 1,8× plus souvent que l'anglais standard.

📊 Detection Metrics

Annotation AgreementDemographic Parity Difference

⚙ Alert Thresholds

Annotation Agreement0.8
Demographic Parity Difference0.1

📚 Sources & Scientific References

🛡 Impact & Mitigation

🎯 Vulnerable groups impacted

Black / Afro-descendantMinority language speakers

🛠 Mitigation methodologies

  • DEMO_PARITY : Demographic Parity
  • SHAP_GROUP : SHAP Group Analysis
  • AUDIT_TIERS : Third-party Audit

🏢 Sectors concerned

Media & Social Platforms (Risk: /5)

⚖ Applicable regulations

🇪🇺 Europe
  • •
    AI_ACT_10 : AI Act (UE) 2024/1689
🌍 International
  • •
    ISO_42001 : ISO/IEC 42001:2023
  • •
    UNESCO_2021 : UNESCO - Recommandation sur l'éthique de l'IA
  • •
    OECD_AI_PRINCIPLES : OCDE - Principes IA
  • •
    COE_AI_CONVENTION_INT : Conseil de l'Europe - Convention IA

📋 Metadata

Contributor
Mohamadou SIDIBE
Institution
AI BIAIS INITIATIVE
Version
1
Created on
October 14, 2026
Updated on
November 4, 2026
UUID
126d4c69-3d6d-4a0c-9e0a-f12d94047850

Explore other biases

250 documented biases, classified by the TriAxis taxonomy.