Home›Biases›IBI-00174
IBI-001743_significativepublie

Evaluator Selection Bias

Biais de sélection des évaluateurs

IBI Score
6.0
out of 10
Severity3_significative
Frequencyfrequent
Scope groups3
Detection difficulty3
🇫🇷 Définition (FR)

Les évaluateurs humains recrutés ne sont pas représentatifs de la population cible.

🇬🇧 Definition (EN)

Recruited human evaluators are not representative of the target population.

TriAxis Taxonomy

Structural Classification

O
Origin
O3
Human-Cognitive
L
Lifecycle
L6
Evaluation
S
Specific
S18
Group attribution bias
💡
Concrete Example

Les évaluateurs de MTurk sont majoritairement jeunes, américains et éduqués.

📊 Detection Metrics

Demographic Parity DifferenceDisparate Impact RatioEqualized Odds Difference

⚙ Alert Thresholds

Disparate Impact Ratio0.8
Equalized Odds Difference0.1
Demographic Parity Difference0.1

🛡 Impact & Mitigation

🎯 Vulnerable groups impacted

Working classRural areasMinority language speakersLGBTQ+ personsWomenNon-binary personsSeniors (60+)Youth (18-25)Black / Afro-descendantMotor disabilityArab / MENA personsAsian persons

🛠 Mitigation methodologies

  • AUDIT_TIERS : Third-party Audit

🏢 Sectors concerned

Media & Social Platforms (Risk: /5)HR & Recruitment (Risk: /5)

⚖ Applicable regulations

🇪🇺 Europe
  • •
    AI_ACT_10 : AI Act (UE) 2024/1689
🇺🇸 United States
  • •
    US_TX_TRAIGA : Texas Responsible AI Governance Act (HB 149)
🌍 International
  • •
    ISO_42001 : ISO/IEC 42001:2023
  • •
    UNESCO_2021 : UNESCO - Recommandation sur l'éthique de l'IA
  • •
    OECD_AI_PRINCIPLES : OCDE - Principes IA
  • •
    COE_AI_CONVENTION_INT : Conseil de l'Europe - Convention IA
🇫🇷 France
  • •
    FR_CNIL_AI : CNIL - Recommandations IA
🌐 Canada
  • •
    CA_AIDA : Canada - Loi sur l'IA et les données (AIDA)

📋 Metadata

Contributor
Mohamadou SIDIBE
Institution
AI BIAIS INITIATIVE
Version
1
Created on
October 14, 2026
Updated on
November 4, 2026
UUID
e9fda2ab-9d26-40de-910f-4692a010ba31

Explore other biases

250 documented biases, classified by the TriAxis taxonomy.