IBI-000363_significativepublie
Subjective Annotation Bias
Biais d'annotation subjectif
IBI Score
6.8
out of 10
Severity3_significative
Frequencyfrequent
Scope groups4
Detection difficulty4
🇫🇷 Définition (FR)
Préjugés des annotateurs projetés dans les labels lors de l'étiquetage manuel.
🇬🇧 Definition (EN)
Annotator biases projected into labels during manual annotation.
TriAxis Taxonomy
Structural Classification
O
Origin
O3
Human-Cognitive
L
Lifecycle
L2
Representation
S
Specific
S05
Annotation bias
💡
Concrete Example
Waseem et Hovy 2016 : dialectes afro-américains classés toxiques 1,8× plus souvent.
📊 Detection Metrics
Annotation AgreementDemographic Parity Difference
⚙ Alert Thresholds
Annotation Agreement0.8
Demographic Parity Difference0.1
📚 Sources & Scientific References
- •
- •Perspectivist Approaches to Natural Language Processing: A SurveyFrenda, S., Abercrombie, G., Basile, V., Pedrani, A., Panizzon, R., Cignarella, A. T., Marco, C. (2025)
🛡 Impact & Mitigation
🎯 Vulnerable groups impacted
No specific groups.
🛠 Mitigation methodologies
- AUDIT_TIERS : Third-party Audit
🏢 Sectors concerned
Education & Training (Risk: /5)Media & Social Platforms (Risk: /5)HR & Recruitment (Risk: /5)Justice & Security (Risk: /5)Healthcare & Medicine (Risk: /5)
⚖ Applicable regulations
🌍 International
- •ISO_42001 : ISO/IEC 42001:2023
- •UNESCO_2021 : UNESCO - Recommandation sur l'éthique de l'IA
- •OECD_AI_PRINCIPLES : OCDE - Principes IA
- •COE_AI_CONVENTION_INT : Conseil de l'Europe - Convention IA
📋 Metadata
Contributor
Mohamadou SIDIBE
Institution
AI BIAIS INITIATIVE
Version
1
Created on
October 14, 2026
Updated on
November 4, 2026
UUID
6feffa5f-27fb-4c4d-ad42-74d6b1ae30ef
Explore other biases
250 documented biases, classified by the TriAxis taxonomy.