IBI-002174 - Severepublie
Sensitive Content Detection Bias
Biais de détection de contenu sensible
IBI Score
7.5
out of 10
Severity4_grave
Frequencyfrequent
Scope groups4
Detection difficulty4
🇫🇷 Définition (FR)
Systèmes de détection de nudité ou violence plus stricts sur les corps non blancs.
🇬🇧 Definition (EN)
Nudity or violence detection systems stricter on non-white bodies.
TriAxis Taxonomy
Structural Classification
O
Origin
O2
Computational & Statistical
L
Lifecycle
L6
Evaluation
S
Specific
S18
Group attribution bias
💡
Concrete Example
Les utilisateurs noirs et transgenres subissent des suppressions de contenu et des modérations plus fréquentes et restrictives sur les réseaux sociaux.
📊 Detection Metrics
Demographic Parity DifferenceDisparate Impact RatioEqualized Odds Difference
⚙ Alert Thresholds
Disparate Impact Ratio0.8
Equalized Odds Difference0.1
Demographic Parity Difference0.1
📚 Sources & Scientific References
- •Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media UsersHaimson, Delmonaco, Nie, Wegner (2021)
🛡 Impact & Mitigation
🎯 Vulnerable groups impacted
Black / Afro-descendantLGBTQ+ personsWomenWorking classMinority language speakersSeniors (60+)Youth (18-25)Motor disabilityAsian personsArab / MENA personsNon-binary personsRural areas
🛠 Mitigation methodologies
- DEMO_PARITY : Demographic Parity
- AUDIT_TIERS : Third-party Audit
🏢 Sectors concerned
Media & Social Platforms (Risk: /5)
⚖ Applicable regulations
🇪🇺 Europe
- •AI_ACT_10 : AI Act (UE) 2024/1689
- •DSA_27 : Digital Services Act (UE) 2022/2065
🇺🇸 United States
- •US_TX_TRAIGA : Texas Responsible AI Governance Act (HB 149)
🌍 International
- •ISO_42001 : ISO/IEC 42001:2023
- •UNESCO_2021 : UNESCO - Recommandation sur l'éthique de l'IA
- •OECD_AI_PRINCIPLES : OCDE - Principes IA
- •COE_AI_CONVENTION_INT : Conseil de l'Europe - Convention IA
🇫🇷 France
- •FR_CNIL_AI : CNIL - Recommandations IA
🌐 Canada
- •CA_AIDA : Canada - Loi sur l'IA et les données (AIDA)
📋 Metadata
Contributor
Mohamadou SIDIBE
Institution
AI BIAIS INITIATIVE
Version
1
Created on
October 14, 2026
Updated on
November 6, 2026
UUID
2baed932-5c82-44e6-812b-c3c7f3fc69c6
Explore other biases
250 documented biases, classified by the TriAxis taxonomy.