IBI Score
6.3
out of 10
Severity3_significative
Frequencyfrequent
Scope groups3
Detection difficulty4
🇫🇷 Définition (FR)
Le BLEU score favorise les traductions proches de l'anglais et pénalise les langues à morphologie riche.
🇬🇧 Definition (EN)
BLEU score favors translations close to English and penalizes morphologically rich languages.
TriAxis Taxonomy
Structural Classification
O
Origin
O2
Computational & Statistical
L
Lifecycle
L6
Evaluation
S
Specific
S22
Linguistic bias
💡
Concrete Example
Les traductions vers le finnois ou le turc sont sous-évaluées par BLEU.
📊 Detection Metrics
Demographic Parity DifferenceDisparate Impact RatioEqualized Odds Difference
⚙ Alert Thresholds
Disparate Impact Ratio0.8
Equalized Odds Difference0.1
Demographic Parity Difference0.1
📚 Sources & Scientific References
- •Bleu: a Method for Automatic Evaluation of Machine TranslationKishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu (2002)
- •Sentence-level Aggregation of Lexical Metrics Correlates Stronger with Human Judgements than Corpus-level AggregationCavalin, P., Domingues, P. H., Pinhanez, C. (2025)
🛡 Impact & Mitigation
🎯 Vulnerable groups impacted
Minority language speakers
🛠 Mitigation methodologies
- AUDIT_TIERS : Third-party Audit
🏢 Sectors concerned
Media & Social Platforms (Risk: /5)
⚖ Applicable regulations
🌍 International
- •ISO_42001 : ISO/IEC 42001:2023
- •UNESCO_2021 : UNESCO - Recommandation sur l'éthique de l'IA
- •OECD_AI_PRINCIPLES : OCDE - Principes IA
- •COE_AI_CONVENTION_INT : Conseil de l'Europe - Convention IA
📋 Metadata
Contributor
Mohamadou SIDIBE
Institution
AI BIAIS INITIATIVE
Version
1
Created on
October 14, 2026
Updated on
November 4, 2026
UUID
34f31d13-db6b-480c-b953-93ac83cad043
Explore other biases
250 documented biases, classified by the TriAxis taxonomy.