Methodology · Taxonomy
The TriAxis Taxonomy
Each bias is classified according to 3 orthogonal axes that answer 3 simple questions: Where does the bias come from, at what stage does it occur, and what is its specific nature.
Pourquoi TriAxis
A classification that stands the test of time
Most existing taxonomies classify biases by symptom (what the bias does) or by domain (health, justice, recruitment...). These approaches are useful but they age poorly: new biases constantly appear in new contexts.
TriAxis adopts a structural approach: it describes each bias by 3 fundamental properties that depend neither on the domain nor on the technology. A bias remains classifiable in the same way whether it is detected in 2020 or 2035.
Origin
Where does the bias come from? 3 possibilités : Systemic, computational, or human-cognitive.
Lifecycle
At what stage of the AI Lifecycle? 6 stages from L1 (Historical) to L6 (Deployment).
Specific
What is the specific nature? 30 categories from S01 (proxy) to S30 (interaction).
Les 3 Axes
Details of Axes O, L, and S
Origin Axis
Where does the bias come from?
Systemic
The bias is embedded in social, historical, or institutional structures. It precedes AI and is reflected in its data.
computational
The bias arises from the algorithm itself: model choice, optimization, data representation, feedback loops.
Humain-cognitive
The bias comes from the cognitive biases of designers, annotators, or users: anchoring, confirmation, availability.
Lifecycle Axis
À quelle étape du Lifecycle IA?
Historical
Historical data, archives, past corpora carrying traces of the past.
Representation
Choice of variables, encoding, tokenization, representation vectors.
Measurement
Metrics, thresholds, labels. What is measured determines what the model learns.
Aggregation
Data fusion, weighting, averages that perpetuate disparities.
Evaluation
Choice of test sets, performance metrics, acceptance thresholds.
Deployment
Production release, usage drift, feedback loops, progressive degradation.
Specific Axis
Quelle est la nature précise du biais?
30 categories covering all bias mechanisms identified in the literature. EXAMPLES:
Complete list in the database (30 categories).
SCORING SYSTEM
The IBI Score
Each bias receives an IBI score (0 à 10) calculated from 4 quantitative dimensions : Severity, Frequency, magnitude of impacted groups, and difficulty of Detection.
Severity
From 1 (minor) to 5 (critical). Potential impact on individuals.
Frequency
Rare, occasional, frequent, systematic.
Group magnitude
Number of impacted protected groups (1 to 5).
Detection
Difficulty to identify the bias (1 = easy, 5 = very difficult).
Severity scale (Official levels)
Exemple
TriAxis in action
Here is how a classic bias is described with TriAxis.
Discriminatory proxy bias
Apparently neutral variable serving as a statistical substitute for a protected attribute.
Rooted in the algorithm and variable selection.
Manifests in the choice of metrics.
Substitution by correlated variable.
Explore the database
250 biases, 68 Regulations, 21 analytical views. Everything is searchable, citable, and open.