Responsible AI is not optional. Organizations that deploy AI without rigor on fairness, transparency, and accountability face regulatory action, reputational damage, and real harm to people. The CDO's job is to build AI governance that is rigorous but not so burdensome it paralyzes innovation.
AI systems fail in predictable ways:
Biased training data: A hiring algorithm trained on historical hiring data learns to prefer candidates similar to those historically hired, reinforcing existing biases. Amazon discovered their AI recruiting tool was penalizing resumes that included the word "women's" (e.g., "women's chess club") and shut it down before deployment.
Proxy discrimination: A model may not use protected attributes (race, gender) directly, but use correlated proxies (zip code, college name) that produce discriminatory outcomes. Legally and ethically, this is still discrimination.
Distributional shift: A loan default model trained during economic expansion may perform catastrophically during recession, a different economic regime.
Feedback loops: A predictive policing model trained on historical arrests (which reflect past policing patterns) directs police to historically over-policed areas, generating more arrests, validating the model's predictions. The model amplifies existing bias.
AI Fairness and Bias: A Practical Guide
Vérification des acquis
1. What specific issue led Amazon to shut down its AI recruiting tool before deployment?
2. According to the lesson, what is 'equal opportunity' as a fairness definition?
3. Why is proxy discrimination still considered discrimination legally and ethically?
4. Select ALL the predictable ways AI systems fail according to the lesson:
Sélectionnez toutes les réponses correctes.
5. Select ALL correct statements about mathematical fairness definitions:
Sélectionnez toutes les réponses correctes.
Fairness in AI is not a single concept, it's a set of mathematical definitions that can conflict with each other:
Demographic parity: The model's positive prediction rate is the same across groups. A loan approval model approves equal percentages of applicants regardless of race.
Equal opportunity: The true positive rate is the same across groups. Among actually creditworthy applicants, the approval rate is equal regardless of race.
Individual fairness: Similar individuals receive similar predictions. Two candidates with identical qualifications receive similar hiring scores.
These definitions can be mathematically incompatible. Satisfying demographic parity may require violating individual fairness. CDOs must decide which fairness concept applies to each use case, in collaboration with legal, compliance, and ethics stakeholders.
Practical approach: define the specific fairness requirements for each AI system before development, measure them before deployment, monitor them in production.
The EU AI Act (effective 2024-2027, phased) categorizes AI systems by risk:
Unacceptable risk (banned): Social scoring systems, real-time biometric surveillance in public, AI that manipulates behavior through unconscious techniques. These are prohibited regardless of business case.
High risk (strict requirements): AI in hiring, credit scoring, medical diagnosis, critical infrastructure, law enforcement. Requires: conformity assessment, documentation, human oversight, transparency to affected individuals, bias testing before deployment.
Limited risk (transparency obligations): Chatbots must disclose they're AI. Deepfakes must be labeled.
Minimal risk: Most AI applications. No specific obligations.
CDOs in EU-regulated markets must understand which category each AI system falls into. High-risk categories require documentation and testing that must be built into the development process, retrofitting compliance is significantly more expensive.
A lightweight but rigorous AI ethics review process:
Pre-development: For any new AI use case, complete a short "AI impact assessment", who is affected, what decisions does it influence, what are the failure modes, what protected groups could be impacted?
Pre-deployment: For high-impact systems: fairness testing across demographic groups, adversarial testing (what happens with malicious inputs?), human review of edge cases.
Post-deployment: Monitor for performance degradation across demographic groups, track appeals and complaints from affected individuals, schedule periodic re-evaluation.
Escalation path: Clear process for when to escalate concerns, from the data scientist who spots a bias issue to the AI ethics committee to the CDO and legal team.
This process adds 10-20% overhead to AI development timelines. It's worth it, the alternative is building systems that harm people and expose the organization to significant legal and reputational risk.
1. Pourquoi Amazon a-t-il arrarrAnnual Recurring Revenue (ARR) is the normalized, predictable revenue a subscription business expects to earn from active contracts over a single year.Voir la définition complète →êté son algorithme de recrutement IA ?
A) Il était trop coûteux à opérer
B) Il pénalisait les CV contenant des références à des activités féminines, un exemple de biais lié aux données historiques d'embauche
C) Il n'était pas assez précis pour prédire la performance
D) Il violait les réglementations sur la protection des données
Réponse: B
2. Qu'est-ce qu'un "feedback loop" problématique dans l'IA, illustré par l'exemple du predictive policing ?
A) Un modèle qui s'améliore trop vite et devient imprévisible
B) Un mécanisme où les prédictions du modèle influencent les données futures qui valident ces mêmes prédictions, amplifiant les biais existants
C) Un problème de performance lié au volume de données
D) Une régression du modèle due au manque de réentraînement
Réponse: B
3. Dans l'EU AI Act, quelle catégorie s'applique aux systèmes IA utilisés dans le recrutement ou le scoring de crcrThe percentage of visitors or prospects who complete a desired action (purchase, sign-up, contact form), calculated as conversions divided by total opportunities.Voir la définition complète →édit ?
A) Risque minimal
B) Risque limité (obligations de transparence)
C) Risque élevé (haute risk), nécessitant évaluation de conformité, supervision humaine et tests de biais avant déploiement
D) Risque inacceptable (interdit)
Réponse: C