Fairness Assessments
Class Coverage
- How can we assess algorithmic fairness?
- What metrics are commonly used to measure fairness?
- What can’t be captured in data?
- Class this week is on TUESDAY NOVEMBER 7TH!!
Pre-Class Readings
Please read the following:
- Ethical Machine Learning in Health Care (Chen et al. 2021)
- Millions of black people affected by racial bias in health-care algorithms (Nature)
Participation Questions
Submit to Gradescope by 11AM PT on Thursday, November 9th
- “Individual fairness” refers to the practice of treating similar individuals similarly. What fairness metrics can you use to measure individual fairness?
- “Group fairness” refers to the process of equalizing some output metric(s) (positive predictions, error rates, etc.) across demographic subgroups. What fairness metrics can you use to measure group fairness?
- Can you think of any types of fairness other than individual and group? How would you measure them?
This Week’s Slides
Assigned for Week 07
- Complete Replication Part 02: Model Development and Fairness Assessment
- Complete next week’s readings
- If you signed up to present on Model Cards for Model Reporting (Mitchell et al.) or Fairness Through Awareness (Dwork et al.) come prepared to present next week by 11AM PT on Thursday, November 17th (note the different time!)
- Submit your answers to next week’s participation questions to Gradescope by 11AM PT on Thursday, November 17th
Office Hours for Replication Project
- Tuesday 3:30-4:30pm
- Message Parker on Discord for help. START EARLY!!