Flexible Group Fairness Metrics for Survival Analysis

  title={Flexible Group Fairness Metrics for Survival Analysis},
  author={Raphael Sonabend and Florian Pfisterer and Alan Mishler and Moritz Schauer and Lukas Burk and Sandra Jeanne Vollmer},
Algorithmic fairness is an increasingly important field concerned with de- tecting and mitigating biases in machine learning models. There has been a wealth of literature for algorithmic fairness in regression and classification however there has been little exploration of the field for survival analysis. Survival analysis is the prediction task in which one attempts to predict the probability of an event occurring over time. Survival predictions are particularly important in sensitive settings… 

Figures and Tables from this paper

Distributionally Robust Survival Analysis: A Novel Fairness Loss Without Demographics

This approach uses a training loss function that does not know any demographic information to treat as sensitive, and it is demonstrated that the proposed approach often scores better on recently established fairness metrics compared to various baselines.



An Empirical Characterization of Fair Machine Learning For Clinical Risk Prediction

Longitudinal Fairness with Censorship

Fairness in longitudinal right-censored environments, where the time to event might be unknown, resulting in censorship of the class label and inapplicability of existing fairness studies is considered.

Fairness Measures for Regression via Probabilistic Classification

This work introduces and train machine learning classifiers, distinct from the predictor, as a mechanism to estimate these probabilities from the data, and introduces tractable approximations of the independence, separation and sufficiency criteria.

Counterfactual Fairness

This paper develops a framework for modeling fairness using tools from causal inference and demonstrates the framework on a real-world problem of fair prediction of success in law school.

Algorithmic Fairness: Choices, Assumptions, and Definitions

It is shown how choices and assumptions madeβ€”often implicitlyβ€”to justify the use of prediction-based decision-making can raise fairness concerns and a notationally consistent catalog of fairness definitions from the literature is presented.

Avoiding C-hacking when evaluating survival distribution predictions with discrimination measures

This article considers how to evaluate survival distribution predictions with measures of discrimination and recommends that machine learning survival analysis software implements clear transformations between distribution and risk predictions in order to allow more transparent and accessible model evaluation.

Measuring the Biases that Matter: The Ethical and Casual Foundations for Measures of Fairness in Algorithms

While procedural bias is indicative of disparate treatment, it is argued that consideration of causal structures shows that these measures are better understood as complicated and unreliable measures of procedural biases, and it is suggested that error bias proper is best measured by score-based measures of accuracy, such as the Brier score.

Fairness through awareness

A framework for fair classification comprising a (hypothetical) task-specific metric for determining the degree to which individuals are similar with respect to the classification task at hand and an algorithm for maximizing utility subject to the fairness constraint, that similar individuals are treated similarly is presented.

A Survey on Bias and Fairness in Machine Learning

This survey investigated different real-world applications that have shown biases in various ways, and created a taxonomy for fairness definitions that machine learning researchers have defined to avoid the existing bias in AI systems.

Evaluating Random Forests for Survival Analysis using Prediction Error Curves.

The R package pec is surveyed, showing how the functionality of pec can be extended to yet unsupported prediction models, and implemented support for random forest prediction models based on the R-packages randomSurvivalForest and party.