• Corpus ID: 245124106

Fairness for Robust Learning to Rank

@article{Memarrast2021FairnessFR,
  title={Fairness for Robust Learning to Rank},
  author={Omid Memarrast and Ashkan Rezaei and Rizal Fathony and Brian D. Ziebart},
  journal={ArXiv},
  year={2021},
  volume={abs/2112.06288}
}
While conventional ranking systems focus solely on maximizing the utility of the ranked items to users, fairness-aware ranking systems additionally try to balance the exposure for different protected attributes such as gender or race. To achieve this type of group fairness for ranking, we derive a new ranking system based on the first principles of distributional robustness. We formulate a minimax game between a player choosing a distribution over rankings to maximize utility while satisfying… 
[PDF] Semantic Reader
2 Citations
Background Citations
2

Figures and Tables from this paper

2 Citations

Fair Ranking with Noisy Protected Attributes

This work presents a fair-ranking framework that incorporates group fairness requirements along with probabilistic information about perturbations in socially-salient attributes and provides provable guarantees on the fairness and utility attainable by this framework and shows that it is informationtheoretically impossible to significantly beat these guarantees.

Fair Matrix Factorisation for Large-Scale Recommender Systems

This study takes a step towards solving real-world unfairness issues by developing a simple and scalable collaborative filtering method for fairness-aware item recommendation named fiADMM, which inherits the scalability of iALS and maintains a provable convergence guarantee.

References

SHOWING 1-10 OF 61 REFERENCES

Policy Learning for Fairness in Ranking

This work proposes a general LTR framework that can optimize a wide range of utility metrics while satisfying fairness of exposure constraints with respect to the items, and provides a new LTR algorithm called Fair-PG-Rank for directly searching the space of fair ranking policies via a policy-gradient approach.

Pairwise Fairness for Ranking and Regression

We present pairwise fairness metrics for ranking models and regression models that form analogues of statistical fairness notions such as equal opportunity, equal accuracy, and statistical parity.…

Fairness in Recommendation Ranking through Pairwise Comparisons

This paper offers a set of novel metrics for evaluating algorithmic fairness concerns in recommender systems and shows how measuring fairness based on pairwise comparisons from randomized experiments provides a tractable means to reason about fairness in rankings fromRecommender systems.

Fairness of Exposure in Rankings

This work proposes a conceptual and computational framework that allows the formulation of fairness constraints on rankings in terms of exposure allocation, and develops efficient algorithms for finding rankings that maximize the utility for the user while provably satisfying a specifiable notion of fairness.

Controlling Fairness and Bias in Dynamic Learning-to-Rank

This work proposes a learning algorithm that ensures notions of amortized group fairness, while simultaneously learning the ranking function from implicit feedback data, and finds empirically that the algorithm is highly practical and robust.

Ranking with Fairness Constraints

This work studies the following variant of the traditional ranking problem when the objective satisfies properties that appear in common ranking metrics such as Discounted Cumulative Gain, Spearman's rho or Bradley-Terry.

Fairness for Robust Log Loss Classification

This work re-derive a new classifier from the first principles of distributional robustness that incorporates fairness criteria into a worst-case logarithmic loss minimization that produces a parametric exponential family conditional distribution that resembles truncated logistic regression.

Equity of Attention: Amortizing Individual Fairness in Rankings

The challenge of achieving amortized individual fairness subject to constraints on ranking quality as an online optimization problem is formulated and solved as an integer linear program and it is demonstrated that the method can improve individual fairness while retaining high ranking quality.

Ranking for Individual and Group Fairness Simultaneously

This paper defines individual fairness based on how close the predicted rank of each item is to its true rank, and proves a lower bound on the trade-off achievable for simultaneous individual and group fairness in ranking.

Designing Fair Ranking Schemes

This paper develops a system that helps users choose criterion weights that lead to greater fairness, and shows how to efficiently identify regions in this space that satisfy a broad range of fairness criteria.
...