European Union Regulations on Algorithmic Decision-Making and a "Right to Explanation"

@article{Goodman2017EuropeanUR,
  title={European Union Regulations on Algorithmic Decision-Making and a "Right to Explanation"},
  author={Bryce Goodman and Seth Flaxman},
  journal={AI Mag.},
  year={2017},
  volume={38},
  pages={50-57}
}
We summarize the potential impact that the European Union’s new General Data Protection Regulation will have on the routine use of machine learning algorithms. Slated to take effect as law across the EU in 2018, it will restrict automated individual decision-making (that is, algorithms that make decisions based on user-level predictors) which “significantly affect” users. The law will also effectively create a “right to explanation,” whereby a user can ask for an explanation of an algorithmic… Expand
Understanding algorithmic decision-making : Opportunities and challenges
  • 2019
While algorithms are hardly a recent invention, they are nevertheless increasingly involved in systems used to support decision-making in society. These ADS (algorithmic decision systems) often relyExpand
Identifying Sources of Discrimination Risk in the Life Cycle of Machine Intelligence Applications under New European Union Regulations
TLDR
This work outlines two key sources of bias in machine intelligence applications that have become imminent in light of new General Data Protection Regulations introduced by the European Union in April 2016 and some strategies for mitigating those biases to mitigate the risks for public. Expand
Effects of Algorithmic Decision-Making and Interpretability on Human Behavior: Experiments using Crowdsourcing
TLDR
A large scale study using crowd-sourcing as a means to measure how interpretability affects human-decision making using well understood principles of behavioral economics is undertaken, the first of its kind of an inter-disciplinary study involving interpretability in ADM models. Expand
Do algorithms rule the world? Algorithmic decision-making and data protection in the framework of the GDPR and beyond
  • M. Brkan
  • Computer Science
  • Int. J. Law Inf. Technol.
  • 2019
TLDR
The article argues that the GDPR obliges the controller to inform the data subject of the reasons why an automated decision was taken and argues that such a right would in principle fit well within the broader framework of theGDPR's quest for a high level of transparency. Expand
Algorithmic Decision-Making and the Problem of Control
In the legal sector, as well as in public policy or medicine, decisions are increasingly being delegated to learning algorithms. In this paper we argue that these delegation practices involveExpand
AI-supported decision-making under the general data protection regulation
The purpose of this paper is to analyse the rules of the General Data Protection Regulation on automated decision making in the age of Big Data and to explore how to ensure transparency of suchExpand
Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems
TLDR
It is argued that a reviewability framework, drawing on administrative law's approach to reviewing human decision-making, offers a practical way forward towards more a more holistic and legally-relevant form of accountability for ADM. Expand
Futility of a Right to Explanation
TLDR
This paper argues that this Right to Explanation for people subjected to automated decision making would be very difficult to implement due to technical challenges, and proposes instead an external evaluation of classification models with respect to their correctness and fairness. Expand
Infusing domain knowledge in AI-based "black box" models for better explainability with application in bankruptcy prediction
TLDR
A way to collect and infuse domain knowledge into a "black box" model for bankruptcy prediction and understanding from the experiments reveals that infused domain knowledge makes the output from the black box model more interpretable and explainable. Expand
Artificial Intelligence, Data, Ethics An Holistic Approach for Risks and Regulation
TLDR
An holistic and original approach is proposed to take into account the risks encountered all along the implementation of systems using artificial intelligence from the choice of the data and the selection of the algorithm, to the decision making. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 72 REFERENCES
EU regulations on algorithmic decision-making and a "right to explanation"
TLDR
It is argued that while this law will pose large challenges for industry, it highlights opportunities for machine learning researchers to take the lead in designing algorithms and evaluation frameworks which avoid discrimination. Expand
Algorithmic Transparency via Quantitative Input Influence
TLDR
A family of Quantitative Input Influence measures that capture the degree of input influence on system outputs provide a foundation for the design of transparency reports that accompany system decisions and for testing tools useful for internal and external oversight. Expand
Better decision support through exploratory discrimination-aware data mining: foundations and empirical evidence
TLDR
This article discusses the relative merits of constraint-oriented and exploratory DADM from a conceptual viewpoint and considers the case of loan applications to empirically assess the fitness of both discrimination-aware data mining approaches for two of their typical usage scenarios: prevention and detection. Expand
Certifying and Removing Disparate Impact
TLDR
This work links disparate impact to a measure of classification accuracy that while known, has received relatively little attention and proposes a test for disparate impact based on how well the protected class can be predicted from the other attributes. Expand
Three naive Bayes approaches for discrimination-free classification
TLDR
Three approaches for making the naive Bayes classifier discrimination-free are presented: modifying the probability of the decision being positive, training one model for every sensitive attribute value and balancing them, and adding a latent variable to the Bayesian model that represents the unbiased label and optimizing the model parameters for likelihood using expectation maximization. Expand
How the machine ‘thinks’: Understanding opacity in machine learning algorithms
This article considers the issue of opacity as a problem for socially consequential mechanisms of classification and ranking, such as spam filters, credit card fraud detection, search engines, newsExpand
The new profiling: Algorithms, black boxes, and the failure of anti-discriminatory safeguards in the European Union
This article argues that with increasingly large databases and computational power, profiling as a key part of security governance is experiencing major changes. Targeting mobile populations in orderExpand
Exploring Discrimination: A User-centric Evaluation of Discrimination-Aware Data Mining
TLDR
In a user study administered via Mechanical Turk, it is shown that tools such as DCUBE-GUI can successfully assist novice users in exploring discrimination in data mining. Expand
Big Data's Disparate Impact
Advocates of algorithmic techniques like data mining argue that these techniques eliminate human biases from the decision-making process. But an algorithm is only as good as the data it works with.Expand
Judgment under Uncertainty: Heuristics and Biases.
TLDR
Three heuristics that are employed in making judgements under uncertainty are described: representativeness, availability of instances or scenarios, which is often employed when people are asked to assess the frequency of a class or the plausibility of a particular development. Expand
...
1
2
3
4
5
...