Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations

  title={Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations},
  author={Jakob M{\"o}kander and Jessica Morley and Mariarosaria Taddeo and L. Floridi},
  journal={Science and Engineering Ethics},
Important decisions that impact humans lives, livelihoods, and the natural environment are increasingly being automated. Delegating tasks to so-called automated decision-making systems (ADMS) can improve efficiency and enable new solutions. However, these benefits are coupled with ethical challenges. For example, ADMS may produce discriminatory outcomes, violate individual privacy, and undermine human self-determination. New governance mechanisms are thus needed that help organisations design… 
Ethics-Based Auditing of Automated Decision-Making Systems: Intervention Points and Policy Implications
To support the emergence of feasible and effective EBA procedures, policymakers and regulators could provide standardised reporting formats, facilitate knowledge exchange, provide guidance on how to resolve normative tensions, and create an independent body to oversee EBA of ADMS.
Ethics as a service: a pragmatic operationalisation of AI Ethics
Why principles and technical translational tools are still needed even if they are limited, and how these limitations can be potentially overcome by providing theoretical grounding of a concept that has been termed ‘Ethics as a Service’ are explored.
Ethics as a Service: A Pragmatic Operationalisation of AI Ethics
Why principles and technical translational tools are still needed even if they are limited, and how these limitations can be potentially overcome by providing theoretical grounding of a concept that has been termed ‘Ethics as a Service’ are explored.
Conformity Assessments and Post-market Monitoring: A Guide to the Role of Auditing in the Proposed European AI Regulation
This article describes and discusses the two primary enforcement mechanisms proposed in the AIA: the conformity assessments that providers of high-risk AI systems are expected to conduct, and the post-market monitoring plans that providers must establish to document the performance ofHigh- risk AI systems throughout their lifetimes.
A Code of Digital Ethics: laying the foundation for digital ethics in a science and technology company
The rapid and dynamic nature of digital transformation challenges companies that wish to develop and deploy novel digital technologies. Like other actors faced with this transformation, companies
Towards a framework for evaluating the safety, acceptability and efficacy of AI systems for health: an initial synthesis
A framework to guide AI system developers, policymakers, and regulators through a sufficient evaluation of an AI system designed for use in healthcare is set out by conducting a systematic search across Scopus, PubMed and Google Scholar.
The European Legislation on AI: a Brief Analysis of its Philosophical Approach
On 21 April, 2021, the European Commission published the proposal of the new EU Artificial Intelligence Act (henceforth AIA), or, to use its full name, the Proposal for a regulation of the European Parliament and the Council laying down harmonised rules on Artificial Intelligence and amending certain Union legislative acts (Artificial Intelligence Act 21, 2021).
Algorytm jako informacja publiczna w prawie europejskim
The author verifies the hypothesis concerning the possibility of using algorithms – applied in automated decision making in public sector – as information which is subject to the law governing the
External Stability Auditing to Test the Validity of Personality Prediction in AI Hiring
Automated hiring systems are among the fastest-developing of all high-stakes AI systems. Among these are algorithmic personality tests that use insights from psychometric testing, and promise to
Towards a Reference Software Architecture for Human-AI Teaming in Smart Manufacturing
A reference software architecture based on knowledge graphs, tracking and scene analysis, and components for relational machine learning with a particular focus on its scalability is developed.


Sociotechnical Systems and Ethics in the Large
The conception of ethical STS founded on governance that takes into account stakeholder values, normative constraints on agents, and outcomes (states of the STS) that obtain due to actions taken by agents is presented.
Artificial Intelligence: the global landscape of ethics guidelines
A global convergence emerging around five ethical principles (transparency, justice and fairness, non-maleficence, responsibility and privacy), with substantive divergence in relation to how these principles are interpreted; why they are deemed important; what issue, domain or actors they pertain to; and how they should be implemented.
The global landscape of AI ethics guidelines
A detailed analysis of 84 AI ethics reports around the world finds a convergence around core principles but substantial divergence on practical implementation, highlighting the importance of integrating guideline-development efforts with substantive ethical analysis and adequate implementation strategies.
Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing
The proposed auditing framework is intended to contribute to closing the accountability gap in the development and deployment of large-scale artificial intelligence systems by embedding a robust process to ensure audit integrity.
The algorithm audit: Scoring the algorithms that score us
The proposed audit instrument yields an ethical evaluation of an algorithm that could be used by regulators and others interested in doing due diligence, while paying careful attention to the complex societal context within which the algorithm is deployed.
What does it mean to solve the problem of discrimination in hiring? Social, technical and legal perspectives from the UK on automated hiring systems
A perspective outside the US is introduced by critically examining how three prominent automated hiring systems in regular use in the UK, HireVue, Pymetrics and Applied, understand and attempt to mitigate bias and discrimination, before situating these in the socio-legal context of the UK.
The Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions
It is suggested that an important next step for the field of AI ethics is to focus on exploring the tensions that inevitably arise as the authors try to implement principles in practice, and develop frameworks and guidelines that are rigorous and practically relevant.
Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical
It has taken a very long time, but today, the debate on the ethical impact and implications of digital technologies has reached the front pages of newspapers. This is understandable: digital
Tolerant Paternalism: Pro-ethical Design as a Resolution of the Dilemma of Toleration
  • L. Floridi
  • Sociology, Computer Science
    Sci. Eng. Ethics
  • 2016
It is argued that one form of paternalism, based on pro-ethical design, can be compatible with toleration and hence with the respect for B’s choices, by operating only at the informational and not at the structural level of a choice architecture.
A governance framework for algorithmic accountability and transparency
Algorithmic systems are increasingly used as part of decision-making processes in the public and private sectors, with potentially significant consequences for individuals, organisations and