Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI

@article{Madaio2020CoDesigningCT,
  title={Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI},
  author={Michael A. Madaio and Luke Stark and Jennifer Wortman Vaughan and Hanna M. Wallach},
  journal={Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems},
  year={2020}
}
Many organizations have published principles intended to guide the ethical development and deployment of AI systems; however, their abstract nature makes them difficult to operationalize. Some organizations have therefore produced AI ethics checklists, as well as checklists for more specific concepts, such as fairness, as applied to AI systems. But unless checklists are grounded in practitioners' needs, they may be misused. To understand the role of checklists in AI ethics, we conducted an… 

Figures and Tables from this paper

Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Support
TLDR
This paper presents a meta-modelling framework for estimating and analyzing values during the design of an internet infrastructure and some examples show how this framework can be applied to social systems.
Prompting Conversations about Fairness in AI Development with Checklists
TLDR
This paper study how checklists can serve as “values levers” in enabling and structuring conversations about ethics, as well as more specific concepts, such as fairness, when developing and deploying AI systems.
An Ecosystem Approach to Ethical AI and Data Use: Experimental reflections
TLDR
The methodology bridges responsibility imbalances that rest in structural decision-making power and elite technical knowledge, by commencing with personal, facilitated conversations, returning the ethical discourse to those meant to give it meaning at the sharp end of the ecosystem.
An Ecosystem Approach to Ethical AI and Data Use: Experimental Reflections
  • M. Findlay, J. Seah
  • Business
    2020 IEEE / ITU International Conference on Artificial Intelligence for Good (AI4G)
  • 2020
While we have witnessed a rapid growth of ethics documents meant to guide artificial intelligence (AI) development, the promotion of AI ethics has nonetheless proceeded with little input from AI
Putting AI ethics to work: are the tools fit for purpose?
TLDR
An assessment of these practical frameworks with the lens of known best practices for impact assessment and audit of technology, and identifies gaps in current AI ethics tools in auditing and risk assessment that should be considered going forward.
Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics
Numerous toolkits have been developed to support ethical AI development. However, toolkits, like all tools, encode assumptions in their design about what work should be done and how. In this paper,
Trustworthy AI for the People?
TLDR
An exploratory empirical study interviewing AI developers working for Swedish public organizations found that several AI ethics issues are not consistently tackled, and AI systems are not fully recognized as part of a broader sociotechnical system.
Community-in-the-loop: towards pluralistic value creation in AI, or - why AI needs business ethics
Today, due to growing computing power and the increasing availability of high-quality datasets, artificial intelligence (AI) technologies are entering many areas of our everyday life. Thereby,
2 Methods and Challenges to Measuring Fairness in AI
  • Education
  • 2021
Educational technologies, and the systems of schooling in which they are deployed, enact particular ideologies about what is important to know and how learners should learn. As artificial
Human-AI Interaction in Human Resource Management: Understanding Why Employees Resist Algorithmic Evaluation at Workplaces and How to Mitigate Burdens
TLDR
It is found that employees feel six types of burdens toward AI's introduction to human resource management (HRM), and that these burdens could be mitigated by incorporating transparency, interpretability, and human intervention to algorithmic decision-making.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 102 REFERENCES
The global landscape of AI ethics guidelines
TLDR
A detailed analysis of 84 AI ethics reports around the world finds a convergence around core principles but substantial divergence on practical implementation, highlighting the importance of integrating guideline-development efforts with substantive ethical analysis and adequate implementation strategies.
Does ACM’s code of ethics change ethical decision making in software development?
TLDR
This work replicated a prior behavioral ethics study with 63 software engineering students and 105 professional software developers, and found that explicitly instructing participants to consider the ACM code of ethics in their decision making had no observed effect when compared with a control group.
Artificial Intelligence: the global landscape of ethics guidelines
TLDR
A global convergence emerging around five ethical principles (transparency, justice and fairness, non-maleficence, responsibility and privacy), with substantive divergence in relation to how these principles are interpreted; why they are deemed important; what issue, domain or actors they pertain to; and how they should be implemented.
Values and pragmatic action: The challenges of introducing ethical intelligence in technical design communities
TLDR
Three key challenges of pragmatic engagement with technical design communities are identified, confronting competing values; identifying the role of the values advocate; and the justification of a value framework are identified.
Principles Alone Cannot Guarantee Ethical AI
TLDR
Brent Mittelstadt highlights important differences between medical practice and AI development that suggest a principled approach to AI development may not work in the case of AI.
Ethical Mediation in UX Practice
TLDR
This paper uses a practice-led approach to describe ethical complexity, presenting three varied cases of UX practitioners based onin situ observations and interviews, and proposes future work on ethical awareness and design education based on the concept of ethical mediation.
Participatory design of a preliminary safety checklist for general practice.
  • P. Bowie, J. Ferguson, S. Atkinson
  • Medicine
    The British journal of general practice : the journal of the Royal College of General Practitioners
  • 2015
TLDR
Hards in the general practice work system were prioritised that can potentially impact on the safety, health and wellbeing of patients, GP team members, and practice performance, and a necessary safety checklist prototype was designed.
From ethics washing to ethics bashing: a view on tech ethics from within moral philosophy
The word 'ethics' is under siege in technology policy circles. Weaponized in support of deregulation, self-regulation or handsoff governance, "ethics" is increasingly identified with technology
Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making
TLDR
There are design opportunities in this disconnect, such as in supporting the tracking of concept drift in secondary data sources, and in building usable transparency tools to identify risks and incorporate domain knowledge, aimed both at managers and at the 'street-level bureaucrats' on the frontlines of public service.
Aequitas: A Bias and Fairness Audit Toolkit
TLDR
Aequitas is an open source bias and fairness audit toolkit that is an intuitive and easy to use addition to the machine learning workflow, enabling users to seamlessly test models for several bias and Fairness metrics in relation to multiple population sub-groups.
...
1
2
3
4
5
...