The Moral Machine experiment

  title={The Moral Machine experiment},
  author={Edmond Awad and Sohan Dsouza and Richard Kim and Jonathan F. Schulz and Joseph Henrich and Azim F. Shariff and Jean‐François Bonnefon and Iyad Rahwan},
With the rapid development of artificial intelligence have come concerns about how machines will make moral decisions, and the major challenge of quantifying societal expectations about the ethical principles that should guide machine behaviour. To address this challenge, we deployed the Moral Machine, an online experimental platform designed to explore the moral dilemmas faced by autonomous vehicles. This platform gathered 40 million decisions in ten languages from millions of people in 233… 
Philosophy and Politics of Moral Machines
A recent large-scale survey, “The Moral Machine experiment” (2018) aggregated 39.61 million decisions across 233 countries and territories reflecting people’s preferences as to who should be spared
On the Machine Learning of Ethical Judgments from Natural Language
Through an audit of recent work on computational approaches for predicting morality, this work examines the broader issues that arise from such efforts and offers a critique of such NLP methods for automating ethical decision-making.
Programming Away Human Rights and Responsibilities? “The Moral Machine Experiment” and the Need for a More “Humane” AV Future
Dilemma situations involving the choice of which human life to save in the case of unavoidable accidents are expected to arise only rarely in the context of autonomous vehicles (AVs). Nonetheless,
Does Moral Code have a Moral Code? Probing Delphi’s Moral Philosophy
In an effort to guarantee that machine learning model outputs conform with human moral values, recent work has begun exploring the possibility of explicitly training models to learn the difference
Why machines cannot be moral
It is argued that the project of building “ethics” “into” machines presupposes a flawed understanding of the nature of ethics and that machines could at best be engineered to provide a shallow simulacrum of ethics, which would have limited utility in confronting the ethical and policy dilemmas associated with AI.
The Thorny Challenge of Making Moral Machines: Ethical Dilemmas with Self-Driving Cars
Abstract The algorithms that control AVs will need to embed moral principles guiding their decisions in situations of unavoidable harm. Manufacturers and regulators are confronted with three
Modeling of moral decisions with deep learning
Test results indicate that deep neural networks can be effective in learning the group morality of a population through observation, and outperform the Bayesian model in the cases of model mismatches.
Cognitive architectures for artificial intelligence ethics
In this article, it is argued for the application of cognitive architectures for ethical AI for their potential contributions to AI transparency, explainability, and accountability.
Neuro-computational foundations of moral preferences
The findings show that human lives and money are valued in distinct neural currencies, supporting theoretical proposals that human moral behavior is guided by processes that are distinct from those underlying behavior driven by personal material benefit.
Synthetic Deliberation: Can Emulated Imagination Enhance Machine Ethics?
A potential path to AI ethics is explored by considering the role of imagination in the deliberative process via the work of John Dewey and his interpreters, showcasing one form of reinforcement learning that mimics imaginative deliberation and contend that such an artificial agent is capable of something very near ethical behavior.


A Dissociation Between Moral Judgments and Justifications
To what extent do moral judgments depend on conscious reasoning from explicitly understood principles? We address this question by investigating one particular moral principle, the principle of the
The weirdest people in the world?
Abstract Behavioral scientists routinely publish broad claims about human psychology and behavior in the world's top journals based on samples drawn entirely from Western, Educated, Industrialized,
Intrinsic Honesty and the Prevalence of Rule Violations across Societies
An index of the ‘prevalence of rule violations’ (PRV) based on country-level data from the year 2003 of corruption, tax evasion and fraudulent politics is developed and individual intrinsic honesty is found to be stronger in the subject pools of low PRV countries than those of highPRV countries.
Responsible Autonomy
Lead ethics theories are described and alternative ways to ensure ethical behavior by artificial systems are proposed, leading to better understanding and trust on artificial autonomous systems.
A Natural History of Human Thinking
Tool-making or culture, language or religious belief: ever since Darwin, thinkers have struggled to identify what fundamentally differentiates human beings from other animals. In this
The Righteous Mind: Why Good People Are Divided by Politics and Religion
In "The Righteous Mind", psychologist Jonathan Haidt answers some of the most compelling questions about human relationships: Why can it sometimes feel as though half the population is living in a
The Psychology of Dilemmas and the Philosophy of Morality
We review several instances where cognitive research has identified distinct psychological mechanisms for moral judgment that yield conflicting answers to moral dilemmas. In each of these cases, the
Moral Tribes: Emotion, Reason, and the Gap Between Us and Them
Our brains were designed for tribal life, for getting along with a select group of others (Us), and for fighting off everyone else (Them). But modern life has thrust the world's tribes into a shared
Crowdsourcing Societal Tradeoffs
It is argued that many techniques developed in the multiagent systems community, particularly those under economic paradigms, can be brought to bear on this question and its relation to computational social choice, mechanism design, prediction markets, and related topics.
Cooperation, decision time, and culture: Online experiments with American and Indian participants
The results imply the cultural background of subjects in their real life affects the speed of cooperation decision-making differentially in online social environments.