The Moral Machine experiment

  title={The Moral Machine experiment},
  author={Edmond Awad and Sohan Dsouza and Richard Kim and Jonathan F. Schulz and Joseph Henrich and Azim F. Shariff and Jean‐François Bonnefon and Iyad Rahwan},
With the rapid development of artificial intelligence have come concerns about how machines will make moral decisions, and the major challenge of quantifying societal expectations about the ethical principles that should guide machine behaviour. To address this challenge, we deployed the Moral Machine, an online experimental platform designed to explore the moral dilemmas faced by autonomous vehicles. This platform gathered 40 million decisions in ten languages from millions of people in 233… 

Philosophy and Politics of Moral Machines

A recent large-scale survey, “The Moral Machine experiment” (2018) aggregated 39.61 million decisions across 233 countries and territories reflecting people’s preferences as to who should be spared

On the Machine Learning of Ethical Judgments from Natural Language

Through an audit of recent work on computational approaches for predicting morality, this work examines the broader issues that arise from such efforts and offers a critique of such NLP methods for automating ethical decision-making.

Programming Away Human Rights and Responsibilities? “The Moral Machine Experiment” and the Need for a More “Humane” AV Future

Dilemma situations involving the choice of which human life to save in the case of unavoidable accidents are expected to arise only rarely in the context of autonomous vehicles (AVs). Nonetheless,

Does Moral Code have a Moral Code? Probing Delphi’s Moral Philosophy

In an effort to guarantee that machine learning model outputs conform with human moral values, recent work has begun exploring the possibility of explicitly training models to learn the difference

Why machines cannot be moral

It is argued that the project of building “ethics” “into” machines presupposes a flawed understanding of the nature of ethics and that machines could at best be engineered to provide a shallow simulacrum of ethics, which would have limited utility in confronting the ethical and policy dilemmas associated with AI.

Mapping Topics in 100, 000 Real-life Moral Dilemmas

Moral dilemmas play an important role in theorizing both about ethical norms and moral psychology. Yet thought experiments borrowed from the philosophical literature often lack the nuances and

The Thorny Challenge of Making Moral Machines: Ethical Dilemmas with Self-Driving Cars

Abstract The algorithms that control AVs will need to embed moral principles guiding their decisions in situations of unavoidable harm. Manufacturers and regulators are confronted with three

Modeling of moral decisions with deep learning

Test results indicate that deep neural networks can be effective in learning the group morality of a population through observation, and outperform the Bayesian model in the cases of model mismatches.

Cognitive architectures for artificial intelligence ethics

In this article, it is argued for the application of cognitive architectures for ethical AI for their potential contributions to AI transparency, explainability, and accountability.

Neuro-computational foundations of moral preferences

The findings show that human lives and money are valued in distinct neural currencies, supporting theoretical proposals that human moral behavior is guided by processes that are distinct from those underlying behavior driven by personal material benefit.



A Dissociation Between Moral Judgments and Justifications

To what extent do moral judgments depend on conscious reasoning from explicitly understood principles? We address this question by investigating one particular moral principle, the principle of the

The social dilemma of autonomous vehicles

Even though participants approve of autonomous vehicles that might sacrifice passengers to save others, respondents would prefer not to ride in such vehicles, and regulating for utilitarian algorithms may paradoxically increase casualties by postponing the adoption of a safer technology.

The weirdest people in the world?

Abstract Behavioral scientists routinely publish broad claims about human psychology and behavior in the world's top journals based on samples drawn entirely from Western, Educated, Industrialized,

Intrinsic Honesty and the Prevalence of Rule Violations across Societies

An index of the ‘prevalence of rule violations’ (PRV) based on country-level data from the year 2003 of corruption, tax evasion and fraudulent politics is developed and individual intrinsic honesty is found to be stronger in the subject pools of low PRV countries than those of highPRV countries.

Responsible Autonomy

Lead ethics theories are described and alternative ways to ensure ethical behavior by artificial systems are proposed, leading to better understanding and trust on artificial autonomous systems.

A Natural History of Human Thinking

Tool-making or culture, language or religious belief: ever since Darwin, thinkers have struggled to identify what fundamentally differentiates human beings from other animals. In this

The Righteous Mind: Why Good People Are Divided by Politics and Religion

In "The Righteous Mind", psychologist Jonathan Haidt answers some of the most compelling questions about human relationships: Why can it sometimes feel as though half the population is living in a

The Psychology of Dilemmas and the Philosophy of Morality

We review several instances where cognitive research has identified distinct psychological mechanisms for moral judgment that yield conflicting answers to moral dilemmas. In each of these cases, the

Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy

Tracing the arc of a persons life, ONeil exposes the black box models that shape the authors' future, both as individuals and as a society, in this urgent and necessary book.