The social dilemma of autonomous vehicles

@article{Bonnefon2016TheSD,
  title={The social dilemma of autonomous vehicles},
  author={Jean-François Bonnefon and Azim F Shariff and Iyad Rahwan},
  journal={Science},
  year={2016},
  volume={352},
  pages={1573 - 1576}
}
Codes of conduct in autonomous vehicles When it becomes possible to program decision-making based on moral principles into machines, will self-interest or the public good predominate? In a series of surveys, Bonnefon et al. found that even though participants approve of autonomous vehicles that might sacrifice passengers to save others, respondents would prefer not to ride in such vehicles (see the Perspective by Greene). Respondents would also not approve regulations mandating self-sacrifice… Expand
View on AAAS
escholarship.org
722 Citations
Highly Influential Citations
28
Background Citations
231
Methods Citations
12
Results Citations
14

722 Citations

Citation Type

Citation Type

Autonomous vehicles: Willingness to pay and the social dilemma
Abstract Autonomous driving technologies are advancing rapidly, and determining when consumers ride in driverless vehicles on a daily basis is becoming essential. Using choice experiments, first, we… Expand
How Should Autonomous Vehicles Redistribute the Risks of the Road?
If this expectation materializes, there are strong reasons to favor replacing human-driven vehicles with autonomous ones. The advent of autonomous vehicles, however, likely will be gradual, with the… Expand
Reply to: Life and death decisions of autonomous vehicles
TLDR
The results challenge the idea that people want autonomous vehicles to treat different human lives unequally, revealing that this apparent preference for inequality is driven by the specific ‘trolley-type’ paradigm used by the Moral Machine experiment. Expand
Hurting Others vs. Hurting Myself, a Dilemma for our Autonomous Vehicle
Autonomous Vehicles (AVs) will soon be a reality on our roads. Up to now, their standard behaviour is predetermined since it is the result of programmed algorithms. Under risky traffic situations,… Expand
Autonomous Vehicles Require Socio-Political Acceptance—An Empirical and Philosophical Perspective on the Problem of Moral Decision Making
TLDR
What factors people recognize as relevant in driving situations are investigated and subjects showed a surprisingly high willingness to sacrifice themselves to save others, took the age of potential victims in a crash into consideration and were willing to swerve onto a sidewalk if this saved more lives. Expand
Life and death decisions of autonomous vehicles
TLDR
The results challenge the idea that people want autonomous vehicles to treat different human lives unequally, revealing that this apparent preference for inequality is driven by the specific ‘trolley-type’ paradigm used by the Moral Machine experiment. Expand
Our driverless dilemma
TLDR
It is shown that people generally approve of cars programmed to minimize the total amount of harm, even at the expense of their passengers, but are not enthusiastic about riding in such “utilitarian” cars—that is, autonomous vehicles that are, in certain emergency situations, programmed to sacrifice their passengers for the greater good. Expand
Human Decisions in Moral Dilemmas are Largely Described by Utilitarianism: Virtual Car Driving Study Provides Guidelines for Autonomous Driving Vehicles
TLDR
It will be argued for an obligatory ethics setting implemented in ADVs after a set of experiments in which participants experienced modified trolley dilemmas as drivers in virtual reality environments showed that participants, in general, decided in a utilitarian manner. Expand
Ethical Decision Making in Autonomous Vehicles: The AV Ethics Project
TLDR
The Ethical Valence Theory is proposed, which paints AV decision-making as a type of claim mitigation: different road users hold different moral claims on the vehicle’s behavior, and the vehicle must mitigate these claims as it makes decisions about its environment. Expand
Risk of Injury in Moral Dilemmas With Autonomous Vehicles
TLDR
Experimental work is presented that systematically studies the effect of risk of injury on the decisions people make in moral dilemmas and finds significant evidence of utilitarianism. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 34 REFERENCES
Moral Machines: Teaching Robots Right from Wrong
Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military… Expand
Products Liability and Driverless Cars: Issues and Guiding Principles for Legislation
Executive Summary As driverless cars—or more formally, autonomous vehicles—continue to attract growing interest and investment, the associated liability issues are also getting increased attention.… Expand
Autonomous driving in urban environments: Boss and the Urban Challenge
Boss is an autonomous vehicle that uses on-board sensors (global positioning system, lasers, radars, and cameras) to track other vehicles, detect static obstacles, and localize itself relative to a… Expand
Toward a Systematic Approach to the Design and Evaluation of Automated Mobility-on-Demand Systems: A Case Study in Singapore
The objective of this work is to provide analytical guidelines and financial justification for the design of shared-vehicle mobility-on-demand systems. Specifically, we consider the fundamental issue… Expand
For whom do the ends justify the means? Social class and utilitarian moral judgment.
Though scholars have speculated for centuries on links between individuals' social class standing and approach to moral reasoning, little systematic research exists on how class and morality are… Expand
The Social Dilemmas
"For that which is common to the greatest number has the least care bestowed upon it. Every one thinks chiefly of his own, hardly at all of the common interest; and only when he is himself concerned… Expand
Machines without Principals: Liability Rules and Artificial Intelligence
INTRODUCTIONThe idea that humans could, at some point, develop machines that actually "think" for themselves and act autonomously has been embedded in our literature and culture since the beginning… Expand
Inference of trustworthiness from intuitive moral judgments.
Moral judgments play a critical role in motivating and enforcing human cooperation, and research on the proximate mechanisms of moral judgments highlights the importance of intuitive, automatic… Expand
Inference of trustworthiness from intuitive moral judgments.
Moral judgments play a critical role in motivating and enforcing human cooperation, and research on the proximate mechanisms of moral judgments highlights the importance of intuitive, automatic… Expand
Cultural differences in responses to real-life and hypothetical trolley problems
Trolley problems have been used in the development of moral theory and the psychological study of moral judgments and behavior. Most of this research has focused on people from the West, with… Expand
...
1
2
3
4
...