Corpus ID: 235417486

Courteous Behavior of Automated Vehicles at Unsignalized Intersections via Reinforcement Learning

  title={Courteous Behavior of Automated Vehicles at Unsignalized Intersections via Reinforcement Learning},
  author={Shengchao Yan and Tim Welschehold and Daniel B{\"u}scher and Wolfram Burgard},
The transition from today’s mostly human-driven traffic to a purely automated one will be a gradual evolution, with the effect that we will likely experience mixed traffic in the near future. Connected and automated vehicles can benefit human-driven ones and the whole traffic system in different ways, for example by improving collision avoidance and reducing traffic waves. Many studies have been carried out to improve intersection management, a significant bottleneck in traffic, with… Expand

Figures and Tables from this paper


Multiagent traffic management: a reservation-based intersection control mechanism
  • K. Dresner, P. Stone
  • Computer Science
  • Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004.
  • 2004
This paper proposes a reservation-based system for alleviating traffic congestion, specifically at intersections, and under the assumption that the cars are controlled by agents, and specifies a precise metric for evaluating the quality of traffic control at an intersection. Expand
Sharing the Road: Autonomous Vehicles Meet Human Drivers
The modified system is able to accommodate traditional human-operated vehicles using existing infrastructure and shows that as the number of autonomous vehicles on the road increases, traffic delays decrease monotonically toward the levels exhibited in the previous work. Expand
A Multiagent Approach to Autonomous Intersection Management
This article suggests an alternative mechanism for coordinating the movement of autonomous vehicles through intersections and demonstrates in simulation that this new mechanism has the potential to significantly outperform current intersection control technology--traffic lights and stop signs. Expand
Multiagent traffic management: an improved intersection control mechanism
The prototype implementation of a reservation-based system for alleviating traffic congestion at intersections is extended in several ways, adding the ability of vehicles to turn, enabling them to accelerate while in the intersection, and augment their interaction capabilities with a detailed protocol such that the vehicles do not need to know anything about the intersection control policy. Expand
Courtesy Behavior for Highly Automated Vehicles on Highway Interchanges
A novel method that automatically adapts the driving behavior, integrating the merging intention of other vehicles is presented, which improves the aggregate traffic comfort and in addition a reduction of critical situations, as a result of applying the courtesy behavior to different planning strategies. Expand
Analysis of Cooperative Driving Strategies for Nonsignalized Intersections
Results indicate the performance of a strategy mainly depends on the passing order of vehicles that it finds, and when the traffic demand becomes high, the “planning-based” strategy yields significantly better performance since it finds better passing orders. Expand
A Protocol for Mixed Autonomous and Human-Operated Vehicles at Intersections
A new protocol, H-AIM, applicable as long as AIM is applicable and the infrastructure is able to sense approaching vehicles is introduced, that can decrease traffic delay for autonomous vehicles even at 1% technology penetration rate. Expand
Mixed-Integer Linear Programming for Optimal Scheduling of Autonomous Vehicle Intersection Crossing
An intersection control server processes data streams from approaching vehicles, periodically solves an optimization problem, and assigns to each vehicle an optimal arrival time that ensures safety while significantly reducing number of stops and intersection delays. Expand
Priority-based coordination of autonomous and legacy vehicles at intersection
This paper makes the hypothesis that legacy vehicles are able to keep a safe distance from their leading vehicles and implements the extended priority-based coordination system to support legacy vehicles without compromising above-mentioned features. Expand
Autonomous Vehicle-Intersection Coordination Method in a Connected Vehicle Environment
A buffer-assignment mechanism is developed to cooperatively assign a specific crossing span for an individual AV and guide each AV to adjust its entry time and corresponding speed in the core area to reduce travel delays and improve the sustainability of the traffic system. Expand