Cooperation-Aware Reinforcement Learning for Merging in Dense Traffic

@article{Bouton2019CooperationAwareRL,
  title={Cooperation-Aware Reinforcement Learning for Merging in Dense Traffic},
  author={Maxime Bouton and Alireza Nakhaei and Kikuo Fujimura and Mykel J. Kochenderfer},
  journal={2019 IEEE Intelligent Transportation Systems Conference (ITSC)},
  year={2019},
  pages={3441-3447}
}
Decision making in dense traffic can be challenging for autonomous vehicles. [...] Key Method We enhanced the performance of traditional reinforcement learning algorithms by maintaining a belief over the level of cooperation of other drivers. We show that our agent successfully learns how to navigate a dense merging scenario with less deadlocks than with online planning methods.Expand
Reinforcement Learning with Iterative Reasoning for Merging in Dense Traffic
TLDR
This work proposes a combination of reinforcement learning and game theory to learn merging behaviors, and designs a training curriculum for a reinforcement learning agent using the concept of level-k behavior. Expand
Learning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarios
TLDR
This paper proposes to learn, via deep Reinforcement Learning (RL), an interaction-aware policy providing global guidance about the cooperativeness of other vehicles to an optimization-based planner ensuring safety and kinematic feasibility through constraint satisfaction. Expand
Learning Highway Ramp Merging Via Reinforcement Learning with Temporally-Extended Actions
TLDR
This work applies a hierarchical approach to decision-making, where it train a high-level policy using reinforcement learning, and executes the policy's output on a low-level controller, which helps increase thepolicy's overall safety, and allows the learning component to be agnostic to the low- level control scheme. Expand
High-level Decisions from a Safe Maneuver Catalog with Reinforcement Learning for Safe and Cooperative Automated Merging
  • Danial Kamran, Yu Ren, Martin Lauer
  • Computer Science
  • 2021 IEEE International Intelligent Transportation Systems Conference (ITSC)
  • 2021
TLDR
An efficient RL-based decision-making pipeline for safe and cooperative automated driving in merging scenarios that can efficiently identify cooperative drivers from their vehicle state history and generate interactive maneuvers, resulting in faster and more comfortable automated driving. Expand
Deep Multi-agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic
TLDR
An efficient and scalable MARL framework that can be used in dynamic traffic where the communication topology could be time-varying and exploit curriculum learning to efficiently learn harder tasks from trained models under simpler settings is developed. Expand
Cooperation-Aware Lane Change Maneuver in Dense Traffic based on Model Predictive Control with Recurrent Neural Network
TLDR
This paper proposes a mathematical control framework based on Model Predictive Control (MPC) encompassing a state-of-the-art Recurrent Neural network (RNN) architecture that predicts interactive motions of other drivers in response to potential actions of the autonomous vehicle, which are then systematically evaluated in safety constraints. Expand
Decision-Making and Control for Freeway On-Ramp Merging Using Deep Reinforcement Learning
TLDR
Analysis of the merging vehicle's behaviors found that it learned human-like behaviors such as slowing down to merge behind or speeding up to merge ahead a main-road vehicle, suggesting that it might be trapped at a bifurcation state. Expand
Finding the Value of Aggressiveness in Autonomous Vehicles
This project involves modeling a lane-changing process of an autonomous vehicle among simulated human-driven vehicles, in which the autonomous vehicle learns a state-action mapping via deepExpand
Combining Reinforcement Learning with Model Predictive Control for On-Ramp Merging
TLDR
An algorithm is presented which blends the model-free RL agent with the MPC solution and shows that it provides better tradeoffs between all metrics - passenger comfort, efficiency, crash rate and robustness. Expand
Cooperation-Aware Lane Change Control in Dense Traffic
This paper presents a real-time lane change control framework of autonomous driving in dense traffic, which exploits cooperative behaviors of human drivers. This paper especially focuses on heavyExpand
...
1
2
3
...

References

SHOWING 1-10 OF 37 REFERENCES
Interaction-aware Decision Making with Adaptive Strategies under Merging Scenarios
TLDR
An interaction-aware decision making with adaptive strategies (IDAS) approach that can let the autonomous vehicle negotiate the road with other drivers by leveraging their cooperativeness under merging scenarios is proposed. Expand
A Reinforcement Learning Based Approach for Automated Lane Change Maneuvers
TLDR
This study proposed a Reinforcement Learning based approach to train the vehicle agent to learn an automated lane change behavior such that it can intelligently make a lane change under diverse and even unforeseen scenarios. Expand
Safe Reinforcement Learning with Scene Decomposition for Navigating Complex Urban Environments
TLDR
This work proposes a modular decision making algorithm to autonomously navigate intersections, addressing challenges of existing rule-based and reinforcement learning (RL) approaches, and introduces a belief update technique using a learning based approach. Expand
A Belief State Planner for Interactive Merge Maneuvers in Congested Traffic
TLDR
A novel motion model representing the uncertain cooperation of other drivers is presented based on a logistic regression model estimating the probability for cooperative behavior of a human driver given a future scene. Expand
Probabilistic Model for Interaction Aware Planning in Merge Scenarios
TLDR
A probabilistic model is presented that explicitly models interaction between vehicles and allows for evaluating the utility of a large number of candidate trajectories of an autonomous vehicle using a receding horizon approach in order to select an appropriate merge maneuver. Expand
Collaborative Planning for Mixed-Autonomy Lane Merging
TLDR
A planning framework where the degree to which the AV considers the other agent's reward is controlled by a selfishness factor is proposed, suggesting it to be a non-zero-sum game and encouraging further investigation on collaborative decision making algorithms for mixed-autonomy traffic. Expand
Intention estimation for ramp merging control in autonomous driving
TLDR
This paper presents a novel learning-based method to efficiently estimate other vehicles' intentions and interact with them in ramp merging scenarios, without over-the-air communication between vehicles. Expand
Hierarchical Game-Theoretic Planning for Autonomous Vehicles
TLDR
This paper introduces a novel game-theoretic trajectory planning algorithm for autonomous driving that enables real-time performance by hierarchically decomposing the underlying dynamic game into a long-horizon “strategic” game with simplified dynamics and full information structure, and a short-Horizon ‘tactical’ game with full dynamics and a simplified information structure. Expand
Planning for Autonomous Cars that Leverage Effects on Human Actions
TLDR
The user study results suggest that the robot is indeed capable of eliciting desired changes in human state by planning using this dynamical system, in which the robot’s actions have immediate consequences on the state of the car, but also on human actions. Expand
Unfreezing the robot: Navigation in dense, interacting crowds
TLDR
IGP is developed, a nonparametric statistical model based on dependent output Gaussian processes that can estimate crowd interaction from data that naturally captures the non-Markov nature of agent trajectories, as well as their goal-driven navigation. Expand
...
1
2
3
4
...