• Corpus ID: 237513888

Back to Basics: Deep Reinforcement Learning in Traffic Signal Control

  title={Back to Basics: Deep Reinforcement Learning in Traffic Signal Control},
  author={Sierk Kanis and Laurens Samson and Daan Bloembergen and Tim Bakker},
In this paper we revisit some of the fundamental premises for a reinforcement learning (RL) approach to self-learning traffic lights. We propose RLight, a combination of choices that offers robust performance and good generalization to unseen traffic flows. In particular, ourmain contributions are threefold: our lightweight and cluster-aware state representation leads to improved performance; we reformulate the Markov Decision Process (MDP) such that it skips redundant timesteps of yellow light… 

Figures and Tables from this paper


Diagnosing Reinforcement Learning for Traffic Signal Control
The proposed method LIT has a very simple state and reward design, thus can serve as a building block for future RL approaches to traffic signal control and significantly outperforms the state-of-the-art traffic sign control methods.
Toward A Thousand Lights: Decentralized Deep Reinforcement Learning for Large-Scale Traffic Signal Control
This paper tackles the problem of multi-intersection traffic signal control, especially for large-scale networks, based on RL techniques and transportation theories and shows that implicit coordination could be achieved by individual control agents with well-crafted reward design thus reducing the dimensionality.
A Deep Reinforcement Learning Network for Traffic Light Cycle Control
A deep reinforcement learning model is proposed to control the traffic light cycle that incorporates multiple optimization elements to improve the performance, such as dueling network, target network, double Q-learning network, and prioritized experience replay.
Coordinated Deep Reinforcement Learners for Traffic Light Control
The combination of the popular Deep Q-learning algorithm with a coordination algorithm for a scalable approach to controlling coordinating traffic lights, without requiring the simplifying assumptions made in earlier work is proposed.
IntelliLight: A Reinforcement Learning Approach for Intelligent Traffic Light Control
This paper proposes a more effective deep reinforcement learning model for traffic light control and tests the method on a large-scale real traffic dataset obtained from surveillance cameras.
Deep Reinforcement Learning for Intelligent Transportation Systems: A Survey
This survey extensively summarizes existing works in this field by categorizing them with respect to application types, control models and studied algorithms and discusses the challenges and open questions regarding deep RL-based transportation applications.
Continuous control with deep reinforcement learning
This work presents an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action spaces, and demonstrates that for many of the tasks the algorithm can learn policies end-to-end: directly from raw pixel inputs.
An Experimental Review of Reinforcement Learning Algorithms for Adaptive Traffic Signal Control
This chapter presents a comprehensive review of the applications of RL to the traffic control problem to date, along with a case study that showcases the developing multi-agent traffic control architecture.
A survey and critique of multiagent deep reinforcement learning
A clear overview of current multiagent deep reinforcement learning (MDRL) literature is provided to help unify and motivate future research to take advantage of the abundant literature that exists in a joint effort to promote fruitful research in the multiagent community.
CoLight: Learning Network-level Cooperation for Traffic Signal Control
The proposed model, CoLight, is the first to use graph attentional networks in the setting of reinforcement learning for traffic signal control and to conduct experiments on the large-scale road network with hundreds of traffic signals.