Traffic Light Control by Multiagent Reinforcement Learning Systems

@inproceedings{Bakker2010TrafficLC,
  title={Traffic Light Control by Multiagent Reinforcement Learning Systems},
  author={Bram Bakker and Shimon Whiteson and Leon Kester and Frans C. A. Groen},
  booktitle={Interactive Collaborative Information Systems},
  year={2010}
}
Traffic light control is one of the main means of controlling road traffic. [] Key Method First, the general multi-agent reinforcement learning framework is described, which is used to control traffic lights in this work.
Intelligent traffic light control using collaborative Q-Learning algorithms
TLDR
The purpose of this research is to optimize the waiting time at traffic light control based on method of collaborative Q-Learning that can be used as a reference model for the solution of traffic congestion in real world.
Comparison of Game Theoretical Strategy and Reinforcement Learning in Traffic Light Control
TLDR
An intelligent traffic model is formalized and presented to control multiple traffic light simultaneously and efficiently according to the distribution of vehicles from each incoming link according to a game theoretical framework in this paper.
Multi-agent reinforcement learning for traffic signal control
TLDR
This paper forms the TSC problem as a discounted cost Markov decision process (MDP) and applies multi-agent reinforcement learning (MARL) algorithms to obtain dynamic TSC policies and shows that these algorithms perform significantly better than both the standard fixed signal timing (FST) algorithm and the saturation balancing (SAT) algorithm over two real road networks.
STMARL: A Spatio-Temporal Multi-Agent Reinforcement Learning Approach for Cooperative Traffic Light Control
TLDR
A novel Spatio-Temporal Multi-Agent Reinforcement Learning (STMARL) framework for effectively capturing the spatio-temporal dependency of multiple related traffic lights and control these traffic lights in a coordinating way is proposed.
Deep Reinforcement Learning based Traffic Signal optimization for Multiple Intersections in ITS
  • A. Paul, S. Mitra
  • Computer Science
    2020 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS)
  • 2020
TLDR
A single DRL agent manages the traffic signal of multiple intersections using policy gradient algorithm that is trained with spatio-temporal data of the environment that allows it to perform action in different deep neural network models.
Multi-Agent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC)
TLDR
A novel, decentralized and coordinated adaptive real-time traffic signal control system using Multi-Agent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLINATSC) that aims to minimize the total vehicle delay in the traffic network.
IntelliLight: A Reinforcement Learning Approach for Intelligent Traffic Light Control
TLDR
This paper proposes a more effective deep reinforcement learning model for traffic light control and tests the method on a large-scale real traffic dataset obtained from surveillance cameras.
An Experimental Review of Reinforcement Learning Algorithms for Adaptive Traffic Signal Control
TLDR
This chapter presents a comprehensive review of the applications of RL to the traffic control problem to date, along with a case study that showcases the developing multi-agent traffic control architecture.
Deep reinforcement learning for urban traffic light control
TLDR
This work proposes to rely on the ability of deep Learning approaches to handle large input spaces, in the form of Deep Deterministic Policy Gradient (DDPG) algorithm, and performs several experiments with a range of models.
Optimised Traffic Light Management Through Reinforcement Learning: Traffic State Agnostic Agent vs. Holistic Agent With Current V2I Traffic State Knowledge
TLDR
This study designs representative Deep Reinforcement Learning agents that learn the control of multiple traffic lights without and with current traffic state information, and finds that the holistic system substantially increases average vehicle velocities and flow rates, while reducing CO2 emissions, average wait and trip times, as well as a driver stress metric.
...
...

References

SHOWING 1-10 OF 44 REFERENCES
Reinforcement Learning of Traffic Light Controllers Adapting to Traffic Congestion
TLDR
This paper describes the optimization of traffic light controllers using a multi-agent, model-based reinforcement learning or approximate real-time dynamic programming approach, and shows that this approach outperforms existing methods.
Simulation and optimization of traffic in a city
TLDR
The experimental results show that the adaptive algorithms can strongly reduce average waiting times of cars compared to three hand-designed controllers.
Reinforcement learning for true adaptive traffic signal control
TLDR
An introduction to Q-learning, a simple yet powerful reinforcement learning algorithm, is presented and a case study involving application to traffic signal control is presented, which involves optimal control of heavily congested traffic across a two-dimensional road network.
Intelligent Traffic Light Control
TLDR
This paper studies the simulation and optimization of traffic light controllers in a city and presents an adaptive optimization algorithm based on reinforcement learning that outperform other fixed controllers on all studied infrastructures.
INTELLIGENT TRAFFIC LIGHTS CONTROL BY FUZZY LOGIC
TLDR
The implementation of an intelligent traffic lights control system using fuzzy logic technology which has the capability of mimicking human intelligence for controlling traffic lights is discussed.
Adaptive traffic signal control using fuzzy logic
  • S. Chiu
  • Computer Science
    Proceedings of the Intelligent Vehicles `92 Symposium
  • 1992
Presents a distributed approach to traffic signal control, where the signal timing parameters are a given intersection are adjusted as functions of the local traffic condition and of the signal
Traffic-responsive signal timing for system-wide traffic control
  • J. Spall, D. C. Chin
  • Computer Science
    Proceedings of the 1997 American Control Conference (Cat. No.97CH36041)
  • 1997
TLDR
The approach is based on a neural network serving as the basis for the control law, with the weight estimation occurring in closed-loop mode via the simultaneous perturbation stochastic approximation (SPSA) algorithm.
Learning to Act Using Real-Time Dynamic Programming
Agent-based learning control method for urban traffic signal of single intersection
TLDR
This technique that is combined with the rules and Q_learning is applied to urban traffic area to control dynamically the traffic signals in an isolated intersection and the result indicates that the effect of the new method is better.
SIGNAL TIMING DETERMINATION USING GENETIC ALGORITHMS
TLDR
The implementation of a genetic algorithm (GA) to produce optimal or near-optimal intersection traffic signal timing strategies is described, with a focus on examining this application within a simple traffic situation, giving the reader a clear understanding of how the genetic algorithm is used.
...
...