GAN and Multi-Agent DRL based Decentralized Traffic Light Signal Control

Author(s):  
Zixin Wang ◽  
Hanyu Zhu ◽  
Mingcheng He ◽  
Yong Zhou ◽  
Xiliang Luo ◽  
...  
Sensors ◽  
2020 ◽  
Vol 20 (15) ◽  
pp. 4291 ◽  
Author(s):  
Qiang Wu ◽  
Jianqing Wu ◽  
Jun Shen ◽  
Binbin Yong ◽  
Qingguo Zhou

With smart city infrastructures growing, the Internet of Things (IoT) has been widely used in the intelligent transportation systems (ITS). The traditional adaptive traffic signal control method based on reinforcement learning (RL) has expanded from one intersection to multiple intersections. In this paper, we propose a multi-agent auto communication (MAAC) algorithm, which is an innovative adaptive global traffic light control method based on multi-agent reinforcement learning (MARL) and an auto communication protocol in edge computing architecture. The MAAC algorithm combines multi-agent auto communication protocol with MARL, allowing an agent to communicate the learned strategies with others for achieving global optimization in traffic signal control. In addition, we present a practicable edge computing architecture for industrial deployment on IoT, considering the limitations of the capabilities of network transmission bandwidth. We demonstrate that our algorithm outperforms other methods over 17% in experiments in a real traffic simulation environment.


Current traffic regulator in remote is vehicle impelled, pre-coordinated, and webster’s technique, which produce more deferral at higher traffic. The chance of sending a keen and constant versatile traffic light regulator, which gets data from vehicles, for example, the position and speed of the vehicle, and then use this information to streamline the traffic light signal at the convergence for vehicle to vehicle(V2V) and vehicle to infrastructure(V2I) communication. The traffic board framework utilizing the AdHoc Ondemand Distance Vector (AODV) convention for VANET is sufficiently used in this work. It has been seen that practically all routes demand communication arrive at the target, a couple over significant distances with center vehicle thickness fizzled. Nonetheless, the load on the association starting from the unsophisticated transmission is gigantic. Therefore, it additionally prompts rapidly developing postponements and connection disappointment. A few trajectory answers don’t come through considering the way that telecomunication is as yet going on. This is a basic issue, particularly in city regions with high vehicle thickness. Based on the information in this paper, appropriate traffic signal control is developed to minimize the congestion at the intersections


10.29007/t895 ◽  
2018 ◽  
Author(s):  
Chaodit Aswakul ◽  
Sorawee Watarakitpaisarn ◽  
Patrachart Komolkiti ◽  
Chonti Krisanachantara ◽  
Kittiphan Techakittiroj

In this paper, Chula-Sathorn SUMO Simulator (Chula-SSS) has been proposed as an educational tool for traffic police and traffic engineers. The tool supports our framework to develop actuated traffic signal control logics in order to resolve urban traffic congestion. The framework design aims to incorporate the tacit traffic control expertise of human operators by trying to extract and extend the human-level intelligence in actuating logically traffic signal controls. In this regard, a new software package has been developed for the microscopic-mobility computer simulation capability of the SUMO (Simulation of Urban MObility) platform. Using the SUMO TraCI, our package implements the graphical user interface (GUI) of actual traffic light signal control panel, recently introduced in Bangkok (Thailand) for traffic police deployment in the Chulalongkorn University’s Sathorn Model project under the umbrella of Sustainable Mobility Project 2.0 of the World Business Council for Sustainable Development (WBCSD). The traffic light signal control panel GUI modules can communicate via TraCI in real-time to SUMO in order both to retrieve the raw traffic sensor data emulated within SUMO and to send the desired traffic light signal phase manually entered via GUI by the module users. Each of the users could play a role of traffic police in charge of actuating the traffic light signal at each of the controllable intersections. To demonstrate this framework, Chula-SSS has been implemented with the calibrated SUMO dataset of Sathorn Road network area. This area is one of the most critical areas in Bangkok due to the immense traffic volume with daily recurring traffic bottlenecks and network deadlocks. The simulation comprises of 2375 intersection nodes, 4517 edges, 10 main signalised intersections. The provided datasets with Chula-SSS cover both the morning and evening rush-hour periods each with over 55,000 simulated vehicles based on the comprehensive traffic data collection and SUMO mobility model calibration. It is hoped that the herein developed framework and software package can be not only useful for our Thailand case, but also readily extensible to those developing and least- developed countries where traffic signal controls rely on human operations, not yet fully automated by an area traffic controller. In those cases, the framework proposed herein is expectedly an enabling technology for the human operators to practice, learn, and evolve their traffic signal control strategies systematically.


Sign in / Sign up

Export Citation Format

Share Document