A Reinforcement Learning-Based Distributed Control Scheme for Cooperative Intersection Traffic Control

被引:6
作者
Guzman, Jose A. [1 ]
Pizarro, German [1 ]
Nunez, Felipe [1 ]
机构
[1] Pontificia Univ Catolica Chile, Dept Elect Engn, Santiago 7820436, Chile
关键词
Predictive models; Detectors; Real-time systems; Data models; Urban areas; Graph neural networks; Decentralized control; Reinforcement learning; cyber-physical systems; intersection control; distributed control;
D O I
10.1109/ACCESS.2023.3283218
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traffic congestion is a major source of discomfort and economic losses in urban environments. Recently, the proliferation of traffic detectors and the advances in algorithms to efficiently process data have enabled taking a data-driven approach to mitigate congestion. In this context, this work proposes a reinforcement learning (RL) based distributed control scheme that exploits cooperation among intersections. Specifically, a RL controller is synthesized, which manipulates traffic signals using information from neighboring intersections in the form of an embedding obtained from a traffic prediction application. Simulation results using SUMO show that the proposed scheme outperforms classical techniques in terms of waiting time and other key performance indices.
引用
收藏
页码:57037 / 57045
页数:9
相关论文
共 22 条
[1]  
[Anonymous], 2021, 2021 INRIX Global Traffic Scorecard
[2]   Cooperative Intersection Management: A Survey [J].
Chen, Lei ;
Englund, Cristofer .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2016, 17 (02) :570-586
[3]  
Guzman J. A., 2023, THESIS DEPT ELECT EN
[4]   A Cyberphysical System for Data-Driven Real-Time Traffic Prediction on the Las Vegas I-15 Freeway [J].
Guzman, Jose A. ;
Morris, Brendan T. ;
Nunez, Felipe .
IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2023, 15 (01) :23-35
[5]   A Cyber-Physical Systems Approach to Collaborative Intersection Management and Control [J].
Guzman, Jose A. ;
Nunez, Felipe .
IEEE ACCESS, 2021, 9 :99617-99632
[6]  
Hamilton William L., SYNTHESIS LECT ARTIF, V14, P1
[7]   Cooperative Control for Multi-Intersection Traffic Signal Based on Deep Reinforcement Learning and Imitation Learning [J].
Huo, Yusen ;
Tao, Qinghua ;
Hu, Jianming .
IEEE ACCESS, 2020, 8 :199573-199585
[8]   A biologically-inspired reinforcement learning based intelligent distributed flocking control for Multi-Agent Systems in presence of uncertain system and dynamic environment [J].
Jafari, Mohammad ;
Xu, Hao ;
Carrillo, Luis Rodolfo Garcia .
IFAC JOURNAL OF SYSTEMS AND CONTROL, 2020, 13
[9]  
Kingma DP, 2014, ADV NEUR IN, V27
[10]  
Krajzewicz D., 2012, International Journal On Advances in Systems and Measurements, V5