DeepGAL: Intelligent Vehicle Control for Traffic Congestion Alleviation at Intersections

被引:3
作者
Cao, Miaomiao [1 ]
Li, Victor O. K. [1 ]
Shuai, Qiqi [1 ]
机构
[1] Univ Hong Kong, Dept Elect & Elect Engn, Hong Kong, Peoples R China
关键词
Adaptation models; Roads; Automobiles; Traffic congestion; Reinforcement learning; Switches; Limiting; Intersection congestion; vehicle control; deep reinforcement learning; intelligent transportation system; smart city; ECO-DRIVING CONTROL; AUTONOMOUS VEHICLES; MODEL; STATES; WAVES; FLOW;
D O I
10.1109/TITS.2023.3257199
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Intersections are prone to congestion in urban areas and making competent speed plans for vehicles to efficiently utilize green time resources is significant for congestion alleviation and driving experience improvement. The key is to increase the chance of going through green lights and avoid idling at red lights. Existing works for velocity planning fail to fully consider various realistic traffic conditions, such as interfering traffic, free lane switch, and group efficiency, thus compromising effectiveness and limiting feasibility. To address all the aforementioned issues, we propose a novel method DeepGAL for vehicle control by dividing vehicles into groups, assigning a leader in each group and delivering intelligent control on leaders with deep reinforcement learning. Extensive experiments are conducted based on two real-world datasets with distinct traffic flow rates in Hangzhou, China, and the results demonstrate that DeepGAL achieves outstanding improvement over various performance metrics applied in five classic car following models considering realistic traffic conditions. Moreover, DeepGAL outperforms four state-of-the-art baseline methods over various metrics under both light and heavy real-world traffic flows. The test of DeepGAL with indeterministic traffic-signal phase and timing (SPAT) information under an adaptive traffic signal control indicates its effectiveness even with partial SPAT information. In addition, considering the practical issue that only some of the vehicles can be controlled by our scheme, we conduct simulations on different penetration levels of controlled leader vehicles, which demonstrate that even with only 10% penetration, DeepGAL can notably alleviate congestion and enhance driving experience at intersections, validating its great feasibility.
引用
收藏
页码:6836 / 6848
页数:13
相关论文
共 44 条
  • [21] Eco-Driving of Autonomous Vehicles for Nonstop Crossing of Signalized Intersections
    Meng, Xiangyu
    Cassandras, Christos G.
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2022, 19 (01) : 320 - 331
  • [22] Trajectory Optimization of Autonomous Agents With Spatio-Temporal Constraints
    Meng, Xiangyu
    Cassandras, Christos G.
    [J]. IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2020, 7 (03): : 1571 - 1581
  • [23] Meng XY, 2018, IEEE DECIS CONTR P, P6988, DOI 10.1109/CDC.2018.8618939
  • [24] Modeling cooperative and autonomous adaptive cruise control dynamic responses using experimental data
    Milanes, Vicente
    Shladover, Steven E.
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2014, 48 : 285 - 300
  • [25] Human-level control through deep reinforcement learning
    Mnih, Volodymyr
    Kavukcuoglu, Koray
    Silver, David
    Rusu, Andrei A.
    Veness, Joel
    Bellemare, Marc G.
    Graves, Alex
    Riedmiller, Martin
    Fidjeland, Andreas K.
    Ostrovski, Georg
    Petersen, Stig
    Beattie, Charles
    Sadik, Amir
    Antonoglou, Ioannis
    King, Helen
    Kumaran, Dharshan
    Wierstra, Daan
    Legg, Shane
    Hassabis, Demis
    [J]. NATURE, 2015, 518 (7540) : 529 - 533
  • [26] Pozzi A, 2020, IEEE DECIS CONTR P, P245, DOI 10.1109/CDC42340.2020.9304005
  • [27] Delay Optimal Scheduling in a Two-Hop Vehicular Relay Network
    Ramaiyan, Venkatesh
    Altman, Eitan
    Kumar, Anurag
    [J]. MOBILE NETWORKS & APPLICATIONS, 2010, 15 (01) : 97 - 111
  • [28] An Adaptive Signal Control Scheme to Prevent Intersection Traffic Blockage
    Ren, Yilong
    Wang, Yunpeng
    Yu, Guizhen
    Liu, Henry
    Xiao, Lin
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2017, 18 (06) : 1519 - 1528
  • [29] Silva M. J. D., 2020, 132 FED U OUR PRET
  • [30] Dissipation of stop-and-go waves via control of autonomous vehicles: Field experiments
    Stern, Raphael E.
    Cui, Shumo
    Delle Monache, Maria Laura
    Bhadani, Rahul
    Bunting, Matt
    Churchill, Miles
    Hamilton, Nathaniel
    Haulcy, R'mani
    Pohlmann, Hannah
    Wu, Fangyu
    Piccoli, Benedetto
    Seibold, Benjamin
    Sprinkle, Jonathan
    Work, Daniel B.
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2018, 89 : 205 - 221