A distributed deep reinforcement learning-based longitudinal control strategy for connected automated vehicles combining attention mechanism

被引:3
作者
Liu, Chunyu [1 ,2 ]
Sheng, Zihao [2 ]
Li, Pei [2 ]
Chen, Sikai [2 ,4 ]
Luo, Xia [3 ]
Ran, Bin [2 ]
机构
[1] Sichuan Shudao New Syst Rail Grp Co Ltd, Chengdu, Sichuan, Peoples R China
[2] Univ Wisconsin, Dept Civil & Environm Engn, Madison, WI USA
[3] Southwest Jiaotong Univ, Dept Sch Transportat & Logist, Natl United Engn Lab Integrated & Intelligent Tran, Chengdu, Sichuan, Peoples R China
[4] Univ Wisconsin, Dept Civil & Environm Engn, 1415 Engn Dr, Madison, WI 53706 USA
来源
TRANSPORTATION LETTERS-THE INTERNATIONAL JOURNAL OF TRANSPORTATION RESEARCH | 2025年 / 17卷 / 02期
关键词
Connected automated vehicle; Attention mechanism; Deep reinforcement learning; Longitudinal control; Car-following behavior; MODEL-PREDICTIVE CONTROL; COOPERATIVE CONTROL; OPTIMIZATION; STABILITY; INTERSECTION; DESIGN; SPEED;
D O I
10.1080/19427867.2024.2335084
中图分类号
U [交通运输];
学科分类号
08 ; 0823 ;
摘要
With the rapid development of connected automated vehicles (CAVs), the trajectory control of CAVs has become a focus in traffic engineering. This paper proposes a distributed deep reinforcement learning-based longitudinal control strategy for CAVs combining attention mechanism, which enhances the stability of mixed traffic, car-following efficiency, energy efficiency, and safety. A longitudinal control strategy is built using a deep reinforcement learning model. The CAVs gradually learn optimal car-following strategy in training process to improve safety, stability, fuel economy, mobility, and driving comfort. To further capture the interactions among vehicles in each platoon, the graph attention network is introduced to facilitate the car-following control strategy. To verify the effectiveness of the proposed method, a comparative analysis is conducted, which indicates that the proposed method can dramatically dampen oscillations, enhance traffic efficiency, reduce fuel consumption, and improve driving safety under different scenarios.
引用
收藏
页码:183 / 199
页数:17
相关论文
共 50 条
  • [1] Estimating vehicle fuel consumption and emissions based on instantaneous speed and acceleration levels
    Ahn, K
    Rakha, H
    Trani, A
    Van Aerde, M
    [J]. JOURNAL OF TRANSPORTATION ENGINEERING, 2002, 128 (02) : 182 - 190
  • [2] Model predictive control of transitional maneuvers for adaptive cruise control vehicles
    Baghwar, VL
    Garrard, WL
    Rajamani, R
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2004, 53 (05) : 1573 - 1585
  • [3] DYNAMICAL MODEL OF TRAFFIC CONGESTION AND NUMERICAL-SIMULATION
    BANDO, M
    HASEBE, K
    NAKAYAMA, A
    SHIBATA, A
    SUGIYAMA, Y
    [J]. PHYSICAL REVIEW E, 1995, 51 (02): : 1035 - 1042
  • [4] A Taxonomy for Autonomous Vehicles Considering Ambient Road Infrastructure
    Chen, Sikai
    Zong, Shuya
    Chen, Tiantian
    Huang, Zilin
    Chen, Yanshen
    Labi, Samuel
    [J]. SUSTAINABILITY, 2023, 15 (14)
  • [5] Graph neural network and reinforcement learning for multi-agent cooperative control of connected autonomous vehicles
    Chen, Sikai
    Dong, Jiqian
    Ha, Paul
    Li, Yujie
    Labi, Samuel
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2021, 36 (07) : 838 - 857
  • [6] Why did the AI make that decision? Towards an explainable artificial intelligence (XAI) for autonomous driving systems
    Dong, Jiqian
    Chen, Sikai
    Miralinaghi, Mohammad
    Chen, Tiantian
    Li, Pei
    Labi, Samuel
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 156
  • [7] Development and testing of an image transformer for explainable autonomous driving systems
    Dong J.
    Chen S.
    Miralinaghi M.
    Chen T.
    Labi S.
    [J]. Journal of Intelligent and Connected Vehicles, 2022, 5 (03) : 235 - 249
  • [8] Space-weighted information fusion using deep reinforcement learning: The context of tactical control of lane-changing autonomous vehicles and connectivity range assessment
    Dong, Jiqian
    Chen, Sikai
    Li, Yujie
    Du, Runjia
    Steinfeld, Aaron
    Labi, Samuel
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 128
  • [9] Dynamic urban traffic rerouting with fog-cloud reinforcement learning
    Du, Runjia
    Chen, Sikai
    Dong, Jiqian
    Chen, Tiantian
    Fu, Xiaowen
    Labi, Samuel
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2024, 39 (06) : 793 - 813
  • [10] A Cooperative Crash Avoidance Framework for Autonomous Vehicle under Collision-imminent Situations in Mixed Traffic Stream
    Du, Runjia
    Chen, Sikai
    Lia, Yujie
    Ha, Paul
    Dong, Jiqian
    Anastasopoulos, Panagiotis Ch
    Labi, Samuel
    [J]. 2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 1997 - 2002