Multi-agent Decision-Making Framework Based on Value Decomposition for Connected Automated Vehicles at Highway On-Ramps

被引:0
作者
Wang, Jinzhu [1 ]
Ma, Zhixiong [1 ]
Zhu, Xichan [1 ]
机构
[1] Tongji Univ, Sch Automot Studies, Shanghai, Peoples R China
来源
SAE INTERNATIONAL JOURNAL OF CONNECTED AND AUTOMATED VEHICLES | 2023年 / 6卷 / 03期
关键词
Highway on-ramp; Cooperative decision-making; Multi-agent reinforcement learning; learning; Value decomposition;
D O I
10.4271/12-06-03-0016
中图分类号
U [交通运输];
学科分类号
08 ; 0823 ;
摘要
Recognition of the necessity of connected and automated vehicles (CAVs) in transportation systems is gaining momentum. CAVs can improve the transportation network efficiency and safety by sharing information and cooperative control. This article addresses the problem of coordinating CAVs at highway on-ramps to achieve smooth traffic flow. We develop a multi-agent reinforcement learning (MARL) method based on value decomposition and centralized control to coordinate CAVs. The simulation results show that the proposed collaborative decision-making framework can effectively coordinate dynamic traffic flows and improve the metrics by more than 10% compared to the baseline methods under high traffic demand scenarios.
引用
收藏
页数:10
相关论文
共 24 条
  • [21] Heuristic Approach for Real-Time Multi-Agent Trajectory Planning Under Uncertainty
    Tahir, Haseeb
    Syed, Mujahid N.
    Baroudi, Uthman
    [J]. IEEE ACCESS, 2020, 8 : 3812 - 3826
  • [22] Wang L., 2019, IEEE INTELLIGENT TRA
  • [23] A Survey on Cooperative Longitudinal Motion Control of Multiple Connected and Automated Vehicles
    Wang, Ziran
    Bian, Yougang
    Shladover, Steven E.
    Wu, Guoyuan
    Li, Shengbo Eben
    Barth, Matthew J.
    [J]. IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2020, 12 (01) : 4 - 24
  • [24] Distributed Multiagent Coordinated Learning for Autonomous Driving in Highways Based on Dynamic Coordination Graphs
    Yu, Chao
    Wang, Xin
    Xu, Xin
    Zhang, Minjie
    Ge, Hongwei
    Ren, Jiankang
    Sun, Liang
    Chen, Bingcai
    Tan, Guozhen
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (02) : 735 - 748