Multi-Agent Deep Reinforcement Learning for Large-scale Platoon Coordination with Partial Information at Hubs

被引:0
|
作者
Wei, Dixiao [1 ,2 ]
Yi, Peng [1 ,2 ]
Lei, Jinlong [1 ,2 ]
机构
[1] Tongji Univ, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
[2] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
基金
中国国家自然科学基金;
关键词
STRING STABILITY; SPACING POLICY;
D O I
10.1109/CDC49753.2023.10383216
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper considers the hub-based platoon coordination problem in a large-scale transportation network, to promote cooperation among trucks and optimize the overall efficiency of the transportation network. We design a distributed communication model for transportation networks and transform the problem into a Dec-POMDP (Decentralized-Partial Observable Markov Decision Process). We then propose an A-QMIX deep reinforcement learning algorithm to solve the problem, which adopts centralized training and distributed execution and hence provides a reliable model for trucks to make quick decisions using only partial information. Finally, we carry out experiments with 100 trucks in the transportation network of the Yangtze River Delta region in China to demonstrate the effectiveness of the proposed algorithm.
引用
收藏
页码:6242 / 6248
页数:7
相关论文
共 50 条
  • [21] Mix-attention approximation for homogeneous large-scale multi-agent reinforcement learning
    Yang Shike
    Li Jingchen
    Shi Haobin
    Neural Computing and Applications, 2023, 35 : 3143 - 3154
  • [22] Simulation Platform for Large-scale Multi-agent Team Coordination
    Xu Yang
    Li Xiang
    Tan Ruochen
    Chen Zheng
    PROCEEDINGS OF THE 31ST CHINESE CONTROL CONFERENCE, 2012, : 6467 - 6471
  • [23] A Coordination Mechanism to Replicate Large-Scale Multi-Agent Systems
    Ductor, Sylvain
    Guessoum, Zahia
    2018 IEEE/ACM 13TH INTERNATIONAL SYMPOSIUM ON SOFTWARE ENGINEERING FOR ADAPTIVE AND SELF-MANAGING SYSTEMS (SEAMS), 2018, : 130 - 136
  • [24] Evolutionary reinforcement learning algorithm for large-scale multi-agent cooperation and confrontation applications
    Haiying Liu
    ZhiHao Li
    Kuihua Huang
    Rui Wang
    Guangquan Cheng
    Tiexiang Li
    The Journal of Supercomputing, 2024, 80 : 2319 - 2346
  • [25] A Weighted Mean Field Reinforcement Learning Algorithm for Large-Scale Multi-Agent Collaboration
    Xinwei Yuan
    He Wang
    Wenwu Yu
    Guidance,Navigation and Control, 2023, (02) : 42 - 60
  • [26] Pacesetter Learning for Large Scale Cooperative Multi-Agent Reinforcement Learning
    Zhou, Pingqi
    Li, Chao
    Qiu, Mengwei
    Liu, Jun
    Ma, Chennan
    Yan, Ming
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VI, 2023, 14259 : 115 - 126
  • [27] A multi-agent deep reinforcement learning approach for traffic signal coordination
    Hu, Ta-Yin
    Li, Zhuo-Yu
    IET INTELLIGENT TRANSPORT SYSTEMS, 2024, 18 (08) : 1428 - 1444
  • [28] Distributed interference coordination based on multi-agent deep reinforcement learning
    Liu T.
    Luo Y.
    Yang C.
    Tongxin Xuebao/Journal on Communications, 2020, 41 (07): : 38 - 48
  • [29] Asynchronous multi-agent deep reinforcement learning under partial observability
    Xiao, Yuchen
    Tan, Weihao
    Hoffman, Joshua
    Xia, Tian
    Amato, Christopher
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2025,
  • [30] Coordination as inference in multi-agent reinforcement learning
    Li, Zhiyuan
    Wu, Lijun
    Su, Kaile
    Wu, Wei
    Jing, Yulin
    Wu, Tong
    Duan, Weiwei
    Yue, Xiaofeng
    Tong, Xiyi
    Han, Yizhou
    NEURAL NETWORKS, 2024, 172