Multi-Agent Deep Reinforcement Learning for Large-scale Platoon Coordination with Partial Information at Hubs

被引:0
|
作者
Wei, Dixiao [1 ,2 ]
Yi, Peng [1 ,2 ]
Lei, Jinlong [1 ,2 ]
机构
[1] Tongji Univ, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
[2] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
基金
中国国家自然科学基金;
关键词
STRING STABILITY; SPACING POLICY;
D O I
10.1109/CDC49753.2023.10383216
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper considers the hub-based platoon coordination problem in a large-scale transportation network, to promote cooperation among trucks and optimize the overall efficiency of the transportation network. We design a distributed communication model for transportation networks and transform the problem into a Dec-POMDP (Decentralized-Partial Observable Markov Decision Process). We then propose an A-QMIX deep reinforcement learning algorithm to solve the problem, which adopts centralized training and distributed execution and hence provides a reliable model for trucks to make quick decisions using only partial information. Finally, we carry out experiments with 100 trucks in the transportation network of the Yangtze River Delta region in China to demonstrate the effectiveness of the proposed algorithm.
引用
收藏
页码:6242 / 6248
页数:7
相关论文
共 50 条
  • [31] Large-scale multi-agent deep reinforcement learning-based coordination strategy for energy optimization and control of proton exchange membrane fuel cell
    Li, Jiawen
    Yu, Tao
    SUSTAINABLE ENERGY TECHNOLOGIES AND ASSESSMENTS, 2021, 48
  • [32] Large-Scale Traffic Signal Control Based on Integration of Adaptive Subgraph Reformulation and Multi-agent Deep Reinforcement Learning
    Gong, Kai
    Sun, Qiwei
    Zhong, Xiaofang
    Zhang, Yanhua
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT I, 2023, 14086 : 751 - 762
  • [33] Agent Coordination in Air Combat Simulation using Multi-Agent Deep Reinforcement Learning
    Kallstrom, Johan
    Heintz, Fredrik
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 2157 - 2164
  • [34] Multi-Agent Reinforcement Learning for Resource Allocation in Large-Scale Robotic Warehouse Sortation Centers
    Shen, Yi
    McClosky, Benjamin
    Durham, Joseph W.
    Zavlanos, Michael M.
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 7137 - 7143
  • [35] Large-Scale Multi-Agent Reinforcement Learning Using Image-Based State Representation
    Chu, Tianshu
    Qu, Shuhui
    Wang, Jie
    2016 IEEE 55TH CONFERENCE ON DECISION AND CONTROL (CDC), 2016, : 7592 - 7597
  • [36] Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Control
    Bokade, Rohit
    Jin, Xiaoning
    Amato, Christopher
    IEEE ACCESS, 2023, 11 : 47646 - 47658
  • [37] HELSA: Hierarchical Reinforcement Learning with Spatiotemporal Abstraction for Large-Scale Multi-Agent Path Finding
    Song, Zhaoyi
    Zhang, Rongqing
    Cheng, Xiang
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 7318 - 7325
  • [38] Coverage Optimization for Large-Scale Mobile Networks With Digital Twin and Multi-Agent Reinforcement Learning
    Liu, Haoqiang
    Li, Tong
    Jiang, Fenyu
    Su, Weikang
    Wang, Zhaocheng
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (12) : 18316 - 18330
  • [39] A representation for coordination fault detection in large-scale multi-agent systems
    Lindner, Michael
    Kalech, Meir
    Kaminka, Gal A.
    ANNALS OF MATHEMATICS AND ARTIFICIAL INTELLIGENCE, 2009, 56 (02) : 153 - 186
  • [40] A representation for coordination fault detection in large-scale multi-agent systems
    Michael Lindner
    Meir Kalech
    Gal A. Kaminka
    Annals of Mathematics and Artificial Intelligence, 2009, 56 : 153 - 186