Multi-Agent Deep Reinforcement Learning for Large-scale Platoon Coordination with Partial Information at Hubs

被引:0
|
作者
Wei, Dixiao [1 ,2 ]
Yi, Peng [1 ,2 ]
Lei, Jinlong [1 ,2 ]
机构
[1] Tongji Univ, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
[2] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
基金
中国国家自然科学基金;
关键词
STRING STABILITY; SPACING POLICY;
D O I
10.1109/CDC49753.2023.10383216
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper considers the hub-based platoon coordination problem in a large-scale transportation network, to promote cooperation among trucks and optimize the overall efficiency of the transportation network. We design a distributed communication model for transportation networks and transform the problem into a Dec-POMDP (Decentralized-Partial Observable Markov Decision Process). We then propose an A-QMIX deep reinforcement learning algorithm to solve the problem, which adopts centralized training and distributed execution and hence provides a reliable model for trucks to make quick decisions using only partial information. Finally, we carry out experiments with 100 trucks in the transportation network of the Yangtze River Delta region in China to demonstrate the effectiveness of the proposed algorithm.
引用
收藏
页码:6242 / 6248
页数:7
相关论文
共 50 条
  • [41] Hierarchical resource usage coordination for large-scale multi-agent systems
    Jamali, N
    Zhao, XH
    MASSIVELY MULTI-AGENT SYSTEMS I, 2005, 3446 : 40 - 54
  • [42] Air-Ground Coordination Communication by Multi-Agent Deep Reinforcement Learning
    Ding, Ruijin
    Gao, Feifei
    Yang, Guanghua
    Shen, Xuemin Sherman
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [43] Distributed Multi-Agent Deep Reinforcement Learning for Robust Coordination against Noise
    Motokawa, Yoshinari
    Sugawara, Toshiharu
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [44] Promoting Coordination through Policy Regularization in Multi-Agent Deep Reinforcement Learning
    Roy, Julien
    Barde, Paul
    Harvey, Felix G.
    Nowrouzezahrai, Derek
    Pal, Christopher
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [45] Multi-agent Coordination using Reinforcement Learning with a Relay Agent
    Zemzem, Wiem
    Tagina, Moncef
    ICEIS: PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS - VOL 1, 2017, : 537 - 545
  • [46] HALFTONING WITH MULTI-AGENT DEEP REINFORCEMENT LEARNING
    Jiang, Haitian
    Xiong, Dongliang
    Jiang, Xiaowen
    Yin, Aiguo
    Ding, Li
    Huang, Kai
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 641 - 645
  • [47] Deep reinforcement learning for multi-agent interaction
    Ahmed, Ibrahim H.
    Brewitt, Cillian
    Carlucho, Ignacio
    Christianos, Filippos
    Dunion, Mhairi
    Fosong, Elliot
    Garcin, Samuel
    Guo, Shangmin
    Gyevnar, Balint
    McInroe, Trevor
    Papoudakis, Georgios
    Rahman, Arrasy
    Schafer, Lukas
    Tamborski, Massimiliano
    Vecchio, Giuseppe
    Wang, Cheng
    Albrecht, Stefano, V
    AI COMMUNICATIONS, 2022, 35 (04) : 357 - 368
  • [48] Multi-agent deep reinforcement learning: a survey
    Sven Gronauer
    Klaus Diepold
    Artificial Intelligence Review, 2022, 55 : 895 - 943
  • [49] Deep Multi-Agent Reinforcement Learning: A Survey
    Liang X.-X.
    Feng Y.-H.
    Ma Y.
    Cheng G.-Q.
    Huang J.-C.
    Wang Q.
    Zhou Y.-Z.
    Liu Z.
    Zidonghua Xuebao/Acta Automatica Sinica, 2020, 46 (12): : 2537 - 2557
  • [50] Lenient Multi-Agent Deep Reinforcement Learning
    Palmer, Gregory
    Tuyls, Karl
    Bloembergen, Daan
    Savani, Rahul
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS (AAMAS' 18), 2018, : 443 - 451