A Collaborative Control Scheme for Smart Vehicles Based on Multi-Agent Deep Reinforcement Learning

被引:1
|
作者
Shi, Liyan [1 ]
Chen, Hairui [2 ]
机构
[1] Open Univ Henan, Sch Informat Engn & Artificial Intelligence, Zhengzhou 450046, Peoples R China
[2] Zhongyuan Univ Technol, Zhongyuan Petersburg Aviat Coll, Zhengzhou 450007, Peoples R China
关键词
Reinforcement learning; Control systems; Adaptation models; Roads; Optimization; Vehicle dynamics; Heuristic algorithms; Intelligent transportation systems; Collaborative control; smart vehicles; deep reinforcement learning; intelligent transportation systems; EDGE; SECURITY; INTERNET;
D O I
10.1109/ACCESS.2023.3312021
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of artificial intelligence and autonomous driving technology, the vehicle-road cooperative control system combined with artificial intelligence technology can provide more effective and adaptive traffic control solutions for intelligent transportation systems. Existing research works are confronted with two kinds of challenges. For one thing, traditional recurrent neural networks-based methods cannot model the long-time dependent information in traffic flow sequences. For another, the large sample correlation makes it difficult to optimize the trained strategies. In this paper, we propose a Multi-agent Deep Reinforcement Learning (MADRL)-based intelligent vehicle cooperative control method to deal remedy current gaps. To this end, a closed-loop control system of self-driving vehicles and signal controllers is used as the research object to achieve dynamic scheduling of traffic flow by MADRL. After designing relevant experimental validation, the feasibility of the method is verified in terms of both scheme comparison and operational effect analysis, which is a good aid to traffic signal timing. The simulation results show that the proposal can be well utilized to realize collaborative control of smart vehicles, and there is some performance improvement compared with several typical methods.
引用
收藏
页码:96221 / 96234
页数:14
相关论文
共 50 条
  • [31] Multi-agent deep reinforcement learning: a survey
    Gronauer, Sven
    Diepold, Klaus
    ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (02) : 895 - 943
  • [32] Constraint-based multi-agent reinforcement learning for collaborative tasks
    Shang, Xiumin
    Xu, Tengyu
    Karamouzas, Ioannis
    Kallmann, Marcelo
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2023, 34 (3-4)
  • [33] Deep reinforcement learning for multi-agent interaction
    Ahmed, Ibrahim H.
    Brewitt, Cillian
    Carlucho, Ignacio
    Christianos, Filippos
    Dunion, Mhairi
    Fosong, Elliot
    Garcin, Samuel
    Guo, Shangmin
    Gyevnar, Balint
    McInroe, Trevor
    Papoudakis, Georgios
    Rahman, Arrasy
    Schafer, Lukas
    Tamborski, Massimiliano
    Vecchio, Giuseppe
    Wang, Cheng
    Albrecht, Stefano, V
    AI COMMUNICATIONS, 2022, 35 (04) : 357 - 368
  • [34] Communicate with Traffic Lights and Vehicles Based on Multi-Agent Reinforcement Learning
    Wu, Qiang
    Zhi, Peng
    Wei, Yongqiang
    Zhang, Liang
    Wu, Jianqing
    Zhou, Qingguo
    Zhou, Qiang
    Gao, Pengfei
    PROCEEDINGS OF THE 2021 IEEE 24TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2021, : 843 - 848
  • [35] Multi-agent deep reinforcement learning: a survey
    Sven Gronauer
    Klaus Diepold
    Artificial Intelligence Review, 2022, 55 : 895 - 943
  • [36] Heuristic-Based Multi-Agent Deep Reinforcement Learning Approach for Coordinating Connected and Automated Vehicles at Non-Signalized Intersection
    Guo, Zihan
    Wu, Yan
    Wang, Lifang
    Zhang, Junzhi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (11) : 16235 - 16248
  • [37] Multi-Agent Deep Reinforcement Learning-Based Resource Allocation for Cognitive Radio Networks
    Mei, Ruru
    Wang, Zhugang
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2025, 74 (03) : 4744 - 4757
  • [38] Multi-agent deep reinforcement learning based Predictive Maintenance on parallel machines
    Rodriguez, Marcelo Luis Ruiz
    Kubler, Sylvain
    de Giorgio, Andrea
    Cordy, Maxime
    Robert, Jeremy
    Le Traon, Yves
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 78
  • [39] Multi-Agent Deep Reinforcement Learning Based Downlink Beamforming in Heterogeneous Networks
    Zhang, Zitian
    Hou, Jinbo
    Chu, Xiaoli
    Zhou, Haibo
    Wei, Guiyi
    Zhang, Jie
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (06) : 4247 - 4263
  • [40] Multi-Agent Deep Reinforcement Learning-Based Flexible Satellite Payload for Mobile Terminals
    Hu, Xin
    Liao, Xianglai
    Liu, Zhijun
    Liu, Shuaijun
    Ding, Xin
    Helaoui, Mohamed
    Wang, Weidong
    Ghannouchi, Fadhel M.
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (09) : 9849 - 9865