A Collaborative Control Scheme for Smart Vehicles Based on Multi-Agent Deep Reinforcement Learning

被引:1
|
作者
Shi, Liyan [1 ]
Chen, Hairui [2 ]
机构
[1] Open Univ Henan, Sch Informat Engn & Artificial Intelligence, Zhengzhou 450046, Peoples R China
[2] Zhongyuan Univ Technol, Zhongyuan Petersburg Aviat Coll, Zhengzhou 450007, Peoples R China
关键词
Reinforcement learning; Control systems; Adaptation models; Roads; Optimization; Vehicle dynamics; Heuristic algorithms; Intelligent transportation systems; Collaborative control; smart vehicles; deep reinforcement learning; intelligent transportation systems; EDGE; SECURITY; INTERNET;
D O I
10.1109/ACCESS.2023.3312021
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of artificial intelligence and autonomous driving technology, the vehicle-road cooperative control system combined with artificial intelligence technology can provide more effective and adaptive traffic control solutions for intelligent transportation systems. Existing research works are confronted with two kinds of challenges. For one thing, traditional recurrent neural networks-based methods cannot model the long-time dependent information in traffic flow sequences. For another, the large sample correlation makes it difficult to optimize the trained strategies. In this paper, we propose a Multi-agent Deep Reinforcement Learning (MADRL)-based intelligent vehicle cooperative control method to deal remedy current gaps. To this end, a closed-loop control system of self-driving vehicles and signal controllers is used as the research object to achieve dynamic scheduling of traffic flow by MADRL. After designing relevant experimental validation, the feasibility of the method is verified in terms of both scheme comparison and operational effect analysis, which is a good aid to traffic signal timing. The simulation results show that the proposal can be well utilized to realize collaborative control of smart vehicles, and there is some performance improvement compared with several typical methods.
引用
收藏
页码:96221 / 96234
页数:14
相关论文
共 50 条
  • [1] A Data-Driven Multi-Agent PHEVs Collaborative Charging Scheme Based on Deep Reinforcement Learning
    Huang, Shiying
    Yang, Ming
    Yun, Jiangyang
    Li, Peng
    Zhang, Qiang
    Xiang, Guangwei
    2021 IEEE IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA (IEEE I&CPS ASIA 2021), 2021, : 326 - 331
  • [2] Novel Edge Caching Approach Based on Multi-Agent Deep Reinforcement Learning for Internet of Vehicles
    Zhang, Degan
    Wang, Wenjing
    Zhang, Jie
    Zhang, Ting
    Du, Jinyu
    Yang, Chun
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (08) : 8324 - 8338
  • [3] Multi-agent Collaborative Fire Rescue Based on Deep Reinforcement Learning
    Feng, Yiming
    2022 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, BIG DATA AND ALGORITHMS (EEBDA), 2022, : 1317 - 1321
  • [4] Formation Control of Multi-agent Based on Deep Reinforcement Learning
    Pan, Chao
    Nian, Xiaohong
    Dai, Xunhua
    Wang, Haibo
    Xiong, Hongyun
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 1149 - 1159
  • [5] UAV-Enabled Collaborative Beamforming via Multi-Agent Deep Reinforcement Learning
    Liu, Saichao
    Sun, Geng
    Li, Jiahui
    Liang, Shuang
    Wu, Qingqing
    Wang, Pengfei
    Niyato, Dusit
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 13015 - 13032
  • [6] A deep reinforcement learning-based multi-agent area coverage control for smart agriculture
    Din, Ahmad
    Ismail, Muhammed Yousoof
    Shah, Babar
    Babar, Mohammad
    Ali, Farman
    Baig, Siddique Ullah
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 101
  • [7] A cooperative lateral and vertical control strategy for autonomous vehicles based on multi-agent deep reinforcement learning
    Liu, Qianjie
    Xiong, Peixiang
    Zhu, Qingyuan
    Xiao, Wei
    Li, Gang
    Hu, Guoliang
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2025,
  • [8] Collaborative Multi-Agent Reinforcement Learning Control of Parallel Robots
    Ardekani, Amirhossein Afkhami
    Masouleh, Mehdi Tale
    Yazdi, Mohammad Reza Hairi
    2022 10TH RSI INTERNATIONAL CONFERENCE ON ROBOTICS AND MECHATRONICS (ICROM), 2022, : 67 - 74
  • [9] Dynamic DNR and Solar PV Smart Inverter Control Scheme Using Heterogeneous Multi-Agent Deep Reinforcement Learning
    Lim, Se-Heon
    Yoon, Sung-Guk
    ENERGIES, 2022, 15 (23)
  • [10] Multi-Agent Collaborative Exploration through Graph-based Deep Reinforcement Learning
    Luo, Tianze
    Subagdja, Budhitama
    Wang, Di
    Tan, Ah-Hwee
    2019 IEEE INTERNATIONAL CONFERENCE ON AGENTS (ICA), 2019, : 2 - 7