MARP: A Cooperative Multiagent DRL System for Connected Autonomous Vehicle Platooning

被引:8
作者
Dai, Shuhong [1 ,2 ]
Li, Shike [3 ]
Tang, Haichuan [4 ]
Ning, Xin [5 ]
Fang, Fang [1 ,2 ]
Fu, Yunxiao [4 ]
Wang, Qingle [2 ]
Cheng, Long [1 ,2 ]
机构
[1] North China Elect Power Univ, State Key Lab Alternate Elect Power Syst Renewble, Beijing 100096, Peoples R China
[2] North China Elect Power Univ, Sch Control & Comp Engn, Beijing 100096, Peoples R China
[3] Shanxi Univ, Sch Comp & Informat Technol, Taiyuan 030006, Peoples R China
[4] CRRC Acad, AI Lab, Beijing 100078, Peoples R China
[5] Chinese Acad Sci, Inst Semicond, AnnLab, Beijing 100083, Peoples R China
关键词
Real-time systems; Vehicle dynamics; Sensors; Fuels; Multi-agent systems; Autonomous vehicles; Velocity control; Cooperative control; deep reinforcement learning (DRL); mixed traffic; multiagent system; vehicle platooning; SIGNAL CONTROL;
D O I
10.1109/JIOT.2024.3432119
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In modern urban areas, inefficiency traffic management is one of the main causes of road congestion, leading to reduced fuel efficiency and increased traffic safety hazards. Traditional researches typically focus only on enhancing the throughput of intersections by optimizing traffic signals or individual vehicle trajectories. However, these methods often overlook the dynamic nature of the traffic system and the potential benefits of vehicle platooning, limiting their effectiveness in complex traffic environments. Addressing this challenge, this article presents MARP, a Cooperative Multiagent deep reinforcement learning (DRL) System for connected autonomous vehicle (CAV) Platooning. Utilizing vehicle to vehicle (V2I) and vehicles to infrastructure (V2V) technologies, MARP integrates sensing, computing, and communication to collect and process real-time data on traffic conditions, thereby achieving dynamic synchronization between traffic signal controllers and CAV platoons. By constructing platoons that collaborates with the infrastructure through a multiagent DRL collaboration model, MARP adapts to real-time traffic flow changes, significantly optimizing the fluidity and efficiency of the entire traffic network. Detailed experiments show that MARP effectively reduces traffic congestion, shortens intersection travel times, and cuts fuel consumption and emissions, surpassing the state-of-the-art approach.
引用
收藏
页码:32454 / 32463
页数:10
相关论文
共 31 条
[1]   Deep Reinforcement Learning for Efficient IoT Data Compression in Smart Railroad Management [J].
Chen, Xuan ;
Yu, Qixuan ;
Dai, Shuhong ;
Sun, Pengfei ;
Tang, Haichuan ;
Cheng, Long .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (15) :25494-25504
[2]   Coupling Control of Traffic Signal and Entry Lane at Isolated Intersections Under the Mixed-Autonomy Traffic Environment [J].
Dai, Rongjian ;
Ding, Chuan ;
Wu, Xinkai ;
Yu, Bin ;
Lu, Guangquan .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (10) :10628-10642
[3]  
de Souza AM, 2018, VEH TECHNOL CONFE
[4]   A comprehensive review of machine learning and IoT solutions for demand side energy management, conservation, and resilient operation [J].
Elsisi, Mahmoud ;
Amer, Mohammed ;
Dababat, Alya ;
Su, Chun-Lien .
ENERGY, 2023, 281
[5]   A Taxonomy of Signal Vehicle Coupled Control from a Mathematical Programming Perspective [J].
Ghosh, Arka ;
Angarita-Zapata, Juan S. ;
Masegosa, Antonio D. ;
Laresgoiti, Ander Arriandiaga .
2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, :5597-5602
[6]   Using connected vehicle technology to improve the efficiency of intersections [J].
Guler, S. Ilgin ;
Menendez, Monica ;
Meier, Linus .
TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2014, 46 :121-131
[7]   CoTV: Cooperative Control for Traffic Light Signals and Connected Autonomous Vehicles Using Deep Reinforcement Learning [J].
Guo, Jiaying ;
Cheng, Long ;
Wang, Shen .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (10) :10501-10512
[8]   Deep Reinforcement Learning for Intelligent Transportation Systems: A Survey [J].
Haydari, Ammar ;
Yilmaz, Yasin .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (01) :11-32
[9]   Multi-modal traffic signal control with priority, signal actuation and coordination [J].
He, Qing ;
Head, K. Larry ;
Ding, Jun .
TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2014, 46 :65-82
[10]   PAMSCOD: Platoon-based arterial multi-modal signal control with online data [J].
He, Qing ;
Head, K. Larry ;
Ding, Jun .
TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2012, 20 (01) :164-184