Acquisition of Cooperative Control of Multiple Vehicles Through Reinforcement Learning Utilizing Vehicle-to-Vehicle Communication and Map Information

被引:0
|
作者
Suzuki, Tenta [1 ]
Matsuda, Kenji [1 ]
Kumagae, Kaito [1 ]
Tobisawa, Mao [1 ]
Hoshino, Junya [1 ]
Itoh, Yuki [1 ]
Harada, Tomohiro [2 ]
Matsuoka, Jyouhei [1 ]
Kagawa, Toshinori [3 ]
Hattori, Kiyohiko [1 ]
机构
[1] Tokyo Univ Technol, 1404-1 Katakuramachi, Hachioji, Tokyo 1920983, Japan
[2] Saitama Univ, 255 Shimo Okubo,Sakura Ku, Saitama, Saitama 3388570, Japan
[3] Cent Res Inst Elect Power Ind, 2-6-1 Nagasaka, Yokosuka, Kanagawa 2400196, Japan
关键词
multi-agent learning; autonomous driving; re- inforcement learning; map utilization; vehicle-to-vehicle communication;
D O I
10.20965/jrm.2024.p0642
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In recent years, extensive research has been conducted on the practical applications of autonomous driving. Much of this research relies on existing road infrastructure and aims to replace and automate human drivers. Concurrently, studies on zero -based control optimization focus on the effective use of road resources without assuming the presence of car lanes. These studies often overlook the physical constraints of vehicles in their control optimization based on reinforcement learning, leading to the learning of unrealistic control behaviors while simplifying the implementation of ranging sensors and vehicle -to -vehicle communication. Additionally, these studies do not use map information, which is widely employed in autonomous driving research. To address these issues, we constructed a simulation environment that incorporates physics simulations, realistically implements ranging sensors and vehicle -to -vehicle communication, and actively employs map information. Using this environment, we evaluated the effect of vehicle -to -vehicle communication and map information on vehicle control learning. Our experimental results show that vehicleto -vehicle communication reduces collisions, while the use of map information improves the average vehicle speed and reduces the average lap time.
引用
收藏
页码:642 / 657
页数:16
相关论文
共 50 条
  • [1] Cooperative Adaptive Cruise Control using Vehicle-to-Vehicle communication and Deep Learning
    Ke, Haoyang
    Mozaffari, Saeed
    Alirezaee, Shahpour
    Saif, Mehrdad
    2022 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2022, : 435 - 440
  • [2] Learning for Vehicle-to-Vehicle Cooperative Perception Under Lossy Communication
    Li, Jinlong
    Xu, Runsheng
    Liu, Xinyu
    Ma, Jin
    Chi, Zicheng
    Ma, Jiaqi
    Yu, Hongkai
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (04): : 2650 - 2660
  • [3] A Road Alert Information Sharing System with Multiple Vehicles Using Vehicle-to-Vehicle Communication in Various Communication
    Ito, Kenta
    Hirakawa, Go
    Arai, Yoshikazu
    Shibata, Yoshitaka
    PROCEEDINGS 2015 18TH INTERNATIONAL CONFERENCE ON NETWORK-BASED INFORMATION SYSTEMS (NBIS 2015), 2015, : 365 - 370
  • [4] LONGITUDINAL CONTROL OF A STRING OF VEHICLES USING VEHICLE-TO-VEHICLE COMMUNICATION
    TSUGAWA, S
    MURATA, S
    JOURNAL OF MECHANICAL ENGINEERING LABORATORY, 1993, 47 (02): : 38 - 46
  • [5] Supporting Multiple Cooperative Applications through Vehicle-to-Vehicle Communications
    Patrick, Sondi
    Lucas, Rivoirard
    Martine, Wahl
    2019 GLOBAL INFORMATION INFRASTRUCTURE AND NETWORKING SYMPOSIUM (GIIS), 2019,
  • [6] Path Clearance for Emergency Vehicles Through the Use of Vehicle-to-Vehicle Communication
    Jordan, Craig A.
    Cetin, Mecit
    Robinson, R. Michael
    TRANSPORTATION RESEARCH RECORD, 2013, (2381) : 45 - 53
  • [7] Safety Cruise Control of Connected Vehicles Using Radar and Vehicle-to-Vehicle Communication
    Ma, Zhikai
    Huo, Qian
    Yang, Xin
    Zhao, Xiaoshun
    IEEE SYSTEMS JOURNAL, 2020, 14 (03): : 4602 - 4613
  • [8] Stabilisation of traffic flow by considering multiple information based on vehicle-to-vehicle communication
    Li, Qian
    Wang, Haiyang
    Xie, Dongfan
    Jiang, Cailiang
    INTERNATIONAL JOURNAL OF VEHICLE DESIGN, 2023, 93 (03) : 280 - 291
  • [9] Cooperative adaptive cruise control in mixed traffic with selective use of vehicle-to-vehicle communication
    Zhang, Linjun
    IET INTELLIGENT TRANSPORT SYSTEMS, 2018, 12 (10) : 1243 - 1254
  • [10] Multiclass information flow propagation control under vehicle-to-vehicle communication environments
    Wang, Jian
    Peeta, Srinivas
    Lu, Lili
    Li, Tao
    TRANSPORTATION RESEARCH PART B-METHODOLOGICAL, 2019, 129 : 96 - 121