Emergence of Cooperative Automated Driving Control at Roundabouts Using Deep Reinforcement Learning

被引:1
|
作者
Nakaya, Reo [1 ]
Harada, Tomohiro [2 ]
Miura, Yukiya [2 ]
Hattori, Kiyohiko [3 ]
Matsuoka, Johei [3 ]
机构
[1] Tokyo Metropolitan Univ, Grad Sch Syst Design, Tokyo, Japan
[2] Tokyo Metropolitan Univ, Fac Syst Design, Tokyo, Japan
[3] Tokyo Univ Technol, Fac Comp Sci, Tokyo, Japan
来源
2023 62ND ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS, SICE | 2023年
关键词
deep reinforcement learning; automated driving; cooperative control; roundabout; multi-agent system;
D O I
10.23919/SICE59929.2023.10354212
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study proposes a deep reinforcement learning mechanism to obtain cooperative driving control of autonomous vehicles at a roundabout, one of the intersections without signal control. This study introduces three new mechanisms to the previous model that enable learning the cooperative control: (i) gradual learning by changing the new vehicle departure interval, (ii) utilization of information about the vehicle's destination, and (iii) additional penalty for approaching walls and other vehicles. We conducted simulation experiments to investigate the effectiveness of the proposed methods. The experimental results showed that the proposed methods enable the acquisition of cooperative vehicle control that can safely navigate a roundabout while reducing the collision rate.
引用
收藏
页码:97 / 102
页数:6
相关论文
共 50 条
  • [1] Cooperative Autonomous Driving Control among Vehicles of Different Sizes Using Deep Reinforcement Learning
    Takenaka, Akito
    Harada, Tomohiro
    Miura, Yukiya
    Hattori, Kiyohiko
    Matuoka, Johei
    2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024, 2024,
  • [2] Design of Unsignalized Roundabouts Driving Policy of Autonomous Vehicles Using Deep Reinforcement Learning
    Wang, Zengrong
    Liu, Xujin
    Wu, Zhifei
    WORLD ELECTRIC VEHICLE JOURNAL, 2023, 14 (02):
  • [3] Automated eco-driving in urban scenarios using deep reinforcement learning
    Wegener, Marius
    Koch, Lucas
    Eisenbarth, Markus
    Andert, Jakob
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 126
  • [4] Connected automated vehicle cooperative control with a deep reinforcement learning approach in a mixed traffic environment
    Shi, Haotian
    Zhou, Yang
    Wu, Keshu
    Wang, Xin
    Lin, Yangxin
    Ran, Bin
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 133
  • [5] CoTV: Cooperative Control for Traffic Light Signals and Connected Autonomous Vehicles Using Deep Reinforcement Learning
    Guo, Jiaying
    Cheng, Long
    Wang, Shen
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (10) : 10501 - 10512
  • [6] Autonomous Vehicle Driving Path Control with Deep Reinforcement Learning
    Tiong, Teckchai
    Saad, Ismail
    Teo, Kenneth Tze Kin
    bin Lago, Herwansyah
    2023 IEEE 13TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE, CCWC, 2023, : 84 - 92
  • [7] Automated Penetration Testing Using Deep Reinforcement Learning
    Hu, Zhenguo
    Beuran, Razvan
    Tan, Yasuo
    2020 IEEE EUROPEAN SYMPOSIUM ON SECURITY AND PRIVACY WORKSHOPS (EUROS&PW 2020), 2020, : 2 - 10
  • [8] Lane detection for automated driving using Deep Learning
    Schmidt, Manuel
    Krueger, Martin
    Lienke, Christian
    Oeljeklaus, Malte
    Nattermann, Till
    Mohamed, Manoj
    Hoffmann, Frank
    Bertram, Torsten
    AT-AUTOMATISIERUNGSTECHNIK, 2019, 67 (10) : 866 - 878
  • [9] Decision-Making System for Lane Change Using Deep Reinforcement Learning in Connected and Automated Driving
    An, HongIl
    Jung, Jae-il
    ELECTRONICS, 2019, 8 (05):
  • [10] Comprehensive Automated Driving Maneuvers under a Non-Signalized Intersection Adopting Deep Reinforcement Learning
    Quang-Duy Tran
    Bae, Sang-Hoon
    APPLIED SCIENCES-BASEL, 2022, 12 (19):