Emergence of Cooperative Automated Driving Control at Roundabouts Using Deep Reinforcement Learning

被引:1
|
作者
Nakaya, Reo [1 ]
Harada, Tomohiro [2 ]
Miura, Yukiya [2 ]
Hattori, Kiyohiko [3 ]
Matsuoka, Johei [3 ]
机构
[1] Tokyo Metropolitan Univ, Grad Sch Syst Design, Tokyo, Japan
[2] Tokyo Metropolitan Univ, Fac Syst Design, Tokyo, Japan
[3] Tokyo Univ Technol, Fac Comp Sci, Tokyo, Japan
来源
2023 62ND ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS, SICE | 2023年
关键词
deep reinforcement learning; automated driving; cooperative control; roundabout; multi-agent system;
D O I
10.23919/SICE59929.2023.10354212
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study proposes a deep reinforcement learning mechanism to obtain cooperative driving control of autonomous vehicles at a roundabout, one of the intersections without signal control. This study introduces three new mechanisms to the previous model that enable learning the cooperative control: (i) gradual learning by changing the new vehicle departure interval, (ii) utilization of information about the vehicle's destination, and (iii) additional penalty for approaching walls and other vehicles. We conducted simulation experiments to investigate the effectiveness of the proposed methods. The experimental results showed that the proposed methods enable the acquisition of cooperative vehicle control that can safely navigate a roundabout while reducing the collision rate.
引用
收藏
页码:97 / 102
页数:6
相关论文
共 50 条
  • [21] Comfort-Oriented Motion Planning for Automated Vehicles Using Deep Reinforcement Learning
    Rajesh, Nishant
    Zheng, Yanggu
    Shyrokau, Barys
    IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 4 : 348 - 359
  • [22] Deep Reinforcement Learning for Autonomous Driving: A Survey
    Kiran, B. Ravi
    Sobh, Ibrahim
    Talpaert, Victor
    Mannion, Patrick
    Al Sallab, Ahmad A.
    Yogamani, Senthil
    Perez, Patrick
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) : 4909 - 4926
  • [23] A Deep Reinforcement Learning Based Hierarchical Eco-Driving Strategy for Connected and Automated HEVs
    Wu, Xiaodong
    Li, Jie
    Su, Chengrui
    Fan, Jiawei
    Xu, Min
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (11) : 13901 - 13916
  • [24] A Deep Reinforcement Learning Framework for Eco-Driving in Connected and Automated Hybrid Electric Vehicles
    Zhu, Zhaoxuan
    Gupta, Shobhit
    Gupta, Abhishek
    Canova, Marcello
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (02) : 1713 - 1725
  • [25] Dynamic metasurface control using Deep Reinforcement Learning
    Zhao, Ying
    Li, Liang
    Lanteri, Stephane
    Viquerat, Jonathan
    MATHEMATICS AND COMPUTERS IN SIMULATION, 2022, 197 : 377 - 395
  • [26] CNC machine control using deep reinforcement learning
    Kalandyk, Dawid
    Kwiatkowski, Bogdan
    Mazur, Damian
    BULLETIN OF THE POLISH ACADEMY OF SCIENCES-TECHNICAL SCIENCES, 2024, 72 (03)
  • [27] Empirical Analysis of Automated Stock Trading Using Deep Reinforcement Learning
    Kong, Minseok
    So, Jungmin
    APPLIED SCIENCES-BASEL, 2023, 13 (01):
  • [28] Trajectory Planning for Automated Parking Systems Using Deep Reinforcement Learning
    Zhuo Du
    Qiheng Miao
    Changfu Zong
    International Journal of Automotive Technology, 2020, 21 : 881 - 887
  • [29] Trajectory Planning for Automated Parking Systems Using Deep Reinforcement Learning
    Du, Zhuo
    Miao, Qiheng
    Zong, Changfu
    INTERNATIONAL JOURNAL OF AUTOMOTIVE TECHNOLOGY, 2020, 21 (04) : 881 - 887
  • [30] Towards Automated Superconducting Circuit Calibration using Deep Reinforcement Learning
    Bautista, Meriam Gay
    Yao, Zhi
    Butko, Anastasiia
    Kiran, Mariam
    Metcalf, Mekena
    2021 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI 2021), 2021, : 462 - 467