Emergence of Cooperative Automated Driving Control at Roundabouts Using Deep Reinforcement Learning

被引:1
|
作者
Nakaya, Reo [1 ]
Harada, Tomohiro [2 ]
Miura, Yukiya [2 ]
Hattori, Kiyohiko [3 ]
Matsuoka, Johei [3 ]
机构
[1] Tokyo Metropolitan Univ, Grad Sch Syst Design, Tokyo, Japan
[2] Tokyo Metropolitan Univ, Fac Syst Design, Tokyo, Japan
[3] Tokyo Univ Technol, Fac Comp Sci, Tokyo, Japan
来源
2023 62ND ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS, SICE | 2023年
关键词
deep reinforcement learning; automated driving; cooperative control; roundabout; multi-agent system;
D O I
10.23919/SICE59929.2023.10354212
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study proposes a deep reinforcement learning mechanism to obtain cooperative driving control of autonomous vehicles at a roundabout, one of the intersections without signal control. This study introduces three new mechanisms to the previous model that enable learning the cooperative control: (i) gradual learning by changing the new vehicle departure interval, (ii) utilization of information about the vehicle's destination, and (iii) additional penalty for approaching walls and other vehicles. We conducted simulation experiments to investigate the effectiveness of the proposed methods. The experimental results showed that the proposed methods enable the acquisition of cooperative vehicle control that can safely navigate a roundabout while reducing the collision rate.
引用
收藏
页码:97 / 102
页数:6
相关论文
共 50 条
  • [31] Deep reinforcement learning-based drift parking control of automated vehicles
    Leng, Bo
    Yu, YiZe
    Liu, Ming
    Cao, Lei
    Yang, Xing
    Xiong, Lu
    SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2023, 66 (04) : 1152 - 1165
  • [32] KIcker: An Industrial Drive and Control Foosball System automated with Deep Reinforcement Learning
    De Blasi, Stefano
    Kloser, Sebastian
    Muller, Arne
    Reuben, Robin
    Sturm, Fabian
    Zerrer, Timo
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2021, 102 (01)
  • [33] Automated Vertical Partitioning with Deep Reinforcement Learning
    Durand, Gabriel Campero
    Piriyev, Rufat
    Pinnecke, Marcus
    Broneske, David
    Gurumurthy, Balasubramanian
    Saake, Gunter
    NEW TRENDS IN DATABASES AND INFORMATION SYSTEMS, ADBIS 2019, 2019, 1064 : 126 - 134
  • [34] Deep reinforcement learning-based drift parking control of automated vehicles
    Bo Leng
    YiZe Yu
    Ming Liu
    Lei Cao
    Xing Yang
    Lu Xiong
    Science China Technological Sciences, 2023, 66 : 1152 - 1165
  • [35] KIcker: An Industrial Drive and Control Foosball System automated with Deep Reinforcement Learning
    Stefano De Blasi
    Sebastian Klöser
    Arne Müller
    Robin Reuben
    Fabian Sturm
    Timo Zerrer
    Journal of Intelligent & Robotic Systems, 2021, 102
  • [36] Cooperative Traffic Signal Control Using a Distributed Agent-Based Deep Reinforcement Learning With Incentive Communication
    Zhou, Bin
    Zhou, Qishen
    Hu, Simon
    Ma, Dongfang
    Jin, Sheng
    Lee, Der-Horng
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (08) : 10147 - 10160
  • [37] Cooperative Object Transportation Using Curriculum-Based Deep Reinforcement Learning
    Eoh, Gyuho
    Park, Tae-Hyoung
    SENSORS, 2021, 21 (14)
  • [38] Interterminal Truck Routing Optimization Using Cooperative Multiagent Deep Reinforcement Learning
    Adi, Taufik Nur
    Bae, Hyerim
    Iskandar, Yelita Anggiane
    PROCESSES, 2021, 9 (10)
  • [39] ICRAN: Intelligent Control for Self-Driving RAN Based on Deep Reinforcement Learning
    Ahmed, Azza H.
    Elmokashfi, Ahmed
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (03): : 2751 - 2766
  • [40] Example-guided learning of stochastic human driving policies using deep reinforcement learning
    Emuna, Ran
    Duffney, Rotem
    Borowsky, Avinoam
    Biess, Armin
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (23) : 16791 - 16804