Emergence of Cooperative Automated Driving Control at Roundabouts Using Deep Reinforcement Learning

被引:1
作者
Nakaya, Reo [1 ]
Harada, Tomohiro [2 ]
Miura, Yukiya [2 ]
Hattori, Kiyohiko [3 ]
Matsuoka, Johei [3 ]
机构
[1] Tokyo Metropolitan Univ, Grad Sch Syst Design, Tokyo, Japan
[2] Tokyo Metropolitan Univ, Fac Syst Design, Tokyo, Japan
[3] Tokyo Univ Technol, Fac Comp Sci, Tokyo, Japan
来源
2023 62ND ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS, SICE | 2023年
关键词
deep reinforcement learning; automated driving; cooperative control; roundabout; multi-agent system;
D O I
10.23919/SICE59929.2023.10354212
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study proposes a deep reinforcement learning mechanism to obtain cooperative driving control of autonomous vehicles at a roundabout, one of the intersections without signal control. This study introduces three new mechanisms to the previous model that enable learning the cooperative control: (i) gradual learning by changing the new vehicle departure interval, (ii) utilization of information about the vehicle's destination, and (iii) additional penalty for approaching walls and other vehicles. We conducted simulation experiments to investigate the effectiveness of the proposed methods. The experimental results showed that the proposed methods enable the acquisition of cooperative vehicle control that can safely navigate a roundabout while reducing the collision rate.
引用
收藏
页码:97 / 102
页数:6
相关论文
共 50 条
  • [41] Ensemble-based Deep Reinforcement Learning for robust cooperative wind farm control
    He, Binghao
    Zhao, Huan
    Liang, Gaoqi
    Zhao, Junhua
    Qiu, Jing
    Dong, Zhao Yang
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2022, 143
  • [42] Cooperative formation control of fixed-wing UAVs based on deep reinforcement learning
    Yue, Keyuan
    Yuan, Jianquan
    Hao, Mingrui
    SEVENTH ASIA PACIFIC CONFERENCE ON OPTICS MANUFACTURE (APCOM 2021), 2022, 12166
  • [43] Example-guided learning of stochastic human driving policies using deep reinforcement learning
    Ran Emuna
    Rotem Duffney
    Avinoam Borowsky
    Armin Biess
    Neural Computing and Applications, 2023, 35 : 16791 - 16804
  • [44] Deep Reinforcement Learning Based Multi-UUV Cooperative Control for Target Capturing
    Wang, Zhong
    Wen, Zhiwen
    Xia, Qianxin
    Cai, Weijun
    2022 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2022, : 986 - 991
  • [45] Deep Reinforcement Learning with Noisy Exploration for Autonomous Driving
    Li, Ruyang
    Zhang, Yaqiang
    Zhao, Yaqian
    Wei, Hui
    Xu, Zhe
    Zhao, Kun
    PROCEEDINGS OF 2022 THE 6TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING, ICMLSC 20222, 2022, : 8 - 14
  • [46] Distributed Deep Reinforcement Learning on the Cloud for Autonomous Driving
    Spryn, Mitchell
    Sharma, Aditya
    Parkar, Dhawal
    Shrimal, Madhur
    PROCEEDINGS 2018 IEEE/ACM 1ST INTERNATIONAL WORKSHOP ON SOFTWARE ENGINEERING FOR AI IN AUTONOMOUS SYSTEMS (SEFAIAS), 2018, : 16 - 22
  • [47] A Deep Reinforcement Learning Approach for Autonomous Highway Driving
    Zhao, Junwu
    Qu, Ting
    Xu, Fang
    IFAC PAPERSONLINE, 2020, 53 (05): : 542 - 546
  • [48] Deep Reinforcement Learning Based Train Driving Optimization
    Huang, Jin
    Zhang, Ende
    Zhang, Jiarui
    Huang, Siguang
    Zhong, Zhihua
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 2375 - 2381
  • [49] A Deep Reinforcement Learning Method for Self-driving
    Fang, Yong
    Gu, Jianfeng
    INTELLIGENT COMPUTING THEORIES AND APPLICATION, PT II, 2018, 10955 : 143 - 152
  • [50] Hierarchical Human-robot Cooperative Control Based on GPR and Deep Reinforcement Learning
    Jin Z.-H.
    Liu A.-D.
    Yu L.
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (09): : 2352 - 2360