Autonomous Overtaking Decision Making of Driverless Bus Based on Deep Q-learning Method

被引:0
作者
Yu, Lingli [1 ]
Shao, Xuanya [1 ]
Yan, Xiaoxin [1 ]
机构
[1] Cent South Univ, Sch Informat Sci & Engn, Changsha, Peoples R China
来源
2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE ROBIO 2017) | 2017年
基金
中国国家自然科学基金;
关键词
deep learning; reinforcement learning; deep Q network; overtaking decision making;
D O I
暂无
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
The autonomous overtaking maneuver is a valuable technology in unmanned vehicle field. However, overtaking is always perplexed by its security and time cost. Now, an autonomous overtaking decision making method based on deep Q-learning network is proposed in this paper, which employs a deep neural network(DNN) to learn Q function from action chosen to state transition. Based on the trained DNN, appropriate action is adopted in different environments for higher reward state. A series of experiments are performed to verify the effectiveness and robustness of our proposed approach for overtaking decision making based on deep Q-learning method. The results support that our approach achieves better security and lower time cost compared with traditional reinforcement learning methods.
引用
收藏
页码:2267 / 2272
页数:6
相关论文
共 24 条
  • [1] [Anonymous], 2010, IEEE IJCNN, DOI DOI 10.1109/IJCNN.2010.5596468
  • [2] Deep learning with adaptive learning rate using laplacian score
    Chandra, B.
    Sharma, Rajesh K.
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2016, 63 : 1 - 7
  • [3] Cunningham AG, 2015, IEEE INT CONF ROBOT, P1670, DOI 10.1109/ICRA.2015.7139412
  • [4] Autonomous Driver Based on an Intelligent System of Decision-Making
    Czubenko, Michal
    Kowalczuk, Zdzislaw
    Ordys, Andrew
    [J]. COGNITIVE COMPUTATION, 2015, 7 (05) : 569 - 581
  • [5] Intelligent-based multi-robot path planning inspired by improved classical Q-learning and improved particle swarm optimization with perturbed velocity
    Das, P. K.
    Behera, H. S.
    Panigrahi, B. K.
    [J]. ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH, 2016, 19 (01): : 651 - 669
  • [6] Enabling Safe Autonomous Driving in Real-World City Traffic Using Multiple Criteria Decision Making
    Furda, Andrei
    Vlacic, Ljubo
    [J]. IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2011, 3 (01) : 4 - 17
  • [7] Gu S, 2016, Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updates
  • [8] Hong Hu, 2016, IMAGE MATTING PERCEP, P102
  • [9] Isele D., 2017, NAVIGATING INTERSECT
  • [10] Hierarchical finite state machines for autonomous mobile systems
    Kurt, Arda
    Oezguener, Uemit
    [J]. CONTROL ENGINEERING PRACTICE, 2013, 21 (02) : 184 - 194