Decision making of autonomous vehicles in lane change scenarios: Deep reinforcement learning approaches with risk awareness

被引:160
作者
Li, Guofa [1 ]
Yang, Yifan [1 ]
Li, Shen [2 ]
Qu, Xingda [1 ]
Lyu, Nengchao [3 ]
Li, Shengbo Eben [4 ]
机构
[1] Shenzhen Univ, Inst Human Factors & Ergon, Coll Mechatron & Control Engn, Shenzhen 518060, Peoples R China
[2] Tsinghua Univ, Dept Civil Engn, Beijing 100084, Peoples R China
[3] Wuhan Univ Technol, Intelligent Transportat Syst Res Ctr, Wuhan 430063, Peoples R China
[4] Tsinghua Univ, Sch Vehicle & Mobil, State Key Lab Automot Safety & Energy, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Driving safety; Driving risk; Autonomous vehicle; Driver assistance system; Reinforcement learning; FRAMEWORK; EFFICIENT; BEHAVIOR;
D O I
10.1016/j.trc.2021.103452
中图分类号
U [交通运输];
学科分类号
08 ; 0823 ;
摘要
Driving safety is the most important element that needs to be considered for autonomous vehicles (AVs). To ensure driving safety, we proposed a lane change decision-making framework based on deep reinforcement learning to find a risk-aware driving decision strategy with the minimum expected risk for autonomous driving. Firstly, a probabilistic-model based risk assessment method was proposed to assess the driving risk using position uncertainty and distance-based safety metrics. Then, a risk aware decision making algorithm was proposed to find a strategy with the minimum expected risk using deep reinforcement learning. Finally, our proposed methods were evaluated in CARLA in two scenarios (one with static obstacles and one with dynamically moving vehicles). The results show that our proposed methods can generate robust safe driving strategies and achieve better driving performances than previous methods.
引用
收藏
页数:18
相关论文
共 64 条
[1]  
Ali M, 2012, IEEE DECIS CONTR P, P6315, DOI 10.1109/CDC.2012.6425989
[2]  
[Anonymous], 2019, PROC REAL WORLD SEQU
[3]  
Antonoglou I, 2016, INT C LEARN REPR ICL, P3240
[4]  
Bojarski M., 2017, CORR ABS170407911
[5]  
Bosnak M, 2017, IEEE INT C CYBERNET, P35
[6]  
Bouton M., 2019, ARXIV PREPRINT ARXIV
[7]  
Brockman Greg, 2016, arXiv
[8]  
Chen D, 2020, P AMER CONTR CONF, P4355, DOI [10.23919/ACC45564.2020.9147626, 10.23919/acc45564.2020.9147626]
[9]   Exploring Behavioral Patterns of Lane Change Maneuvers for Human-Like Autonomous Driving [J].
Chen, Yaoyu ;
Li, Guofa ;
Li, Shen ;
Wang, Wenjun ;
Li, Shengbo Eben ;
Cheng, Bo .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (09) :14322-14335
[10]  
Codevilla F., 2018, ARXIV171002410