Reinforcement-Learning-Based Decision and Control for Autonomous Vehicle at Two-Way Single-Lane Unsignalized Intersection

被引:6
作者
Liu, Yonggang [1 ,2 ]
Liu, Gang [2 ]
Wu, Yitao [2 ]
He, Wen [3 ]
Zhang, Yuanjian [4 ]
Chen, Zheng [5 ]
机构
[1] Jilin Univ, State Key Lab Automot Simulat & Control, Changchun 130025, Peoples R China
[2] Chongqing Univ, Coll Mech & Vehicle Engn, Chongqing 400044, Peoples R China
[3] Changan Automobile Intelligent Res Inst, Chongqing 710199, Peoples R China
[4] Loughborough Univ, Dept Aeronaut & Automot Engn, Loughborough LE11 3TU, Leics, England
[5] Kunming Univ Sci & Technol, Fac Transportat Engn, Kunming 650500, Yunnan, Peoples R China
基金
国家重点研发计划;
关键词
autonomous vehicle; intersection; decision and control; reinforcement learning; autoregressive integrated moving average model; AUTOMATED VEHICLES;
D O I
10.3390/electronics11081203
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Intersections have attracted wide attention owing to their complexity and high rate of traffic accidents. In the process of developing L3-and-above autonomous-driving techniques, it is necessary to solve problems in autonomous driving decisions and control at intersections. In this article, a decision-and-control method based on reinforcement learning and speed prediction is proposed to manage the conjunction of straight and turning vehicles at two-way single-lane unsignalized intersections. The key position of collision avoidance in the process of confluence is determined by establishing a road-geometry model, and on this basis, the expected speed of the straight vehicle that ensures passing safety is calculated. Then, a reinforcement-learning algorithm is employed to solve the decision-control problem of the straight vehicle, and the expected speed is optimized to direct the agent to learn and converge to the planned decision. Simulations were conducted to verify the performance of the proposed method, and the results show that the proposed method can generate proper decisions for the straight vehicle to pass the intersection while guaranteeing preferable safety and traffic efficiency.
引用
收藏
页数:22
相关论文
共 27 条
[1]  
[Anonymous], 2016, 2016 ONLINE INT C GR, P1, DOI DOI 10.1109/GET.2016.7916627
[2]  
Bouton M, 2017, IEEE INT VEH SYM, P825, DOI 10.1109/IVS.2017.7995818
[3]   Control of imperfect dynamical systems [J].
Bucolo, Maide ;
Buscarino, Arturo ;
Famoso, Carlo ;
Fortuna, Luigi ;
Frasca, Mattia .
NONLINEAR DYNAMICS, 2019, 98 (04) :2989-2999
[4]  
Chen W.L., 2019, P 2019 IEEE INT C CO, P1
[5]   Visualization Analysis of Intelligent Vehicles Research Field Based on Mapping Knowledge Domain [J].
He, Yi ;
Yang, Shuo ;
Chan, Ching-Yao ;
Chen, Long ;
Wu, Chaozhong .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (09) :5721-5736
[6]  
Huang LX, 2017, P AMER CONTR CONF, P5525, DOI 10.23919/ACC.2017.7963814
[7]  
Hubmann C, 2019, IEEE INT VEH SYM, P2172, DOI [10.1109/ivs.2019.8814179, 10.1109/IVS.2019.8814179]
[8]   Automated Driving in Uncertain Environments: Planning With Interaction and Uncertain Maneuver Prediction [J].
Hubmann, Constantin ;
Schulz, Jens ;
Becker, Marvin ;
Althoff, Daniel ;
Stiller, Christoph .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2018, 3 (01) :5-17
[9]   Optimal Coordination of Automated Vehicles at Intersections: Theory and Experiments [J].
Hult, Robert ;
Zanon, Mario ;
Gros, Sebastien ;
Falcone, Paolo .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2019, 27 (06) :2510-2525
[10]  
Isele D, 2018, IEEE INT CONF ROBOT, P2034