A self-learning human-machine cooperative control method based on driver intention recognition

被引:2
作者
Jiang, Yan [1 ]
Ding, Yuyan [1 ]
Zhang, Xinglong [1 ]
Xu, Xin [1 ]
Huang, Junwen [2 ]
机构
[1] Natl Univ Def Technol, Coll Intelligence Sci & Technol, Changsha, Peoples R China
[2] Tech Univ Munich, Dept Comp Sci, Garching, Germany
基金
中国国家自然科学基金;
关键词
Self-learning Control; Human-machine Cooperation; Intelligent Vehicles; Reinforcement Learning; AVOIDANCE; SYSTEM;
D O I
10.1049/cit2.12313
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human-machine cooperative control has become an important area of intelligent driving, where driver intention recognition and dynamic control authority allocation are key factors for improving the performance of cooperative decision-making and control. In this paper, an online learning method is proposed for human-machine cooperative control, which introduces a priority control parameter in the reward function to achieve optimal allocation of control authority under different driver intentions and driving safety conditions. Firstly, a two-layer LSTM-based sequence prediction algorithm is proposed to recognise the driver's lane change (LC) intention for human-machine cooperative steering control. Secondly, an online reinforcement learning method is developed for optimising the steering authority to reduce driver workload and improve driving safety. The driver-in-the-loop simulation results show that our method can accurately predict the driver's LC intention in cooperative driving and effectively compensate for the driver's non-optimal driving actions. The experimental results on a real intelligent vehicle further demonstrate the online optimisation capability of the proposed RL-based control authority allocation algorithm and its effectiveness in improving driving safety.
引用
收藏
页码:1101 / 1115
页数:15
相关论文
共 31 条
[1]   Studying the effects of an advanced driver-assistance system to improve safety of cyclists overtaking [J].
Brijs, Tom ;
Mauriello, Filomena ;
Montella, Alfonso ;
Galante, Francesco ;
Brijs, Kris ;
Ross, Veerle .
ACCIDENT ANALYSIS AND PREVENTION, 2022, 174
[2]  
Chen JJ, 2013, 2013 IEEE INTERNATIONAL CONFERENCE ON VEHICULAR ELECTRONICS AND SAFETY (ICVES), P17, DOI 10.1109/ICVES.2013.6619595
[3]  
Dai C., 2021, 2021 5 CAA INT C VEH
[4]   Shared Steering Control Using Safe Envelopes for Obstacle Avoidance and Vehicle Stability [J].
Erlien, Stephen M. ;
Fujita, Susumu ;
Gerdes, Joseph Christian .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2016, 17 (02) :441-451
[5]  
Falcone P, 2007, Nonlinear model predictive control for autonomous vehicles
[6]   THE DEVELOPMENT OF A TIME-RELATED MEASURE TO DESCRIBE DRIVING STRATEGY [J].
GODTHELP, H ;
MILGRAM, P ;
BLAAUW, GJ .
HUMAN FACTORS, 1984, 26 (03) :257-268
[7]   Driver lane change intention recognition in the connected environment [J].
Guo, Yingshi ;
Zhang, Hongjia ;
Wang, Chang ;
Sun, Qinyu ;
Li, Wanmin .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2021, 575
[8]   Adaptive Steering Torque Coupling Framework Considering Conflict Resolution for Human-Machine Shared Driving [J].
Han, Jiayi ;
Zhao, Jian ;
Zhu, Bing ;
Song, Dongjian .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) :10983-10995
[9]   Human-Machine Adaptive Shared Control for Safe Driving Under Automation Degradation [J].
Huang, Chao ;
Lv, Chen ;
Hang, Peng ;
Hu, Zhongxu ;
Xing, Yang .
IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2022, 14 (02) :53-66
[10]   Anticollision system PRORETA with automatic braking and steering [J].
Isermann, R. ;
Schorn, M. ;
Staehlin, U. .
VEHICLE SYSTEM DYNAMICS, 2008, 46 :683-694