REINFORCEMENT LEARNING-BASED ADAPTIVE MOTION CONTROL FOR AUTONOMOUS VEHICLES VIA ACTOR-CRITIC STRUCTURE

被引:1
作者
Wang, Honghai [1 ]
Wei, Liangfen [1 ]
Wang, Xianchao [1 ]
He, Shuping [2 ]
机构
[1] Chaohu Univ, Sch Comp & Artificial Intelligence, Hefei 238024, Peoples R China
[2] Anhui Univ, Sch Elect Engn & Automat, Hefei 230601, Peoples R China
来源
DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES S | 2024年 / 17卷 / 09期
关键词
Autonomous vehicle systems; neural network; path tracking; reinforce- ment learning; PATH-TRACKING; SYSTEMS;
D O I
10.3934/dcdss.2024021
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, an optimized adaptive human-machine collaborative torque control methodology is developed for a class of autonomous vehicle systems with unknown disturbances by employing a reinforcement learning technology with identifier-critic-actor architecture. The criticism method is proposed to assess the performance of the control and to give feedback to the actor. Furthermore, a human-vehicle-road model with steering torque as input is constructed to describe the vehicle's dynamic response and the driver's maneuvering behavior. The stability of the control system is analyzed by means of the Lyapunov theory. Finally, the effectiveness of the control methodology is illustrated by means of a numerical example.
引用
收藏
页码:2894 / 2911
页数:18
相关论文
共 24 条
[1]   ADVANCES IN OPERATOR CAUCHY-SCHWARZ INEQUALITIES AND THEIR REVERSES [J].
Aldaz, J. M. ;
Barza, S. ;
Fujii, M. ;
Moslehian, M. S. .
ANNALS OF FUNCTIONAL ANALYSIS, 2015, 6 (03) :275-295
[2]   Safe driving envelopes for path tracking in autonomous vehicles [J].
Brown, Matthew ;
Funke, Joseph ;
Erlien, Stephen ;
Gerdes, J. Christian .
CONTROL ENGINEERING PRACTICE, 2017, 61 :307-316
[3]   Prescribed Performance Adaptive Fuzzy Control of Stochastic Nonlinear Multi-agent Systems with Input Hysteresis and Saturation [J].
Cheng, Weidi ;
Xue, Hong ;
Liang, Hongjing ;
Wang, Wei .
INTERNATIONAL JOURNAL OF FUZZY SYSTEMS, 2022, 24 (01) :91-104
[4]   Adaptive neural network control of nonlinear systems by state and output feedback [J].
Ge, SS ;
Hang, CC ;
Zhang, T .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 1999, 29 (06) :818-828
[5]   Advances in Line-of-Sight Guidance for Path Following of Autonomous Marine Vehicles: An Overview [J].
Gu, Nan ;
Wang, Dan ;
Peng, Zhouhua ;
Wang, Jun ;
Han, Qing-Long .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (01) :12-28
[6]   Adaptive-neural-network-based robust lateral motion control for autonomous vehicle at driving limits [J].
Ji, Xuewu ;
He, Xiangkun ;
Lv, Chen ;
Liu, Yahui ;
Wu, Jian .
CONTROL ENGINEERING PRACTICE, 2018, 76 :41-53
[7]   Adaptive Fault-Tolerant Tracking Control for Uncertain Nonlinear Systems With Unknown Control Directions and Limited Resolution [J].
Jia, Fanlin ;
Cao, Fangfei ;
He, Xiao .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (03) :1813-1825
[8]   Design of a feedback-feedforward steering controller for accurate path tracking and stability at the limits of handling [J].
Kapania, Nitin R. ;
Gerdes, J. Christian .
VEHICLE SYSTEM DYNAMICS, 2015, 53 (12) :1687-1704
[9]   A deep reinforcement learning approach to energy management control with connected information for hybrid electric vehicles [J].
Mei, Peng ;
Karimi, Hamid Reza ;
Xie, Hehui ;
Chen, Fei ;
Huang, Cong ;
Yang, Shichun .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
[10]   Positiveness and Finite-Time Control of Dual-Switching Poisson Jump Networked Control Systems With Time-Varying Delays and Packet Drops [J].
Ren, Chengcheng ;
Park, Ju H. ;
He, Shuping .
IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2022, 9 (02) :575-587