REINFORCEMENT LEARNING-BASED ADAPTIVE MOTION CONTROL FOR AUTONOMOUS VEHICLES VIA ACTOR-CRITIC STRUCTURE

被引:1
作者
Wang, Honghai [1 ]
Wei, Liangfen [1 ]
Wang, Xianchao [1 ]
He, Shuping [2 ]
机构
[1] Chaohu Univ, Sch Comp & Artificial Intelligence, Hefei 238024, Peoples R China
[2] Anhui Univ, Sch Elect Engn & Automat, Hefei 230601, Peoples R China
来源
DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES S | 2024年 / 17卷 / 09期
关键词
Autonomous vehicle systems; neural network; path tracking; reinforce- ment learning; PATH-TRACKING; SYSTEMS;
D O I
10.3934/dcdss.2024021
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, an optimized adaptive human-machine collaborative torque control methodology is developed for a class of autonomous vehicle systems with unknown disturbances by employing a reinforcement learning technology with identifier-critic-actor architecture. The criticism method is proposed to assess the performance of the control and to give feedback to the actor. Furthermore, a human-vehicle-road model with steering torque as input is constructed to describe the vehicle's dynamic response and the driver's maneuvering behavior. The stability of the control system is analyzed by means of the Lyapunov theory. Finally, the effectiveness of the control methodology is illustrated by means of a numerical example.
引用
收藏
页码:2894 / 2911
页数:18
相关论文
共 24 条
[11]   Finite-Time L2-Gain Asynchronous Control for Continuous-Time Positive Hidden Markov Jump Systems via T-S Fuzzy Model Approach [J].
Ren, Chengcheng ;
He, Shuping ;
Luan, Xiaoli ;
Liu, Fei ;
Karimi, Hamid Reza .
IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (01) :77-87
[12]   ROBUSTNESS OF CONTINUOUS-TIME ADAPTIVE-CONTROL ALGORITHMS IN THE PRESENCE OF UNMODELED DYNAMICS [J].
ROHRS, CE ;
VALAVANI, L ;
ATHANS, M ;
STEIN, G .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1985, 30 (09) :881-889
[13]   Dynamic path planning of mobile robot based on improved simulated annealing algorithm [J].
Shi, Kun ;
Wu, Zhengtian ;
Jiang, Baoping ;
Karimi, Hamid Reza .
JOURNAL OF THE FRANKLIN INSTITUTE, 2023, 360 (06) :4378-4398
[14]   Path-tracking of autonomous vehicles using a novel adaptive robust exponential-like-sliding-mode fuzzy type-2 neural network controller [J].
Taghavifar, Hamid ;
Rakheja, Subhash .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2019, 130 :41-55
[15]   Prediction-Uncertainty-Aware Decision-Making for Autonomous Vehicles [J].
Tang, Xiaolin ;
Yang, Kai ;
Wang, Hong ;
Wu, Jiahang ;
Qin, Yechen ;
Yu, Wenhao ;
Cao, Dongpu .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2022, 7 (04) :849-862
[16]   An adaptive modified neural lateral-longitudinal control system for path following of autonomous vehicles [J].
Tork, Nastaran ;
Amirkhani, Abdollah ;
Shokouhi, Shahriar B. .
ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH, 2021, 24 (01) :126-137
[17]   Adaptive Backstepping Control of Uncertain Gear Transmission Servosystems With Asymmetric Dead-Zone Nonlinearity [J].
Wang, Wei ;
Xie, Bin ;
Zuo, Zongyu ;
Fan, Huijin .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2019, 66 (05) :3752-3762
[18]   Optimized Backstepping Tracking Control Using Reinforcement Learning for Quadrotor Unmanned Aerial Vehicle System [J].
Wen, Guoxing ;
Hao, Wei ;
Feng, Weiwei ;
Gao, Kaizhou .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (08) :5004-5015
[19]   Optimized Backstepping Tracking Control Using Reinforcement Learning for a Class of Stochastic Nonlinear Strict-Feedback Systems [J].
Wen, Guoxing ;
Xu, Liguang ;
Li, Bin .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (03) :1291-1303
[20]   Adaptive Control of PMSM Servo System for Steering-by-Wire System With Disturbances Observation [J].
Wu, Jian ;
Zhang, Junda ;
Nie, Baochang ;
Liu, Yahui ;
He, Xiangkun .
IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2022, 8 (02) :2015-2028