Adaptive reinforcement learning optimal tracking control for strict-feedback nonlinear systems with prescribed performance

被引:30
|
作者
Huang, Zongsheng [1 ]
Bai, Weiwei [1 ]
Li, Tieshan [1 ,2 ,3 ,5 ,6 ,7 ]
Long, Yue [1 ]
Chen, C. L. Philip [1 ,4 ]
Liang, Hongjing [1 ]
Yang, Hanqing [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Automation Engn, Chengdu 611731, Sichuan, Peoples R China
[2] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst, Huzhou 313000, Peoples R China
[3] Lab Electromagnet Space Cognit & Intelligent Contr, Beijing 100089, Peoples R China
[4] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Guangdong, Peoples R China
[5] Univ Elect Sci & Technol China, Sch Automation Engn, Chengdu 611731, Sichuan, Peoples R China
[6] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst, Huzhou 313000, Peoples R China
[7] Lab Electromagnet Space Cognit & Intelligent Contr, Beijing 100089, Peoples R China
基金
中国国家自然科学基金;
关键词
Reinforcement learning; Prescribed performance control; Adaptive dynamic programming; Tracking control; Strict-feedback nonlinear systems; OPTIMAL-CONTROL DESIGN; NEURAL-CONTROL;
D O I
10.1016/j.ins.2022.11.109
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The reinforcement learning-based prescribed performance optimal tracking control prob-lem is considered for a class of strict-feedback nonlinear systems in this paper. The unknown nonlinearities and cost function are approximated by radial-basis-function (RBF) neural network (NN). The overall controller consists of an adaptive controller and an optimal compensation term. Firstly, the adaptive controller is designed by backstepping control method. Subsequently, the optimal compensation term is derived via policy itera-tion by minimizing cost function. In addition, depending on the prescribed performance control, the tracking error can be limited in the prescribed area. Therefore, the whole con-trol scheme can effectively guarantee that the tracking error converges to a bound with prescribed performance while the cost function is minimized. The stability analysis shows that all signals in the closed-loop system are bounded. Finally, the effectiveness and advan-tages of the designed control strategy are illustrated by the simulation examples.(c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:407 / 423
页数:17
相关论文
共 50 条
  • [21] Adaptive neural prescribed performance control for a class of strict-feedback stochastic nonlinear systems with hysteresis input
    Si, Wenjie
    Dong, Xunde
    Yang, Feifei
    NEUROCOMPUTING, 2017, 251 : 35 - 44
  • [22] Deep neural networks-prescribed performance optimal control for stochastic nonlinear strict-feedback systems
    Chen, Jinhui
    Mei, Jun
    Hu, Junhao
    Yang, Zhanying
    NEUROCOMPUTING, 2024, 610
  • [23] Optimized backstepping tracking control using reinforcement learning for strict-feedback nonlinear systems with monotone tube performance boundaries
    Zhang, Gengning
    Wang, Xin
    Wang, Ziming
    Pang, Ning
    INTERNATIONAL JOURNAL OF CONTROL, 2025,
  • [24] Adaptive Prescribed Finite Time Control for Strict-Feedback Systems
    Zuo, Gewei
    Wang, Yujuan
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (09) : 5729 - 5736
  • [25] Adaptive Iterative Learning Backstepping Control for Nonlinear Strict-feedback Systems
    Chen, Jianyong
    PROCEEDINGS OF 2020 IEEE 9TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE (DDCLS'20), 2020, : 1054 - 1059
  • [26] Optimized Backstepping Tracking Control Using Reinforcement Learning for a Class of Stochastic Nonlinear Strict-Feedback Systems
    Wen, Guoxing
    Xu, Liguang
    Li, Bin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (03) : 1291 - 1303
  • [27] Adaptive fuzzy tracking control for switched uncertain strict-feedback nonlinear systems
    Yang, Zhongjun
    Zhang, Huaguang
    Cui, Yang
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2018, 355 (02): : 714 - 727
  • [28] Fuzzy Adaptive Output Feedback Optimal Control Design for Strict-Feedback Nonlinear Systems
    Sun, Kangkang
    Li, Yongming
    Tong, Shaocheng
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2017, 47 (01): : 33 - 44
  • [29] Lifelong Safe Optimal Adaptive Tracking Control of Nonlinear Strict-Feedback Discrete-Time Systems
    Farzanegan, Behzad
    Jagannathan, S.
    International Journal of Adaptive Control and Signal Processing, 2024,
  • [30] Fixed-Time Robust Neural Learning Control for Nonlinear Strict-Feedback Systems With Prescribed Performance
    Wang, Xia
    Yang, Lin
    Xu, Bin
    Chen, Weisheng
    Shi, Peng
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2025, 35 (03) : 1269 - 1280