Adaptive reinforcement learning optimal tracking control for strict-feedback nonlinear systems with prescribed performance

被引:30
|
作者
Huang, Zongsheng [1 ]
Bai, Weiwei [1 ]
Li, Tieshan [1 ,2 ,3 ,5 ,6 ,7 ]
Long, Yue [1 ]
Chen, C. L. Philip [1 ,4 ]
Liang, Hongjing [1 ]
Yang, Hanqing [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Automation Engn, Chengdu 611731, Sichuan, Peoples R China
[2] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst, Huzhou 313000, Peoples R China
[3] Lab Electromagnet Space Cognit & Intelligent Contr, Beijing 100089, Peoples R China
[4] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Guangdong, Peoples R China
[5] Univ Elect Sci & Technol China, Sch Automation Engn, Chengdu 611731, Sichuan, Peoples R China
[6] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst, Huzhou 313000, Peoples R China
[7] Lab Electromagnet Space Cognit & Intelligent Contr, Beijing 100089, Peoples R China
基金
中国国家自然科学基金;
关键词
Reinforcement learning; Prescribed performance control; Adaptive dynamic programming; Tracking control; Strict-feedback nonlinear systems; OPTIMAL-CONTROL DESIGN; NEURAL-CONTROL;
D O I
10.1016/j.ins.2022.11.109
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The reinforcement learning-based prescribed performance optimal tracking control prob-lem is considered for a class of strict-feedback nonlinear systems in this paper. The unknown nonlinearities and cost function are approximated by radial-basis-function (RBF) neural network (NN). The overall controller consists of an adaptive controller and an optimal compensation term. Firstly, the adaptive controller is designed by backstepping control method. Subsequently, the optimal compensation term is derived via policy itera-tion by minimizing cost function. In addition, depending on the prescribed performance control, the tracking error can be limited in the prescribed area. Therefore, the whole con-trol scheme can effectively guarantee that the tracking error converges to a bound with prescribed performance while the cost function is minimized. The stability analysis shows that all signals in the closed-loop system are bounded. Finally, the effectiveness and advan-tages of the designed control strategy are illustrated by the simulation examples.(c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:407 / 423
页数:17
相关论文
共 50 条
  • [41] Observer-based Adaptive Fuzzy Control for Strict-feedback Nonlinear Systems with Prescribed Performance and Dead Zone
    Zeng, Wen
    Li, Zhigang
    Gao, Chuang
    Wu, Libing
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2021, 19 (05) : 1962 - 1975
  • [42] Learning from Adaptive Neural Control of SISO Strict-feedback Nonlinear Systems
    Wu Yuxiang
    Zhou Yongde
    Wang Cong
    2013 32ND CHINESE CONTROL CONFERENCE (CCC), 2013, : 2957 - 2962
  • [43] Lifelong reinforcement learning tracking control of nonlinear strict-feedback systems using multilayer neural networks with constraints
    Ganie, Irfan
    Jagannathan, S.
    NEUROCOMPUTING, 2024, 600
  • [44] Adaptive Fuzzy Prescribed Performance Control for Strict-Feedback Stochastic Nonlinear System with Input Constraint
    Ma, Yilin
    Zhao, Nannan
    Ouyang, Xinyu
    Xu, Haibo
    Zhou, Yiqin
    ENGINEERING LETTERS, 2021, 29 (02) : 650 - 657
  • [45] Adaptive fuzzy control for perturbed strict-feedback nonlinear systems with predefined tracking accuracy
    Jian Wu
    Jing Li
    Nonlinear Dynamics, 2016, 83 : 1185 - 1197
  • [46] Adaptive fuzzy control for perturbed strict-feedback nonlinear systems with predefined tracking accuracy
    Wu, Jian
    Li, Jing
    NONLINEAR DYNAMICS, 2016, 83 (03) : 1185 - 1197
  • [47] Adaptive fuzzy tracking control for strict-feedback nonlinear systems with unknown time delays
    Wang, Min
    Chen, Bing
    Tong, Shaocheng
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2008, 4 (04): : 829 - 837
  • [48] A DSC Approach to Robust Adaptive NN Tracking Control for Strict-Feedback Nonlinear Systems
    Li, Tie-Shan
    Wang, Dan
    Feng, Gang
    Tong, Shao-Cheng
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2010, 40 (03): : 915 - 927
  • [49] Direct adaptive fuzzy tracking control for a class of perturbed strict-feedback nonlinear systems
    Wang, Min
    Chen, Bing
    Dai, Shi-Lu
    FUZZY SETS AND SYSTEMS, 2007, 158 (24) : 2655 - 2670
  • [50] Adaptive asymptotical tracking funnel control for strict-feedback nonlinear systems with input quantization
    Shao Liyuan
    Wang Huanqing
    PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 5380 - 5385