Adaptive reinforcement learning optimal tracking control for strict-feedback nonlinear systems with prescribed performance

被引:30
|
作者
Huang, Zongsheng [1 ]
Bai, Weiwei [1 ]
Li, Tieshan [1 ,2 ,3 ,5 ,6 ,7 ]
Long, Yue [1 ]
Chen, C. L. Philip [1 ,4 ]
Liang, Hongjing [1 ]
Yang, Hanqing [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Automation Engn, Chengdu 611731, Sichuan, Peoples R China
[2] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst, Huzhou 313000, Peoples R China
[3] Lab Electromagnet Space Cognit & Intelligent Contr, Beijing 100089, Peoples R China
[4] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Guangdong, Peoples R China
[5] Univ Elect Sci & Technol China, Sch Automation Engn, Chengdu 611731, Sichuan, Peoples R China
[6] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst, Huzhou 313000, Peoples R China
[7] Lab Electromagnet Space Cognit & Intelligent Contr, Beijing 100089, Peoples R China
基金
中国国家自然科学基金;
关键词
Reinforcement learning; Prescribed performance control; Adaptive dynamic programming; Tracking control; Strict-feedback nonlinear systems; OPTIMAL-CONTROL DESIGN; NEURAL-CONTROL;
D O I
10.1016/j.ins.2022.11.109
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The reinforcement learning-based prescribed performance optimal tracking control prob-lem is considered for a class of strict-feedback nonlinear systems in this paper. The unknown nonlinearities and cost function are approximated by radial-basis-function (RBF) neural network (NN). The overall controller consists of an adaptive controller and an optimal compensation term. Firstly, the adaptive controller is designed by backstepping control method. Subsequently, the optimal compensation term is derived via policy itera-tion by minimizing cost function. In addition, depending on the prescribed performance control, the tracking error can be limited in the prescribed area. Therefore, the whole con-trol scheme can effectively guarantee that the tracking error converges to a bound with prescribed performance while the cost function is minimized. The stability analysis shows that all signals in the closed-loop system are bounded. Finally, the effectiveness and advan-tages of the designed control strategy are illustrated by the simulation examples.(c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:407 / 423
页数:17
相关论文
共 50 条
  • [31] Robust adaptive control for strict-feedback nonlinear systems
    Mizumoto, I
    Gopaluni, RB
    Shah, SL
    Iwai, Z
    ASIAN JOURNAL OF CONTROL, 2005, 7 (03) : 231 - 243
  • [32] Finite-time adaptive optimal control of uncertain strict-feedback nonlinear systems based on fuzzy observer and reinforcement learning
    Sun, Yue
    Chen, Ming
    Peng, Kaixiang
    Wu, Libing
    Liu, Cungen
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2024, 55 (08) : 1553 - 1570
  • [33] Adaptive Fuzzy Inverse Optimal Control for Uncertain Strict-Feedback Nonlinear Systems
    Li, Yong-ming
    Min, Xiao
    Tong, Shaocheng
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2020, 28 (10) : 2363 - 2374
  • [34] Adaptive Fault-Tolerant Control With Global Prescribed Performance of Strict-Feedback Systems
    Guo, Ge
    Zhang, Chen-Liang
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (08): : 4832 - 4840
  • [35] Prescribed performance event-triggered control for strict-feedback switched nonlinear systems
    Fan, Zhida
    Wang, Fenglan
    Long, Lijun
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2023, 33 (03) : 2409 - 2429
  • [36] Active Fault-Tolerant Control for Strict-Feedback Nonlinear Systems with Prescribed Performance
    Chen, Ming
    Zhang, Shiyong
    Wang, Huanqing
    FIFTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2014, : 204 - 210
  • [37] Prescribed Performance Consensus of Uncertain Nonlinear Strict-Feedback Systems With Unknown Control Directions
    Wang, Wei
    Wang, Dan
    Peng, Zhouhua
    Li, Tieshan
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2016, 46 (09): : 1279 - 1286
  • [38] Adaptive neural prescribed performance control for a class of strict-feedback stochastic nonlinear systems under arbitrary switchings
    Si, Wenjie
    Dong, Xunde
    Yang, Feifei
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2017, 48 (11) : 2300 - 2310
  • [39] Adaptive fuzzy fault-tolerant control with guaranteed tracking performance for nonlinear strict-feedback systems
    Zhai, Ding
    An, Liwei
    Li, Jinghao
    Zhang, Qingling
    FUZZY SETS AND SYSTEMS, 2016, 302 : 82 - 100
  • [40] Observer-based Adaptive Fuzzy Control for Strict-feedback Nonlinear Systems with Prescribed Performance and Dead Zone
    Wen Zeng
    Zhigang Li
    Chuang Gao
    Libing Wu
    International Journal of Control, Automation and Systems, 2021, 19 : 1962 - 1975