Adaptive actor-critic neural optimal control for constrained nonstrict feedback nonlinear systems via command filter

被引:4
|
作者
Hua, Yu [1 ,2 ]
Zhang, Tianping [1 ,2 ]
机构
[1] Yangzhou Univ, Coll Informat Engn, Dept Automat, Yangzhou, Peoples R China
[2] Yangzhou Univ, Coll Math Sci, Yangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
adaptive dynamic programming; command filter; dynamic surface control; mapping rule; optimal control; state-constrained; unmodeled dynamics; DYNAMIC SURFACE CONTROL; CONTINUOUS-TIME SYSTEMS; BACKSTEPPING CONTROL; STATE CONSTRAINTS; OUTPUT-FEEDBACK; CONTROL DESIGN; INPUT;
D O I
10.1002/rnc.6840
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The actor-critic neural optimal control is investigated for the state-constrained nonlinear systems in the nonstrict feedback form with unmodeled dynamics in this paper. The filtering errors in the traditional dynamic surface control (DSC) are countervailed by the introduced compensation signals. Two design phases together determine the input: the feedforward input design and the near optimal input design. In the feedforward input design, a mapping rule is established to keep all the states in the finite range, and a first-order adjunctive signal is designed to treat the unmodeled dynamics. In the near optimal input design, the cost function relying on the reconstructed error system is minimized by the near optimal input via adaptive dynamic programming (ADP). In the whole design processing, the unknown nonlinear uncertain parts are fitted by the radial basis function neural networks (RBFNNs). The stability analysis illustrates all the signals are bounded in the controlled system. Two simulation examples are employed to verify the theoretical findings.
引用
收藏
页码:8588 / 8614
页数:27
相关论文
共 50 条
  • [31] Adaptive Optimal Tracking Control of an Underactuated Surface Vessel Using Actor-Critic Reinforcement Learning
    Chen, Lin
    Dai, Shi-Lu
    Dong, Chao
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) : 7520 - 7533
  • [32] Exponentially asymptotic adaptive tracking control of nonstrict feedback nonlinear systems
    Liang, Yanjun
    Li, Yuan-Xin
    Che, Weiwei
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2022, 53 (02) : 337 - 350
  • [33] Optimal Control of Affine Nonlinear Continuous-time Systems Using Online Actor-Critic Algorithm
    Chen Xue-song
    Yang Ming-sheng
    Liu Fu-chun
    2013 32ND CHINESE CONTROL CONFERENCE (CCC), 2013, : 2891 - 2894
  • [34] Adaptive neural control for nonlinear systems with actuator faults and unknown control directions via command filter
    Guo, Jun
    Bo, Yuming
    Park, Ju H.
    Ma, Jiali
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2022, 32 (04) : 2100 - 2118
  • [35] Robust adaptive finite time command filtered backstepping control for uncertain output constrained strict-feedback nonlinear systems
    Soukkou, Yassine
    Soukkou, Ammar
    Tadjine, Mohamed
    Nibouche, Mokhtar
    Haddad, Sofiane
    Benghanem, Mohamed
    INTERNATIONAL JOURNAL OF DYNAMICS AND CONTROL, 2024, 12 (05) : 1436 - 1446
  • [36] Command Filter-Based Adaptive Fuzzy Control for Nonlinear Systems With Unknown Control Directions
    Xia, Jianwei
    Zhang, Jing
    Feng, June
    Wang, Zhen
    Zhuang, Guangming
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (03): : 1945 - 1953
  • [37] Adaptive output-feedback fault-tolerant control for space manipulator via actor-critic learning
    Yin, Yuwan
    Ning, Xin
    Xia, Dongdong
    ADVANCES IN SPACE RESEARCH, 2025, 75 (04) : 3914 - 3932
  • [38] Adaptive neural containment control of nonstrict-feedback multi-agent systems with unmodeled dynamics
    Shang, Kunfeng
    Zhang, Tianping
    Zhang, Enze
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2022, 36 (08) : 1879 - 1908
  • [39] Hierarchical Sliding-Mode Surface-Based Adaptive Actor-Critic Optimal Control for Switched Nonlinear Systems With Unknown Perturbation
    Zhang, Haoyan
    Zhao, Xudong
    Wang, Huanqing
    Zong, Guangdeng
    Xu, Ning
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (02) : 1559 - 1571
  • [40] Fractional-Order Systems Optimal Control via Actor-Critic Reinforcement Learning and Its Validation for Chaotic MFET
    Li, Dongdong
    Dong, Jiuxiang
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, : 1173 - 1182