Adaptive Fault-Tolerant Tracking Control for Discrete-Time Multiagent Systems via Reinforcement Learning Algorithm

被引:344
作者
Li, Hongyi [1 ,2 ]
Wu, Ying [3 ]
Chen, Mou [4 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
[2] Guangdong Univ Technol, Guangdong Prov Key Lab Intelligent Decis & Cooper, Guangzhou 510006, Peoples R China
[3] Bohai Univ, Coll Engn, Jinzhou 121013, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 211106, Peoples R China
关键词
Reinforcement learning; Artificial neural networks; Actuators; Fault tolerance; Fault tolerant systems; Estimation; Multi-agent systems; Discrete-time multiagent systems (MASs); fault-tolerant control; neural networks (NNs); reinforcement learning algorithm; NONLINEAR-SYSTEMS; CONSENSUS; DESIGN; DISTURBANCES;
D O I
10.1109/TCYB.2020.2982168
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article investigates the adaptive fault-tolerant tracking control problem for a class of discrete-time multiagent systems via a reinforcement learning algorithm. The action neural networks (NNs) are used to approximate unknown and desired control input signals, and the critic NNs are employed to estimate the cost function in the design procedure. Furthermore, the direct adaptive optimal controllers are designed by combining the backstepping technique with the reinforcement learning algorithm. Comparing the existing reinforcement learning algorithm, the computational burden can be effectively reduced by using the method of less learning parameters. The adaptive auxiliary signals are established to compensate for the influence of the dead zones and actuator faults on the control performance. Based on the Lyapunov stability theory, it is proved that all signals of the closed-loop system are semiglobally uniformly ultimately bounded. Finally, some simulation results are presented to illustrate the effectiveness of the proposed approach.
引用
收藏
页码:1163 / 1174
页数:12
相关论文
共 45 条
  • [1] Adaptive Reinforcement Learning Neural Network Control for Uncertain Nonlinear System With Input Saturation
    Bai, Weiwei
    Zhou, Qi
    Li, Tieshan
    Li, Hongyi
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (08) : 3433 - 3443
  • [2] Adaptive Neural Control of Uncertain Nonlinear Systems Using Disturbance Observer
    Chen, Mou
    Shao, Shu-Yi
    Jiang, Bin
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (10) : 3110 - 3123
  • [3] Adaptive Fault-Tolerant Control of Uncertain Nonlinear Large-Scale Systems With Unknown Dead Zone
    Chen, Mou
    Tao, Gang
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (08) : 1851 - 1862
  • [4] How often should one update control and estimation: review of networked triggering techniques
    Chen, Zhiyong
    Han, Qing-Long
    Yan, Yamin
    Wu, Zheng-Guang
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (05)
  • [5] Decentralized robust zero-sum neuro-optimal control for modular robot manipulators in contact with uncertain environments: theory and experimental verification
    Dong, Bo
    An, Tianjiao
    Zhou, Fan
    Liu, Keping
    Li, Yuanchun
    [J]. NONLINEAR DYNAMICS, 2019, 97 (01) : 503 - 524
  • [6] Fax J. A., 2002, IEEE T AUTOMATIC CON, V35, P115, DOI DOI 10.3182/20020721-6-ES-1901.00100
  • [7] Adaptive neural network control for a class of MIMO nonlinear systems with disturbances in discrete-time
    Ge, SS
    Zhang, J
    Lee, TH
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (04): : 1630 - 1645
  • [8] Reinforcement learning neural-network-based controller for nonlinear discrete-time systems with input constraints
    He, Pingan
    Jagannathan, S.
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2007, 37 (02): : 425 - 436
  • [9] Fault-Tolerant Oriented Hierarchical Control and Configuration of Modular Multilevel Converter for Shipboard MVdc System
    Hong, Lerong
    Xu, Qianming
    He, Zhixing
    Ma, Fujun
    Luo, An
    Guerrero, Josep M.
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (08) : 4525 - 4535
  • [10] Adaptive control for a class of chemical reactor systems in discrete-time form
    Li, Dong-Juan
    Tang, Li
    [J]. NEURAL COMPUTING & APPLICATIONS, 2014, 24 (7-8) : 1807 - 1814