Adaptive Fault-Tolerant Tracking Control for Discrete-Time Multiagent Systems via Reinforcement Learning Algorithm

被引:342
|
作者
Li, Hongyi [1 ,2 ]
Wu, Ying [3 ]
Chen, Mou [4 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
[2] Guangdong Univ Technol, Guangdong Prov Key Lab Intelligent Decis & Cooper, Guangzhou 510006, Peoples R China
[3] Bohai Univ, Coll Engn, Jinzhou 121013, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 211106, Peoples R China
关键词
Reinforcement learning; Artificial neural networks; Actuators; Fault tolerance; Fault tolerant systems; Estimation; Multi-agent systems; Discrete-time multiagent systems (MASs); fault-tolerant control; neural networks (NNs); reinforcement learning algorithm; NONLINEAR-SYSTEMS; CONSENSUS; DESIGN; DISTURBANCES;
D O I
10.1109/TCYB.2020.2982168
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article investigates the adaptive fault-tolerant tracking control problem for a class of discrete-time multiagent systems via a reinforcement learning algorithm. The action neural networks (NNs) are used to approximate unknown and desired control input signals, and the critic NNs are employed to estimate the cost function in the design procedure. Furthermore, the direct adaptive optimal controllers are designed by combining the backstepping technique with the reinforcement learning algorithm. Comparing the existing reinforcement learning algorithm, the computational burden can be effectively reduced by using the method of less learning parameters. The adaptive auxiliary signals are established to compensate for the influence of the dead zones and actuator faults on the control performance. Based on the Lyapunov stability theory, it is proved that all signals of the closed-loop system are semiglobally uniformly ultimately bounded. Finally, some simulation results are presented to illustrate the effectiveness of the proposed approach.
引用
收藏
页码:1163 / 1174
页数:12
相关论文
共 50 条
  • [1] Adaptive Fault-Tolerant Tracking Control for MIMO Discrete-Time Systems via Reinforcement Learning Algorithm With Less Learning Parameters
    Liu, Lei
    Wang, Zhanshan
    Zhang, Huaguang
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2017, 14 (01) : 299 - 313
  • [2] Distributed Fault-Tolerant Containment Control Protocols for the Discrete-Time Multiagent Systems via Reinforcement Learning Method
    Li, Tieshan
    Bai, Weiwei
    Liu, Qi
    Long, Yue
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (08) : 3979 - 3991
  • [3] Robust Fault-tolerant Tracking Control for Linear Discrete-time Systems via Reinforcement Learning Method
    Nguyen, Ngoc Hoai An
    Kim, Sung Hyun
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2025, 23 (02) : 520 - 529
  • [4] Model free adaptive fault-tolerant tracking control for a class of discrete-time systems
    Wang, Yuan
    Wang, Zhanshan
    NEUROCOMPUTING, 2020, 412 : 143 - 151
  • [5] Fault-Tolerant Controller Design for a Class of Nonlinear MIMO Discrete-Time Systems via Online Reinforcement Learning Algorithm
    Wang, Zhanshan
    Liu, Lei
    Zhang, Huaguang
    Xiao, Geyang
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2016, 46 (05): : 611 - 622
  • [6] Fault-tolerant control of discrete-time switched systems
    Hong, Xiaofeng
    Xu, Housheng
    Sun, Hongfei
    2007 IEEE INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION, VOLS 1-7, 2007, : 1202 - +
  • [7] Event-based adaptive fixed-time optimal control for saturated fault-tolerant nonlinear multiagent systems via reinforcement learning algorithm
    Yue, Huarong
    Xia, Jianwei
    Zhang, Jing
    Park, Ju H.
    Xie, Xiangpeng
    NEURAL NETWORKS, 2025, 183
  • [8] Adaptive Fault-Tolerant Tracking Control for Affine Nonlinear Systems With Unknown Dynamics via Reinforcement Learning
    Roshanravan, Sajad
    Shamaghdari, Saeed
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (01) : 569 - 580
  • [9] Simultaneous fault estimation and fault-tolerant tracking control for uncertain nonlinear discrete-time systems
    Zhou, Meng
    Wang, Zhenhua
    Shen, Yi
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2017, 48 (07) : 1367 - 1379
  • [10] Adaptive Fault-Tolerant Consensus Tracking of Multiagent Systems via Event-Triggered Control
    Wang, Yifeng
    Zhao, Guanglei
    Zhu, Lingchen
    Liu, Shuang
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 4798 - 4803