Adaptive Critic Learning and Experience Replay for Decentralized Event-Triggered Control of Nonlinear Interconnected Systems

被引:78
|
作者
Yang, Xiong [1 ]
He, Haibo [2 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Univ Rhode Isl, Dept Elect Comp & Biomed Engn, Kingston, RI 02881 USA
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Erbium; Interconnected systems; Optimal control; Artificial neural networks; Adaptive systems; Nonlinear systems; Dynamic programming; Adaptive critic learning (ACL); adaptive dynamic programming (ADP); event-triggered control (ETC); experience replay (ER); interconnected systems; reinforcement learning (RL); ROBUST-CONTROL;
D O I
10.1109/TSMC.2019.2898370
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we develop a decentralized event-triggered control (ETC) strategy for a class of nonlinear systems with uncertain interconnections. To begin with, we show that the decentralized ETC policy for the whole system can be represented by a group of optimal ETC laws of auxiliary subsystems. Then, under the framework of adaptive critic learning, we construct the critic networks to solve the event-triggered Hamilton-Jacobi-Bellman equations related to these optimal ETC laws. The weight vectors used in the critic networks are updated by using the gradient descent approach and the experience replay (ER) technique together. With the aid of the ER technique, we can conquer the difficulty arising in the persistence of excitation condition. Meanwhile, by using classic Lyapunov approaches, we prove that the estimated weight vectors used in the critic networks are uniformly ultimately bounded. Moreover, we demonstrate that the obtained decentralized ETC can force the overall system to be asymptotically stable. Finally, we present an interconnected nonlinear plant to validate the proposed decentralized ETC scheme.
引用
收藏
页码:4043 / 4055
页数:13
相关论文
共 50 条
  • [1] Decentralized Event-Triggered Asymmetric Constrained Control Through Adaptive Critic Designs for Nonlinear Interconnected Systems
    Huo, Yu
    Wang, Ding
    Li, Menghua
    Qiao, Junfei
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (01): : 391 - 402
  • [2] Adaptive critic optimization to decentralized event-triggered control of continuous-time nonlinear interconnected systems
    Huo, Yu
    Wang, Ding
    Qiao, Junfei
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2022, 43 (01): : 198 - 212
  • [3] Decentralized Event-Triggered Adaptive Control for Interconnected Nonlinear Systems With Actuator Failures
    Xu, Lin-Xing
    Wang, Yu-Long
    Wang, Xiaofan
    Peng, Chen
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2023, 31 (01) : 148 - 159
  • [4] Adaptive-Critic Design for Decentralized Event-Triggered Control of Constrained Nonlinear Interconnected Systems Within an Identifier-Critic Framework
    Huo, Xin
    Karimi, Hamid Reza
    Zhao, Xudong
    Wang, Bohui
    Zong, Guangdeng
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (08) : 7478 - 7491
  • [5] Decentralized Adaptive Event-triggered Control for Nonlinear Interconnected Systems in Strict-feedback Form
    Ji, Yuehui
    Zhou, Hailiang
    Zong, Qun
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2020, 18 (04) : 980 - 990
  • [6] Decentralized Adaptive Event-triggered Control for Nonlinear Interconnected Systems in Strict-feedback Form
    Yuehui Ji
    Hailiang Zhou
    Qun Zong
    International Journal of Control, Automation and Systems, 2020, 18 : 980 - 990
  • [7] Decentralized Event-Triggered Control for a Class of Nonlinear-Interconnected Systems Using Reinforcement Learning
    Yang, Xiong
    He, Haibo
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (02) : 635 - 648
  • [8] Dynamic event-triggered decentralized control of interconnected systems
    Shi, Lei
    Wang, Xuesong
    Huang, Longyang
    Cheng, Yuhu
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2022, 32 (15) : 8628 - 8645
  • [9] Event-triggered robust adaptive critic control for nonlinear disturbed systems
    Wang, Ding
    Zhou, Zihang
    Liu, Ao
    Qiao, Junfei
    NONLINEAR DYNAMICS, 2023, 111 (21) : 19963 - 19977
  • [10] Event-triggered robust adaptive critic control for nonlinear disturbed systems
    Ding Wang
    Zihang Zhou
    Ao Liu
    Junfei Qiao
    Nonlinear Dynamics, 2023, 111 : 19963 - 19977