Adaptive Critic Learning and Experience Replay for Decentralized Event-Triggered Control of Nonlinear Interconnected Systems

被引:78
|
作者
Yang, Xiong [1 ]
He, Haibo [2 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Univ Rhode Isl, Dept Elect Comp & Biomed Engn, Kingston, RI 02881 USA
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2020年 / 50卷 / 11期
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Erbium; Interconnected systems; Optimal control; Artificial neural networks; Adaptive systems; Nonlinear systems; Dynamic programming; Adaptive critic learning (ACL); adaptive dynamic programming (ADP); event-triggered control (ETC); experience replay (ER); interconnected systems; reinforcement learning (RL); ROBUST-CONTROL;
D O I
10.1109/TSMC.2019.2898370
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we develop a decentralized event-triggered control (ETC) strategy for a class of nonlinear systems with uncertain interconnections. To begin with, we show that the decentralized ETC policy for the whole system can be represented by a group of optimal ETC laws of auxiliary subsystems. Then, under the framework of adaptive critic learning, we construct the critic networks to solve the event-triggered Hamilton-Jacobi-Bellman equations related to these optimal ETC laws. The weight vectors used in the critic networks are updated by using the gradient descent approach and the experience replay (ER) technique together. With the aid of the ER technique, we can conquer the difficulty arising in the persistence of excitation condition. Meanwhile, by using classic Lyapunov approaches, we prove that the estimated weight vectors used in the critic networks are uniformly ultimately bounded. Moreover, we demonstrate that the obtained decentralized ETC can force the overall system to be asymptotically stable. Finally, we present an interconnected nonlinear plant to validate the proposed decentralized ETC scheme.
引用
收藏
页码:4043 / 4055
页数:13
相关论文
共 50 条
  • [1] Adaptive critic optimization to decentralized event-triggered control of continuous-time nonlinear interconnected systems
    Huo, Yu
    Wang, Ding
    Qiao, Junfei
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2022, 43 (01) : 198 - 212
  • [2] Decentralized Event-Triggered Asymmetric Constrained Control Through Adaptive Critic Designs for Nonlinear Interconnected Systems
    Huo, Yu
    Wang, Ding
    Li, Menghua
    Qiao, Junfei
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (01): : 391 - 402
  • [3] Adaptive-Critic Design for Decentralized Event-Triggered Control of Constrained Nonlinear Interconnected Systems Within an Identifier-Critic Framework
    Huo, Xin
    Karimi, Hamid Reza
    Zhao, Xudong
    Wang, Bohui
    Zong, Guangdeng
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (08) : 7478 - 7491
  • [4] Decentralized Event-Triggered Control for a Class of Nonlinear-Interconnected Systems Using Reinforcement Learning
    Yang, Xiong
    He, Haibo
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (02) : 635 - 648
  • [5] Observer-Based Adaptive Fuzzy Decentralized Event-Triggered Control of Interconnected Nonlinear System
    Li, Yuan-Xin
    Tong, Shaocheng
    Yang, Guang-Hong
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (07) : 3104 - 3112
  • [6] Adaptive Critic Learning Control of Nonlinear Wind Turbine Systems via Integral Event-Triggered Scheme
    Yan, Shen
    Gu, Zhou
    Xie, Xiangpeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (09) : 4231 - 4235
  • [7] A Decentralized Learning Control Scheme for Constrained Nonlinear Interconnected Systems Based on Dynamic Event-Triggered Mechanism
    Wang, Jing
    Wu, Jiacheng
    Shen, Hao
    Cao, Jinde
    Rutkowski, Leszek
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (08): : 4934 - 4943
  • [8] Adaptive Critic Learning for Constrained Optimal Event-Triggered Control With Discounted Cost
    Yang, Xiong
    Wei, Qinglai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (01) : 91 - 104
  • [9] Dynamic event-triggered decentralized control of interconnected systems
    Shi, Lei
    Wang, Xuesong
    Huang, Longyang
    Cheng, Yuhu
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2022, 32 (15) : 8628 - 8645
  • [10] Event-Triggered Adaptive Critic Control Design for Discrete-Time Constrained Nonlinear Systems
    Ha, Mingming
    Wang, Ding
    Liu, Derong
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (09): : 3158 - 3168