Adaptive Critic Learning and Experience Replay for Decentralized Event-Triggered Control of Nonlinear Interconnected Systems

被引:78
|
作者
Yang, Xiong [1 ]
He, Haibo [2 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Univ Rhode Isl, Dept Elect Comp & Biomed Engn, Kingston, RI 02881 USA
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Erbium; Interconnected systems; Optimal control; Artificial neural networks; Adaptive systems; Nonlinear systems; Dynamic programming; Adaptive critic learning (ACL); adaptive dynamic programming (ADP); event-triggered control (ETC); experience replay (ER); interconnected systems; reinforcement learning (RL); ROBUST-CONTROL;
D O I
10.1109/TSMC.2019.2898370
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we develop a decentralized event-triggered control (ETC) strategy for a class of nonlinear systems with uncertain interconnections. To begin with, we show that the decentralized ETC policy for the whole system can be represented by a group of optimal ETC laws of auxiliary subsystems. Then, under the framework of adaptive critic learning, we construct the critic networks to solve the event-triggered Hamilton-Jacobi-Bellman equations related to these optimal ETC laws. The weight vectors used in the critic networks are updated by using the gradient descent approach and the experience replay (ER) technique together. With the aid of the ER technique, we can conquer the difficulty arising in the persistence of excitation condition. Meanwhile, by using classic Lyapunov approaches, we prove that the estimated weight vectors used in the critic networks are uniformly ultimately bounded. Moreover, we demonstrate that the obtained decentralized ETC can force the overall system to be asymptotically stable. Finally, we present an interconnected nonlinear plant to validate the proposed decentralized ETC scheme.
引用
收藏
页码:4043 / 4055
页数:13
相关论文
共 50 条
  • [31] Quantization control of networked interconnected control systems with decentralized event-triggered scheme
    Shi, Jing
    Yue, Dong
    Zhang, Jin
    PROCEEDINGS OF 2018 5TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2018, : 193 - 197
  • [32] On designing of an adaptive event-triggered communication scheme for nonlinear networked interconnected control systems
    Gu, Zhou
    Yue, Dong
    Tian, Engang
    INFORMATION SCIENCES, 2018, 422 : 257 - 270
  • [33] Distributed event-triggered fuzzy control for nonlinear interconnected systems
    Pessim, Paulo S. P.
    Coutinho, Pedro Henrique Silva
    Lacerda, Marcio J.
    Palhares, Reinaldo Martinez
    CHAOS SOLITONS & FRACTALS, 2023, 177
  • [34] Reinforcement-learning-based decentralized event-triggered control of partially unknown nonlinear interconnected systems with state constraints
    Qin, Chunbin
    Wu, Yinliang
    Zhu, Tianzeng
    Jiang, Kaijun
    Zhang, Dehua
    APPLIED INTELLIGENCE, 2025, 55 (02)
  • [35] Adaptive Decentralized MAC for Event-Triggered Networked Control Systems
    Vilgelm, Mikhail
    Mamduhi, Mohammad H.
    Kellerer, Wolfgang
    Hirche, Sandra
    HSCC'16: PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON HYBRID SYSTEMS: COMPUTATION AND CONTROL, 2016, : 165 - 174
  • [36] Decentralized Periodic Event-Triggered Control for Nonlinear Switched Systems
    Fu, Anqi
    Dai, Yongji
    Qiao, Junfei
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2025, 35 (06) : 2367 - 2382
  • [37] NN-based decentralized adaptive event-triggered control for nonlinear interconnected systems under intermittent DoS and injection attacks
    Cui, Yahui
    Sun, Haibin
    Hou, Linlin
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2022, 36 (09) : 2249 - 2268
  • [38] An Event-Triggered Predefined Time Decentralized Output Feedback Fuzzy Adaptive Control Method for Interconnected Systems
    Xu, Hao
    Yu, Dengxiu
    Sui, Shuai
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2023, 31 (02) : 631 - 644
  • [39] Output-Based Decentralized Adaptive Event-Triggered Control of Interconnected Systems With Sensor/Actuator Failures
    Zhang, Zhirong
    Wen, Changyun
    Chen, Long
    Song, Yongduan
    Peng, Bowen
    Feng, Gang
    IEEE TRANSACTIONS ON CYBERNETICS, 2025, 55 (02) : 550 - 561
  • [40] Event-Triggered Adaptive Critic Control Design for Discrete-Time Constrained Nonlinear Systems
    Ha, Mingming
    Wang, Ding
    Liu, Derong
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (09): : 3158 - 3168