Dynamic Event-Triggered Reinforcement Learning Control of Stochastic Nonlinear Systems

被引:25
|
作者
Zhu, Hao-Yang [1 ]
Li, Yuan-Xin [1 ]
Tong, Shaocheng [1 ]
机构
[1] Liaoning Univ Technol, Coll Sci, Jinzhou 121001, Peoples R China
关键词
Event-triggered control (ETC); fuzzy logic systems (FLSs); Hamilton-Jacobi-Bellman equation; optimized control; reinforcement learning (RL); stochastic systems; ADAPTIVE OPTIMAL-CONTROL; MULTIAGENT SYSTEMS; LINEAR-SYSTEMS;
D O I
10.1109/TFUZZ.2023.3235417
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article investigates the event-triggered optimized tracking control problem for stochastic nonlinear systems based on reinforcement learning (RL). By using the backstepping strategy, an adaptive RL algorithm is performed under the identifier-critic-actor architecture to achieve event-triggered optimized control (ETOC). Moreover, a novel dynamically adjustable event-triggered mechanism is delicately designed, which adjusts the triggering threshold online to economize communication resources and reduce the computation burden. To overcome the difficulty that the virtual control signals are discontinuous due to the state-triggering, the virtual controllers are designed with the continuous sampling states signals, and the actual optimal controller is redesigned by using the triggered states in the last step. Furthermore, the proposed ETOC in this article has significant advantages in terms of saving network resources because the event-triggered mechanism is employed in the sensor-to-controller channel and the event-sampled states are utilized to directly activate the control actions. Finally, it can be guaranteed that all signals of the stochastic system are bounded under the presented ETOC method. A simulation example is carried out to illustrate the effectiveness of the proposed ETOC algorithm.
引用
收藏
页码:2917 / 2928
页数:12
相关论文
共 50 条
  • [31] Stabilization of nonlinear stochastic systems via event-triggered impulsive control
    Kuang, Daipeng
    Gao, Dongdong
    Li, Jianli
    MATHEMATICS AND COMPUTERS IN SIMULATION, 2025, 233 : 389 - 399
  • [32] Dynamic event-triggered adaptive control for zero-sum games of nonlinear stochastic systems
    Liu, Pengda
    Liu, Zongmin
    Ao, Wengang
    Ming, Zhongyang
    Shi, Peng
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2023,
  • [33] Event-triggered control for stochastic interconnected nonlinear systems with unknown control directions
    Hua, Changchun
    Wang, Qiaona
    Ning, Pengju
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (04) : 2347 - 2364
  • [34] Event-triggered adaptive fuzzy tracking control for stochastic nonlinear systems
    Li, Baomin
    Xia, Jianwei
    Zhang, Huasheng
    Shen, Hao
    Wang, Zhen
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2020, 357 (14): : 9505 - 9522
  • [35] Reinforcement Learning-Based Adaptive Event-Triggered Fuzzy Control for Cyclic Switched Stochastic Nonlinear Systems With Actuator Faults
    Yan, Chengyuan
    Xia, Jianwei
    Park, Ju H.
    Xie, Xiangpeng
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2024, 32 (03) : 1131 - 1143
  • [36] Dynamic Event-Triggered Model-Free Reinforcement Learning for Cooperative Control of Multiagent Systems
    Wang, Ke
    Tang, Zhuo
    Mu, Chaoxu
    IEEE TRANSACTIONS ON RELIABILITY, 2024,
  • [37] Dynamic Event-Triggered Control of Networked Stochastic Systems With Scheduling Protocols
    Zhang, Jin
    Fridman, Emilia
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2021, 66 (12) : 6139 - 6147
  • [38] Event-triggered integral reinforcement learning for nonlinear continuous-time systems
    Zhang, Qichao
    Zhao, Dongbin
    2017 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2017, : 442 - 447
  • [39] Fault detection of nonlinear stochastic systems via a dynamic event-triggered strategy
    Ning, Zhaoke
    Wang, Tong
    Song, Xiaona
    Yu, Jinyong
    SIGNAL PROCESSING, 2020, 167
  • [40] Dynamic periodic event-triggered control for nonlinear systems with output dynamic quantization
    Almakhles, Dhafer
    Aranda-Escolastico, Ernesto
    Abdelrahim, Mahmoud
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2024, 361 (14):