Reinforcement learning-based event-triggered optimal control for unknown nonlinear systems with input delay

被引:1
|
作者
Chen, Xiangyu [1 ]
Sun, Weiwei [1 ]
Gao, Xinci [1 ]
Li, Yongshu [1 ]
机构
[1] Qufu Normal Univ, Inst Automat, Qufu 273165, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
event-triggered control; nonlinear systems; optimal control; reinforcement learning; time-delay; unknown dynamics; OUTPUT-FEEDBACK CONTROL; LINEAR-SYSTEMS; TIME; STABILIZATION;
D O I
10.1002/rnc.7236
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The optimal control issue of discrete-time nonlinear unknown systems with time-delay control input is the focus of this work. In order to reduce communication costs, a reinforcement learning-based event-triggered controller is proposed. By applying the proposed control method, closed-loop system's asymptotic stability is demonstrated, and a maximum upper bound for the infinite-horizon performance index can be calculated beforehand. The event-triggered condition requires the next time state information. In an effort to forecast the next state and achieve optimal control, three neural networks (NNs) are introduced and used to approximate system state, value function, and optimal control. Additionally, a M NN is utilized to cope with the time-delay term of control input. Moreover, taking the estimation errors of NNs into account, the uniformly ultimately boundedness of state and NNs weight estimation errors can be guaranteed. Ultimately, the validity of proposed approach is illustrated by simulations.
引用
收藏
页码:4844 / 4863
页数:20
相关论文
共 50 条
  • [1] Reinforcement Learning-Based Event-Triggered Optimal Control of Power Systems With Control Input Saturation
    Gu, Zhou
    Cao, Ruiyan
    Tian, Engang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2025, 21 (02) : 1528 - 1536
  • [2] Reinforcement Learning-Based Event-Triggered Optimal Control of Power Systems With Control Input Saturation
    Gu, Zhou
    Cao, Ruiyan
    Tian, Engang
    IEEE Transactions on Industrial Informatics, 2024,
  • [3] Observer-Based Event-Triggered Optimal Control for Nonlinear Multiagent Systems With Input Delay via Reinforcement Learning Strategy
    Wang, Xin
    Liao, Yujie
    Tan, Lihua
    Zhang, Wei
    Li, Huaqing
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024,
  • [4] Reinforcement Learning-Based Event-Triggered Predefined-Time Optimal Fuzzy Control for Nonlinear Constrained Systems
    Song, Xiaona
    Sun, Peng
    Ahn, Choon Ki
    Song, Shuai
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2024, 32 (08) : 4646 - 4659
  • [5] Event-Triggered Reinforcement Learning-Based Adaptive Tracking Control for Completely Unknown Continuous-Time Nonlinear Systems
    Guo, Xinxin
    Yan, Weisheng
    Cui, Rongxin
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (07) : 3231 - 3242
  • [6] Data-driven-based event-triggered optimal control of unknown nonlinear systems with input constraints
    Shanlin Liu
    Ben Niu
    Guangdeng Zong
    Xudong Zhao
    Ning Xu
    Nonlinear Dynamics, 2022, 109 : 891 - 909
  • [7] A learning-based approach to event-triggered guaranteed cost control for completely unknown nonlinear systems
    Liang, Yuling
    Zhang, Jun
    Zhao, Hui
    Su, Hanguang
    Cui, Xiaohong
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2024, 46 (06) : 1203 - 1218
  • [8] Data-driven-based event-triggered optimal control of unknown nonlinear systems with input constraints
    Liu, Shanlin
    Niu, Ben
    Zong, Guangdeng
    Zhao, Xudong
    Xu, Ning
    NONLINEAR DYNAMICS, 2022, 109 (02) : 891 - 909
  • [9] Event-Triggered Optimal Neuro-Controller Design With Reinforcement Learning for Unknown Nonlinear Systems
    Yang, Xiong
    He, Haibo
    Liu, Derong
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (09): : 1866 - 1878
  • [10] Distributed event-triggered optimal bipartite consensus control for multiagent systems with input delay via reinforcement learning method
    Zhang, Jing
    Ma, Hui
    Zhang, Yun
    Chen, Yang
    ASIAN JOURNAL OF CONTROL, 2023, 25 (06) : 4834 - 4852