Integral reinforcement learning-based online adaptive event-triggered control for non-zero-sum games of partially unknown nonlinear systems

被引:44
|
作者
Su, Hanguang [2 ]
Zhang, Huaguang [1 ,2 ]
Sun, Shaoxin [2 ]
Cai, Yuliang [2 ]
机构
[1] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110004, Liaoning, Peoples R China
[2] Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110004, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Event-triggered control (ETC); Integral reinforcement learning (IRL); Adaptive dynamic programming (ADP); Adaptive critic design; Non-zero-sum (NZS) games; OPTIMAL TRACKING CONTROL; DIFFERENTIAL-GAMES; FEEDBACK CONTROL; TIME; ALGORITHM; HORIZON; INPUT;
D O I
10.1016/j.neucom.2019.09.088
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper develops an integral reinforcement learning (IRL)-based adaptive control method for the multi-player non-zero-sum (NZS) games of the nonlinear continuous-time systems with partially unknown dynamics, in the context of event-triggered mechanism. With the principle of IRL method, the requirement for the system drift dynamics is relaxed in the controller design. Moreover, different from the conventional iteration computation methods, the algorithm developed in this work is implemented in an online adaptive fashion, which provides a new way to combine the IRL algorithm and the event-triggered control framework in solving the NZS game issues. In the event-based algorithm, a state-dependent triggering condition is presented, which not only guarantees the closed-loop system stability, but also reduces the computation and communication loads of the controlled plant. By means of Lyapunov theorem, the uniform ultimate boundedness (UUB) properties of the system states and the critic weight estimation errors have been proved. Finally, two numerical examples are utilized to demonstrate the efficacy of the proposed method. (c) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:243 / 255
页数:13
相关论文
共 50 条
  • [1] Online event-triggered adaptive critic design for non-zero-sum games of partially unknown networked systems
    Su, Hanguang
    Zhang, Huaguang
    Liang, Yuling
    Mu, Yunfei
    NEUROCOMPUTING, 2019, 368 : 84 - 98
  • [2] Integral reinforcement learning-based event-triggered optimal tracking control for modular robot manipulators via non-zero-sum game
    Dong, Bo
    Ding, Zhendong
    An, Tianjiao
    Cui, Yiming
    Zhu, Xinye
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (09)
  • [3] Event-Triggered Optimal Tracking Control for Multiplayer Non-Zero-Sum Games of Nonlinear Systems via Concurrent Learning
    Qin, Yi
    Wang, Lijie
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 479 - 484
  • [4] Event-Triggered Adaptive Dynamic Programming for Non-Zero-Sum Games of Unknown Nonlinear Systems via Generalized Fuzzy Hyperbolic Models
    Zhang, Huaguang
    Su, Hanguang
    Zhang, Kun
    Luo, Yanhong
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2019, 27 (11) : 2202 - 2214
  • [5] Event-triggered adaptive integral reinforcement learning method for zero-sum differential games of nonlinear systems with incomplete known dynamics
    Liu, Pengda
    Zhang, Huaguang
    Sun, Jiayue
    Tan, Zilong
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (13): : 10775 - 10786
  • [6] Event-triggered adaptive integral reinforcement learning method for zero-sum differential games of nonlinear systems with incomplete known dynamics
    Pengda Liu
    Huaguang Zhang
    Jiayue Sun
    Zilong Tan
    Neural Computing and Applications, 2022, 34 : 10775 - 10786
  • [7] Reinforcement learning-based event-triggered optimal control for unknown nonlinear systems with input delay
    Chen, Xiangyu
    Sun, Weiwei
    Gao, Xinci
    Li, Yongshu
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (07) : 4844 - 4863
  • [8] Online event-triggered adaptive critic design for multi-player zero-sum games of partially unknown nonlinear systems with input constraints
    Liu, Pengda
    Zhang, Huaguang
    Ren, He
    Liu, Chong
    NEUROCOMPUTING, 2021, 462 : 309 - 319
  • [9] Dynamic event-triggered adaptive control for zero-sum games of nonlinear stochastic systems
    Liu, Pengda
    Liu, Zongmin
    Ao, Wengang
    Ming, Zhongyang
    Shi, Peng
    Transactions of the Institute of Measurement and Control, 2023,
  • [10] Dynamic event-triggered adaptive control for zero-sum games of nonlinear stochastic systems
    Liu, Pengda
    Liu, Zongmin
    Ao, Wengang
    Ming, Zhongyang
    Shi, Peng
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2023,