Learning-Based Event-Triggered Tracking Control for Nonlinear Networked Control Systems With Unmatched Disturbance

被引:32
作者
Liu, Jinliang [1 ]
Zhang, Nan [1 ]
Li, Yan [1 ]
Xie, Xiangpeng [2 ]
Tian, Engang [3 ]
Cao, Jinde [4 ,5 ]
机构
[1] Nanjing Univ Finance & Econ, Coll Informat Engn, Nanjing 210023, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Inst Adv Technol, Nanjing 210023, Peoples R China
[3] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
[4] Southeast Univ, Sch Math, Nanjing 210096, Jiangsu, Peoples R China
[5] Southeast Univ, Res Ctr Complex Syst & Network Sci, Nanjing 210096, Jiangsu, Peoples R China
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2023年 / 53卷 / 05期
关键词
Event-triggered mechanism; networked control systems (NCSs); reinforcement learning (RL); tracking control; uniformly ultimately bounded (UUB);
D O I
10.1109/TSMC.2022.3224432
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article concentrates on optimal tracking control for a class of nonlinear networked systems subjecting to limited network bandwidth and unmatched disturbance. Given the models of the control and reference systems, the considered optimal tracking control issue is initially formulated as a minimax optimization problem. Then, with the introduction of an event-triggered mechanism used for saving bandwidth, the formulated problem is transformed into solving an event-based Hamilton-Jacobi-Isaacs (HJI) equation by recurring to the Bellman optimality theory. Based on the HJI equation, we demonstrate that the stability of the concerned system in the sense of uniformly ultimately bounded (UUB) can be guaranteed with the envisioned optimal control and worst disturbance policies. Here, the disturbance policy can be varied periodically while the control policy can only be updated at event-triggering instants, which differs from the existed researches. Furthermore, we propose a reinforcement learning (RL)-based algorithm to handle the constructed HJI equation and thus settle the studied tracking control problem. The effectiveness of the algorithm is finally validated by both theoretical analysis and simulations.
引用
收藏
页码:3230 / 3240
页数:11
相关论文
共 38 条
[1]  
[Anonymous], 2006, ADV IND CON
[2]   Event-Triggered Multigradient Recursive Reinforcement Learning Tracking Control for Multiagent Systems [J].
Bai, Weiwei ;
Li, Tieshan ;
Long, Yue ;
Chen, C. L. Philip .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (01) :366-379
[3]   Data-Based Optimal Control for Weakly Coupled Nonlinear Systems Using Policy Iteration [J].
Li, Chao ;
Liu, Derong ;
Wang, Ding .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2018, 48 (04) :511-521
[4]   Off-Policy Interleaved Q-Learning: Optimal Control for Affine Nonlinear Discrete-Time Systems [J].
Li, Jinna ;
Chai, Tianyou ;
Lewis, Frank L. ;
Ding, Zhengtao ;
Jiang, Yi .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (05) :1308-1320
[5]   ADP-Based Online Tracking Control of Partially Uncertain Time-Delayed Nonlinear System and Application to Wheeled Mobile Robots [J].
Li, Shu ;
Ding, Liang ;
Gao, Haibo ;
Liu, Yan-Jun ;
Huang, Lan ;
Deng, Zongquan .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (07) :3182-3194
[6]   Decentralized event-triggered synchronization control for complex networks with nonperiodic DoS attacks [J].
Li, Yan ;
Song, Feiyu ;
Liu, Jinliang ;
Xie, Xiangpeng ;
Tian, Engang .
INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2022, 32 (03) :1633-1653
[7]   An optimal control approach to robust control of robot manipulators [J].
Lin, F ;
Brandt, RD .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1998, 14 (01) :69-77
[8]   Security Control for T-S Fuzzy Systems With Adaptive Event-Triggered Mechanism and Multiple Cyber-Attacks [J].
Liu, Jinliang ;
Yin, Tingting ;
Cao, Jie ;
Yue, Dong ;
Karimi, Hamid Reza .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (10) :6544-6554
[9]   Event-based security tracking control for networked control systems against stochastic cyber-attacks [J].
Liu, Jinliang ;
Dong, Yanhui ;
Zha, Lijuan ;
Tian, Engang ;
Xie, Xiangpeng .
INFORMATION SCIENCES, 2022, 612 :306-321
[10]   Stabilization of Networked Control Systems With Hybrid-Driven Mechanism and Probabilistic Cyber Attacks [J].
Liu, Jinliang ;
Wu, Zheng-Guang ;
Yue, Dong ;
Park, Ju H. .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (02) :943-953