Periodic event-triggered adaptive tracking control design for nonlinear discrete-time systems via reinforcement learning

被引:104
作者
Tang, Fanghua [1 ]
Niu, Ben [2 ]
Zong, Guangdeng [3 ]
Zhao, Xudong [1 ,4 ]
Xu, Ning [5 ]
机构
[1] Bohai Univ, Coll Control Sci & Engn, Jinzhou 121013, Liaoning, Peoples R China
[2] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250014, Peoples R China
[3] Qufu Normal Univ, Sch Engn, Rizhao 276826, Peoples R China
[4] Dalian Univ Technol, Fac Elect Informat & Elect Engn, Dalian 116024, Liaoning, Peoples R China
[5] Hangzhou Dianzi Univ, Inst Informat & Control, Hangzhou 310018, Peoples R China
关键词
Periodic event-triggered mechanism; Reinforcement learning (RL); Neural networks (NNs); Discrete-time systems;
D O I
10.1016/j.neunet.2022.06.039
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, an event-triggered control scheme with periodic characteristic is developed for nonlinear discrete-time systems under an actor-critic architecture of reinforcement learning (RL). The periodic event-triggered mechanism (ETM) is constructed to decide whether the sampling data are delivered to controllers or not. Meanwhile, the controller is updated only when the event-triggered condition deviates from a prescribed threshold. Compared with traditional continuous ETMs, the proposed periodic ETM can guarantee a minimal lower bound of the inter-event intervals and avoid sampling calculation point-to-point, which means that the partial communication resources can be efficiently economized. The critic and actor neural networks (NNs), consisting of radial basis function neural networks (RBFNNs), aim to approximate the unknown long-term performance index function and the ideal event-triggered controller, respectively. A rigorous stability analysis based on the Lyapunov difference method is provided to substantiate that the closed-loop system can be stabilized. All error signals of the closed-loop system are uniformly ultimately bounded (UUB) under the guidance of the proposed control scheme. Finally, two simulation examples are given to validate the effectiveness of the control design. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页码:43 / 55
页数:13
相关论文
共 47 条
[1]   Multigradient recursive reinforcement learning NN control for affine nonlinear systems with unmodeled dynamics [J].
Bai, Weiwei ;
Zhang, Bin ;
Zhou, Qi ;
Lu, Renquan .
INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2020, 30 (04) :1643-1663
[2]   Event-triggered sliding mode control for a class of nonlinear systems [J].
Behera, Abhisek K. ;
Bandyopadhyay, Bijnan .
INTERNATIONAL JOURNAL OF CONTROL, 2016, 89 (09) :1916-1931
[3]   Semi-global adaptive backstepping control for parametric strict-feedback systems with non-triangular structural uncertainties? [J].
Cai, Jianping ;
Mei, Congli ;
Yan, Qiuzhen .
ISA TRANSACTIONS, 2022, 126 :180-189
[4]   Adaptive Fuzzy Control of a Class of Nonlinear Systems by Fuzzy Approximation Approach [J].
Chen, Bing ;
Liu, Xiaoping P. ;
Ge, Shuzhi Sam ;
Lin, Chong .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2012, 20 (06) :1012-1021
[5]   Command filtering-based adaptive neural network control for uncertain switched nonlinear systems using event-triggered communication [J].
Chen, Zhongyu ;
Niu, Ben ;
Zhang, Liang ;
Zhao, Jinfeng ;
Ahmad, Adil M. ;
Alassafi, Madini O. .
INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2022, 32 (11) :6507-6522
[6]   Model-Based adaptive event-Triggered control of nonlinear continuous-Time systems [J].
Chen, Zhongyu ;
Niu, Ben ;
Zhao, Xudong ;
Zhang, Liang ;
Xu, Ning .
APPLIED MATHEMATICS AND COMPUTATION, 2021, 408
[7]   Decentralized adaptive neural two-bit-triggered control for nonstrict-feedback nonlinear systems with actuator failures [J].
Cheng, Fabin ;
Wang, Huanqing ;
Zhang, Liang ;
Ahmad, A. M. ;
Xu, Ning .
NEUROCOMPUTING, 2022, 500 :856-867
[8]   Event-triggered synchronization of discrete-time neural networks: A switching approach [J].
Ding, Sanbo ;
Wang, Zhanshan .
NEURAL NETWORKS, 2020, 125 :31-40
[9]   Quantization-Based Adaptive Actor-Critic Tracking Control With Tracking Error Constraints [J].
Fan, Quan-Yong ;
Yang, Guang-Hong ;
Ye, Dan .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (04) :970-980
[10]   Adaptive Neural network control of a helicopter system with optimal observer and actor-critic design [J].
Hager, LvS ;
Uren, K. R. ;
van Schoor, G. ;
van Rensburg, A. Janse .
NEUROCOMPUTING, 2018, 302 :75-90