Event-triggered optimal control for nonlinear stochastic systems via adaptive dynamic programming

被引:0
作者
Guoping Zhang
Quanxin Zhu
机构
[1] Hunan Normal University,MOE
来源
Nonlinear Dynamics | 2021年 / 105卷
关键词
Event-triggered control; Optimal control; Adaptive dynamic programming (ADP); Nonlinear Itô-type stochastic systems; Hamilton–Jacobi–Bellman (HJB) equation; Neural network;
D O I
暂无
中图分类号
学科分类号
摘要
For nonlinear Itô-type stochastic systems, the problem of event-triggered optimal control (ETOC) is studied in this paper, and the adaptive dynamic programming (ADP) approach is explored to implement it. The value function of the Hamilton–Jacobi–Bellman(HJB) equation is approximated by applying critical neural network (CNN). Moreover, a new event-triggering scheme is proposed, which can be used to design ETOC directly via the solution of HJB equation. By utilizing the Lyapunov direct method, it can be proved that the ETOC based on ADP approach can ensure that the CNN weight errors and states of system are semi-globally uniformly ultimately bounded in probability. Furthermore, an upper bound is given on predetermined cost function. Specifically, there has been no published literature on the ETOC for nonlinear Itô-type stochastic systems via the ADP method. This work is the first attempt to fill the gap in this subject. Finally, the effectiveness of the proposed method is illustrated through two numerical examples.
引用
收藏
页码:387 / 401
页数:14
相关论文
共 95 条
[11]  
Che W(2015)Event-triggered control for networked control systems with quantization and packet losses J. Franklin Inst. 352 974-986
[12]  
Shi P(2020)Probabilistic-constrained distributed filtering for a class of nonlinear stochastic systems subject to periodic DoS attacks IEEE Trans. Circuits Syst. I Regular Papers 67 5369-5379
[13]  
Yu H(2021)Itô-Taylor-based square-root unscented Kalman filtering methods for state estimation in nonlinear continuous-discrete stochastic systems Europ. J. Control 58 101-113
[14]  
Hao F(2019)Stabilization of stochastic nonlinear delay systems with exogenous disturbances and the event-triggered feedback control IEEE Trans. Automatic Control 64 3764-3771
[15]  
Hu W(2019)On event-triggered control of nonlinear stochastic systems IEEE Trans. Automatic Control 65 369-375
[16]  
Liu L(1977)Advanced forecasting methods for global crisis warning and models of intelligence General Syst. Yearbook 22 25-38
[17]  
Feng G(2008)Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof, IEEE Transactions on Systems, Man, and Cybernetics Part B (Cybernetics) 38 943-949
[18]  
Hu T(2015)Global adaptive dynamic programming for continuous-time nonlinear systems IEEE Trans. Automatic Control 60 2917-2919
[19]  
He Z(2018)On mixed data and event driven design for adaptive-critic-based nonlinear IEEE Trans. Neural Netw. Learn. Syst. 29 993-1005
[20]  
Zhang X(2020) control Neurocomputing 396 191-200