Event-triggered optimal control for nonlinear stochastic systems via adaptive dynamic programming

被引:0
作者
Guoping Zhang
Quanxin Zhu
机构
[1] Hunan Normal University,MOE
来源
Nonlinear Dynamics | 2021年 / 105卷
关键词
Event-triggered control; Optimal control; Adaptive dynamic programming (ADP); Nonlinear Itô-type stochastic systems; Hamilton–Jacobi–Bellman (HJB) equation; Neural network;
D O I
暂无
中图分类号
学科分类号
摘要
For nonlinear Itô-type stochastic systems, the problem of event-triggered optimal control (ETOC) is studied in this paper, and the adaptive dynamic programming (ADP) approach is explored to implement it. The value function of the Hamilton–Jacobi–Bellman(HJB) equation is approximated by applying critical neural network (CNN). Moreover, a new event-triggering scheme is proposed, which can be used to design ETOC directly via the solution of HJB equation. By utilizing the Lyapunov direct method, it can be proved that the ETOC based on ADP approach can ensure that the CNN weight errors and states of system are semi-globally uniformly ultimately bounded in probability. Furthermore, an upper bound is given on predetermined cost function. Specifically, there has been no published literature on the ETOC for nonlinear Itô-type stochastic systems via the ADP method. This work is the first attempt to fill the gap in this subject. Finally, the effectiveness of the proposed method is illustrated through two numerical examples.
引用
收藏
页码:387 / 401
页数:14
相关论文
共 95 条
[21]  
Zhong S(2020)Adaptive dynamic programming based event-triggered control for unknown continuous-time nonlinear systems with input constraints IEEE Trans. Syst. Man Cybern. Syst. 50 3189-3199
[22]  
Yang X(2017)Event-triggered adaptive dynamic programming for zero-sum game of partially unknown continuous-time nonlinear systems IEEE Trans. Neural Netw. Learn. Syst. 28 1941-1952
[23]  
He H(2017)Event-triggered adaptive dynamic programming for continuous-time systems with control constraints IEEE Trans. Ind. Electron. 64 4101-4109
[24]  
Qi W(2019)Event-triggered optimal control for partially unknown constrained-input systems via adaptive dynamic programming IEEE Trans. Syst. Man Cybern. Syst. 49 1866-1878
[25]  
Zong G(2020)Event-triggered optimal neuro-controller design with reinforcement learning for unknown nonlinear systems Neurocomputing 404 294-303
[26]  
Zheng W(2014)Event-triggered constrained robust control for partly-unknown nonlinear systems via ADP IEEE/CAA J. Automatica Sinica 1 282-293
[27]  
Yang J(2020)Event-triggered optimal adaptive control algorithm for continuous-time nonlinear systems IEEE Trans. Ind. Electron. 67 3054-3064
[28]  
Lu J(2019)Event-triggered decentralized tracking control of modular reconfigurable robots through adaptive dynamic programming Nonlinear Dyn. 95 2639-2657
[29]  
Li L(2020)Approximate-optimal control algorithm for constrained zero-sum differential games through event-triggering mechanism IEEE Trans. Neural Netw. Learn. Syst. 31 76-88
[30]  
Liu Y(2015)Event-triggered optimal control with performance guarantees using adaptive dynamic programming IEEE Trans. Cybern. 45 1372-1385