Dynamic Event-Based Control for Stochastic Optimal Regulation of Nonlinear Networked Control Systems

被引:25
作者
Ming, Zhongyang [1 ]
Zhang, Huaguang [1 ,2 ]
Luo, Yanhong [1 ]
Wang, Wei [1 ]
机构
[1] Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110004, Liaoning, Peoples R China
[2] State Key Lab Synthet Automat Proc Ind & Sch Info, Shenyang 110004, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Delays; Stochastic systems; Dynamic programming; Packet loss; Stability criteria; Networked control systems; Approximation error; Adaptive dynamic programming (ADP); dynamic event-triggered; input-to-state stability; stochastic systems; TO-STATE STABILITY; DISCRETE-TIME-SYSTEMS; MULTIAGENT SYSTEMS; CONSENSUS; DESIGN;
D O I
10.1109/TNNLS.2022.3140478
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this article, a dynamic event-triggered stochastic adaptive dynamic programming (ADP)-based problem is investigated for nonlinear systems with a communication network. First, a novel condition of obtaining stochastic input-to-state stability (SISS) of discrete version is skillfully established. Then, the event-triggered control strategy is devised, and a near-optimal control policy is designed using an identifier-actor-critic neural networks (NNs) with an event-sampled state vector. Above all, an adaptive static event sampling condition is designed by using the Lyapunov technique to ensure ultimate boundedness (UB) for the closed-loop system. However, since the static event-triggered rule only depends on the current state, regardless of previous values, this article presents an explicit dynamic event-triggered rule. Furthermore, we prove that the lower bound of sampling interval for the proposed dynamic event-triggered control strategy is greater than one, which avoids the so-called triviality phenomenon. Finally, the effectiveness of the proposed near-optimal control pattern is verified by a simulation example.
引用
收藏
页码:7299 / 7308
页数:10
相关论文
共 25 条
[1]   Event-triggered consensus control for discrete-time stochastic multi-agent systems: The input-to-state stability in probability [J].
Ding, Derui ;
Wang, Zidong ;
Shen, Bo ;
Wei, Guoliang .
AUTOMATICA, 2015, 62 :284-291
[2]   Dynamic Triggering Mechanisms for Event-Triggered Control [J].
Girard, Antoine .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2015, 60 (07) :1992-1997
[3]   Stochastic optimal control and analysis of stability of networked control systems with long delay [J].
Hu, SS ;
Zhu, QX .
AUTOMATICA, 2003, 39 (11) :1877-1884
[4]   Input-to-state stability for discrete-time nonlinear systems [J].
Jiang, ZP ;
Wang, Y .
AUTOMATICA, 2001, 37 (06) :857-869
[5]   A converse Lyapunov theorem for discrete-time systems with disturbances [J].
Jiang, ZP ;
Wang, Y .
SYSTEMS & CONTROL LETTERS, 2002, 45 (01) :49-58
[6]   A STOCHASTIC REGULATOR FOR INTEGRATED COMMUNICATION AND CONTROL-SYSTEMS .1. FORMULATION OF CONTROL LAW [J].
LIOU, LW ;
RAY, A .
JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME, 1991, 113 (04) :604-611
[7]   A notion of stochastic input-to-state stability and its application to stability of cascaded stochastic nonlinear systems [J].
Liu, Shu-jun ;
Zhang, Ji-feng ;
Jiang, Zhong-ping .
ACTA MATHEMATICAE APPLICATAE SINICA-ENGLISH SERIES, 2008, 24 (01) :141-156
[8]  
Mu C., 2020, IEEE T CYBERNETICS, VPP, P1
[9]   Adaptive Learning and Sampled-Control for Nonlinear Game Systems Using Dynamic Event-Triggering Strategy [J].
Mu, Chaoxu ;
Wang, Ke ;
Ni, Zhen .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (09) :4437-4450
[10]   Approximate Optimal Control of Affine Nonlinear Continuous-Time Systems Using Event-Sampled Neurodynamic Programming [J].
Sahoo, Avimanyu ;
Xu, Hao ;
Jagannathan, Sarangapani .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (03) :639-652