Online Optimal Event-Triggered H∞ Control for Nonlinear Systems With Constrained State and Input

被引:55
作者
Song, Ruizhuo [1 ]
Liu, Lu [1 ]
Xia, Lina [1 ]
Lewis, Frank L. [2 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing Engn Res Ctr Ind Spectrum Imaging, Beijing 100083, Peoples R China
[2] Univ Texas Arlington, UTA Res Inst, Ft Worth, TX 76012 USA
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2023年 / 53卷 / 01期
基金
中国国家自然科学基金;
关键词
Optimal control; Mathematical models; Heuristic algorithms; Dynamic programming; Asymptotic stability; Approximation algorithms; Safety; Adaptive dynamic programming (ADP); constrained system; event-triggered (ET); H∞ control; ZERO-SUM GAMES; DESIGN;
D O I
10.1109/TSMC.2022.3173275
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Taking safety and performance into consideration, the state and control input of the actual engineering system are often constrained. For this kind of problem, this article puts forward an online dual event-triggered (ET) adaptive dynamic programming (ADP) optimal control algorithm for a class of nonlinear systems with constrained state and input. First, the original system is transformed into another system through the barrier function, after that, a suitable value function with a nonquadratic utility function is designed to obtain the optimal control pair. In addition, on the premise of the asymptotic stability of the system, the trigger condition is devised, and the intersampling time analysis is proved that the algorithm can avoid the Zeno phenomenon. What is more, the critic, action, and disturbance neural networks (NNs) are trained to approximate value function and control sequences, subsequently, the approximation error is proved to be uniformly ultimately boundedness (UUB). Finally, two comparative experiments based on the robot arm model are simulated to verify that the algorithm can make control policies update only when the system has the requirement and keep satisfactory control effect, which can effectively decrease the number of data transfers and reduce the calculation burden.
引用
收藏
页码:131 / 141
页数:11
相关论文
共 36 条
[1]   Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach [J].
Abu-Khalaf, M ;
Lewis, FL .
AUTOMATICA, 2005, 41 (05) :779-791
[2]   Distributed Bipartite Adaptive Event-Triggered Fault-Tolerant Consensus Tracking for Linear Multiagent Systems Under Actuator Faults [J].
Cai, Yuliang ;
Zhang, Huaguang ;
Li, Weihua ;
Mu, Yunfei ;
He, Qiang .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (11) :11313-11324
[3]   Event-Triggered Adaptive Critic Control Design for Discrete-Time Constrained Nonlinear Systems [J].
Ha, Mingming ;
Wang, Ding ;
Liu, Derong .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (09) :3158-3168
[4]   Intermediate Observer-Based Robust Distributed Fault Estimation for Nonlinear Multiagent Systems With Directed Graphs [J].
Han, Jian ;
Liu, Xiuhua ;
Gao, Xianwen ;
Wei, Xinjiang .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (12) :7426-7436
[5]   Higher level application of ADP: A next phase for the control field? [J].
Lendaris, George G. .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2008, 38 (04) :901-912
[6]  
Lewis F. L., 2015, Optimal Control, V3rd
[7]  
Lewis F. L., 2012, OPTIMAL CONTROL
[8]   Reinforcement Learning and Adaptive Dynamic Programming for Feedback Control [J].
Lewis, Frank L. ;
Vrabie, Draguna .
IEEE CIRCUITS AND SYSTEMS MAGAZINE, 2009, 9 (03) :32-50
[9]   Reinforcement-Learning-Based Robust Controller Design for Continuous-Time Uncertain Nonlinear Systems Subject to Input Constraints [J].
Liu, Derong ;
Yang, Xiong ;
Wang, Ding ;
Wei, Qinglai .
IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (07) :1372-1385
[10]   Online Synchronous Approximate Optimal Learning Algorithm for Multiplayer Nonzero-Sum Games With Unknown Dynamics [J].
Liu, Derong ;
Li, Hongliang ;
Wang, Ding .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2014, 44 (08) :1015-1027