Event-Driven Guaranteed Cost Control Design for Nonlinear Systems With Actuator Faults via Reinforcement Learning Algorithm

被引:110
作者
Zhang, Huaguang [1 ,2 ]
Liang, Yuling [2 ]
Su, Hanguang [2 ]
Liu, Chong [2 ]
机构
[1] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110004, Peoples R China
[2] Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110004, Peoples R China
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2020年 / 50卷 / 11期
基金
中国国家自然科学基金;
关键词
Actuators; Nonlinear systems; Heuristic algorithms; Approximation algorithms; Cost function; Process control; Event-driven control; fault tolerant control; guaranteed cost control; reinforcement learning (RL); sliding mode control (SMC); DISCRETE-TIME-SYSTEMS; INTEGRAL SLIDING-MODE; S FUZZY-SYSTEMS; TOLERANT CONTROL; POLICY ITERATION; ROBUST-CONTROL; CONTROL SCHEME; TRACKING;
D O I
10.1109/TSMC.2019.2946857
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article presents a novel event-driven guaranteed cost control method for nonlinear systems subject to actuator faults. For the purpose of handling the problem of actuator faults and obtaining the event-driven approximate optimal guaranteed cost control approach for general nonlinear dynamics, the reinforcement learning (RL) algorithm is utilized to develop a sliding-mode control (SMC) strategy. To begin with, the unknown faults can be estimated by designing a fault observer. Meanwhile, an SMC technique is presented aiming at countering the effect of abrupt faults. In addition, the optimal performance of the equivalent sliding mode dynamics is considered, then an event-driven guaranteed cost control mechanism is implemented by using RL principle. In the control process, a general cost function, which has a simpler structure, is given to reduce the computation complexity. At the same time, a modified cost function is approximated to obtain optimal guaranteed cost control by using a single critic neural network (NN). In addition, a modified weight update law for critic NN is presented to relax the persistence of excitation (PE) condition. Moreover, a newly triggering condition, which is easy to be implemented, is designed, and the critic NN update law makes sure that the system states are stable. Furthermore, in light of the Lyapunov analysis, it is demonstrated that the developed event-driven control method guarantees the uniformly ultimately bounded (UUB) property of all the signals. Finally, three simulation results are given to validate the designed control method.
引用
收藏
页码:4135 / 4150
页数:16
相关论文
共 62 条
[1]   A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems [J].
Bhasin, S. ;
Kamalapurkar, R. ;
Johnson, M. ;
Vamvoudakis, K. G. ;
Lewis, F. L. ;
Dixon, W. E. .
AUTOMATICA, 2013, 49 (01) :82-92
[2]   Adaptive Intelligent Control for Nonlinear Strict-Feedback Systems With Virtual Control Coefficients and Uncertain Disturbances Based on Event-Triggered Mechanism [J].
Cao, Liang ;
Li, Hongyi ;
Zhou, Qi .
IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (12) :3390-3402
[3]   Grid-Fault Control Scheme for Three-Phase Photovoltaic Inverters With Adjustable Power Quality Characteristics [J].
Castilla, Miguel ;
Miret, Jaume ;
Luis Sosa, Jorge ;
Matas, Jose ;
Garcia de Vicuna, Luis .
IEEE TRANSACTIONS ON POWER ELECTRONICS, 2010, 25 (12) :2930-2940
[4]   ADAPTIVE GUARANTEED COST CONTROL OF SYSTEMS WITH UNCERTAIN PARAMETERS [J].
CHANG, SSL ;
PENG, TKC .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1972, AC17 (04) :474-&
[5]  
Chowdhary G, 2011, P AMER CONTR CONF, P3547
[6]   Online Optimal Control of Affine Nonlinear Discrete-Time Systems With Unknown Internal Dynamics by Using Time-Based Policy Update [J].
Dierks, Travis ;
Jagannathan, Sarangapani .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (07) :1118-1129
[7]   Adaptive fault-tolerant control for affine non-linear systems based on approximate dynamic programming [J].
Fan, Quan-Yong ;
Yang, Guang-Hong .
IET CONTROL THEORY AND APPLICATIONS, 2016, 10 (06) :655-663
[8]   Adaptive Actor-Critic Design-Based Integral Sliding-Mode Control for Partially Unknown Nonlinear Systems With Input Disturbances [J].
Fan, Quan-Yong ;
Yang, Guang-Hong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (01) :165-177
[9]   Model-Based Approaches for Fast and Robust Fault Detection in an Aircraft Control Surface Servo Loop From Theory to Flight Tests [J].
Gheorghe, Anca ;
Zolghadri, Ali ;
Cieslak, Jerome ;
Goupil, Philippe ;
Dayre, Remy ;
Le Berre, Herve .
IEEE CONTROL SYSTEMS MAGAZINE, 2013, 33 (03) :20-+
[10]   Model-based reinforcement learning for approximate optimal regulation [J].
Kamalapurkar, Rushikesh ;
Walters, Patrick ;
Dixon, Warren E. .
AUTOMATICA, 2016, 64 :94-104