Integral Reinforcement Learning Control for a Class of High-Order Multivariable Nonlinear Dynamics With Unknown Control Coefficients

被引:3
作者
Wang, Qingling [1 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
关键词
MIMO communication; Performance analysis; Nonlinear systems; Closed loop systems; Manganese; Learning (artificial intelligence); Artificial neural networks; Nussbaum-type functions; integral reinforcement learning; unknown control coefficients; nonsquare multivariable systems; FREQUENCY GAIN SIGNS; ADAPTIVE-CONTROL; COOPERATIVE CONTROL; SYSTEMS; CONSENSUS; DESIGN; AGENTS; NETWORKS;
D O I
10.1109/ACCESS.2020.2993265
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper develops an integral reinforcement learning (IRL) controller for a class of high-order multivariable nonlinear systems with unknown control coefficients (UCCs). A new long-term performance index is first presented, and then the critic neural network (NN) and the action NN are presented to estimate the unobtainable long-term performance index and the unknown drift of systems, respectively. By combining the critic and action NNs with Nussbaum-type functions, the IRL controllers for high-order, nonsquare multivariable systems are proposed to cope with the problem of UCCs. The analysis are given to illustrate that the stability of the closed-loop system can be obtained, and the signals of the closed-loop systems are semiglobally uniformly ultimately bounded (UUB). Finally, one simulation example is provided to show the effectiveness of the proposed IRL controllers.
引用
收藏
页码:86223 / 86229
页数:7
相关论文
共 36 条
[1]   Two solutions to the adaptive visual servoing problem [J].
Astolfi, A ;
Hsu, L ;
Netto, MS ;
Ortega, R .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 2002, 18 (03) :387-392
[2]   Adaptive Consensus of Multi-Agent Systems With Unknown Identical Control Directions Based on A Novel Nussbaum-Type Function [J].
Chen, Weisheng ;
Li, Xiaobo ;
Ren, Wei ;
Wen, Changyun .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (07) :1887-1892
[3]   Adaptive consensus output regulation of a class of nonlinear systems with unknown high-frequency gain [J].
Ding, Zhengtao .
AUTOMATICA, 2015, 51 :348-355
[4]   Adaptive autopilot design of time-varying uncertain ships with completely unknown control coefficient [J].
Du, Jialu ;
Guo, Chen ;
Yu, Shuanghe ;
Zhao, Yongsheng .
IEEE JOURNAL OF OCEANIC ENGINEERING, 2007, 32 (02) :346-352
[5]   Direct adaptive NN control of a class of nonlinear systems [J].
Ge, SS ;
Wang, C .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (01) :214-221
[6]   Adaptive neural control of nonlinear time-delay systems with unknown virtual control coefficients [J].
Ge, SZS ;
Hong, F ;
Lee, TH .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (01) :499-516
[7]   Integral Reinforcement Learning-Based Adaptive NN Control for Continuous-Time Nonlinear MIMO Systems With Unknown Control Directions [J].
Guo, Xinxin ;
Yan, Weisheng ;
Cui, Rongxin .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (11) :4068-4077
[8]  
Haykin S. S., 1999, Neural Networks: A Comprehensive Foundation, V2nd
[9]   Reinforcement learning-based output feedback control of nonlinear systems with input constraints [J].
He, P ;
Jagannathan, S .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2005, 35 (01) :150-154
[10]   Tuning function design for nonlinear adaptive control systems with multiple unknown control directions [J].
Huang, Chao ;
Yu, Changbin .
AUTOMATICA, 2018, 89 :259-265