Diagonal recurrent neural network based identification of nonlinear dynamical systems with Lyapunov stability based adaptive learning rates

被引:50
作者
Kumar, Rajesh [1 ]
Srivastava, Smriti [2 ]
Gupta, J. R. P. [2 ]
Mohindru, Amit [3 ]
机构
[1] Bharati Vidyapeeths Coll Engn, Dept Instrumentat & Control Engn, A-4, New Delhi 110063, India
[2] Netaji Subhas Inst Technol, Div Instrumentat & Control Engn, Sect 3, New Delhi 110078, India
[3] Indraprastha Inst Informat Technol, Dept Elect & Commun Engn, New Delhi 110020, India
关键词
Diagonal recurrent neural network; Nonlinear system identification; Radial basis function network; Multi-layer feed forward neural network; Robustness; Lyapunov stability based dynamic learning rate; ONLINE IDENTIFICATION;
D O I
10.1016/j.neucom.2018.01.073
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a diagonal recurrent neural network (DRNN) based identification model for approximating the unknown dynamics of the nonlinear plants. The proposed model offers deeper memory and a simpler structure. Thereafter, we have developed a dynamic back-propagation learning algorithm for tuning the parameters of DRNN. Further, to guarantee the faster convergence and stability of the overall system, dynamic (adaptive) learning rates are developed in the sense of Lyapunov stability method. The proposed scheme is also compared with multi-layer feed forward neural network (MLFFNN) and radial basis function network (RBFN) based identification models. Numerical experiments reveal that DRNN has performed much better in approximating the dynamics of the plant and have also shown more robustness toward system uncertainties. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:102 / 117
页数:16
相关论文
共 37 条
[11]   IDENTIFICATION OF NON-LINEAR RATIONAL SYSTEMS USING A PREDICTION-ERROR ESTIMATION ALGORITHM [J].
BILLINGS, SA ;
CHEN, S .
INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 1989, 20 (03) :467-494
[12]   NONLINEAR-SYSTEM IDENTIFICATION USING NEURAL NETWORKS [J].
CHEN, S ;
BILLINGS, SA ;
GRANT, PM .
INTERNATIONAL JOURNAL OF CONTROL, 1990, 51 (06) :1191-1214
[13]   A context layered locally recurrent neural network for dynamic system identification [J].
Coban, Ramazan .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2013, 26 (01) :241-250
[14]   Dynamic neural networks with hybrid structures for nonlinear system identification [J].
Deng, Jiamei .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2013, 26 (01) :281-292
[15]   Identification of Hammerstein nonlinear ARMAX systems [J].
Ding, F ;
Chen, TW .
AUTOMATICA, 2005, 41 (09) :1479-1489
[16]   A comparative study of neural network structures in identification of nonlinear systems [J].
Efe, MO ;
Kaynak, O .
MECHATRONICS, 1999, 9 (03) :287-300
[17]   ON THE APPROXIMATE REALIZATION OF CONTINUOUS-MAPPINGS BY NEURAL NETWORKS [J].
FUNAHASHI, K .
NEURAL NETWORKS, 1989, 2 (03) :183-192
[18]   On-line identification and reconstruction of finite automata with generalized recurrent neural networks [J].
Gabrijel, I ;
Dobnikar, A .
NEURAL NETWORKS, 2003, 16 (01) :101-120
[19]   Nonlinear system modeling using a self-organizing recurrent radial basis function neural network [J].
Han, Hong-Gui ;
Guo, Ya-Nan ;
Qiao, Jun-Fei .
APPLIED SOFT COMPUTING, 2018, 71 :1105-1116
[20]   MULTILAYER FEEDFORWARD NETWORKS ARE UNIVERSAL APPROXIMATORS [J].
HORNIK, K ;
STINCHCOMBE, M ;
WHITE, H .
NEURAL NETWORKS, 1989, 2 (05) :359-366