Robust local stability of multilayer recurrent neural networks

被引:40
作者
Suykens, JAK [1 ]
De Moor, B [1 ]
Vandewalle, J [1 ]
机构
[1] Katholieke Univ Leuven, Dept Elect Engn, ESAT SISTA, B-3001 Heverlee, Belgium
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2000年 / 11卷 / 01期
关键词
dynamic backpropagation; linearization; matrix inequalities; NLq theory;
D O I
10.1109/72.822525
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we derive a condition for robust local stability of multilayer recurrent neural networks with two hidden layers, The stability condition follows from linking theory about linearization, robustness analysis of linear systems under nonlinear perturbation and matrix inequalities. A characterization of the basin of attraction of the origin is given in terms of the level set of a quadratic Lyapunov function. In a similar way like for NLq theory, local stability is imposed around the origin and the apparent basin of attraction is made large by applying the criterion, while the proven basin of attraction is relatively small due to conservatism of the criterion. Modifying dynamic backpropagation by the new stability condition is discussed and illustrated by simulation examples.
引用
收藏
页码:222 / 229
页数:8
相关论文
共 29 条
[1]   UNIVERSAL APPROXIMATION BOUNDS FOR SUPERPOSITIONS OF A SIGMOIDAL FUNCTION [J].
BARRON, AR .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1993, 39 (03) :930-945
[2]  
Bishop C. M., 1995, NEURAL NETWORKS PATT
[3]  
Boyd S., 1994, SIAM STUDIES APPL MA
[4]  
BROCKETT RW, 1966, IEEE T AUTOMAT C JUL, P597
[5]   ADAPTIVELY CONTROLLING NONLINEAR CONTINUOUS-TIME SYSTEMS USING MULTILAYER NEURAL NETWORKS [J].
CHEN, FC ;
LIU, CC .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1994, 39 (06) :1306-1310
[6]  
Cherkassky V.S., 1998, LEARNING DATA CONCEP, V1st ed.
[7]  
Fletcher R., 1987, PRACTICAL METHODS OP, DOI [DOI 10.1002/9781118723203, 10.1002/9781118723203]
[8]  
Haykin S., 1994, NEURAL NETWORKS COMP
[9]   MULTILAYER FEEDFORWARD NETWORKS ARE UNIVERSAL APPROXIMATORS [J].
HORNIK, K ;
STINCHCOMBE, M ;
WHITE, H .
NEURAL NETWORKS, 1989, 2 (05) :359-366
[10]   Discrete-time model reference adaptive control of nonlinear dynamical systems using neural networks [J].
Jagannathan, S ;
Lewis, FL ;
Pastravanu, O .
INTERNATIONAL JOURNAL OF CONTROL, 1996, 64 (02) :217-239