An Overview of the Stability Analysis of Recurrent Neural Networks With Multiple Equilibria

被引:41
作者
Liu, Peng [1 ,2 ]
Wang, Jun [3 ]
Zeng, Zhigang [4 ,5 ]
机构
[1] Zhengzhou Univ Light Ind, Sch Elect & Informat Engn, Zhengzhou 450002, Peoples R China
[2] Henan Key Lab Informat Based Elect Appliances, Zhengzhou 450002, Peoples R China
[3] City Univ Hong Kong, Sch Data Sci, Dept Comp Sci, Hong Kong, Peoples R China
[4] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Wuhan 430074, Peoples R China
[5] Educ Minist China, Key Lab Image Proc & Intelligent Control, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Stability criteria; Switches; Recurrent neural networks; Mathematical model; Stairs; Delay effects; Analytical models; Complete stability; multiple equilibria; multistability; recurrent neural networks (RNNs); LINEAR ACTIVATION FUNCTIONS; LIMIT SET DICHOTOMY; MU-STABILITY; MULTISTABILITY ANALYSIS; ASSOCIATIVE MEMORY; LOCAL STABILITY; GENERAL-CLASS; CONVERGENCE; MULTIPERIODICITY; DYNAMICS;
D O I
10.1109/TNNLS.2021.3105519
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The stability analysis of recurrent neural networks (RNNs) with multiple equilibria has received extensive interest since it is a prerequisite for successful applications of RNNs. With the increasing theoretical results on this topic, it is desirable to review the results for a systematical understanding of the state of the art. This article provides an overview of the stability results of RNNs with multiple equilibria including complete stability and multistability. First, preliminaries on the complete stability and multistability analysis of RNNs are introduced. Second, the complete stability results of RNNs are summarized. Third, the multistability results of various RNNs are reviewed in detail. Finally, future directions in these interesting topics are suggested.
引用
收藏
页码:1098 / 1111
页数:14
相关论文
共 159 条
  • [1] DISTINCTIVE FEATURES, CATEGORICAL PERCEPTION, AND PROBABILITY-LEARNING - SOME APPLICATIONS OF A NEURAL MODEL
    ANDERSON, JA
    SILVERSTEIN, JW
    RITZ, SA
    JONES, RS
    [J]. PSYCHOLOGICAL REVIEW, 1977, 84 (05) : 413 - 451
  • [2] New Results on Impulsive Cohen-Grossberg Neural Networks
    Aouiti, Chaouki
    Dridi, Farah
    [J]. NEURAL PROCESSING LETTERS, 2019, 49 (03) : 1459 - 1483
  • [3] Nonlinear Lipschitz measure and adaptive control for stability and synchronization in delayed inertial Cohen-Grossberg-type neural networks
    Aouiti, Chaouki
    Assali, El Abed
    [J]. INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2019, 33 (10) : 1457 - 1477
  • [4] Stability analysis for a class of impulsive high-order Hopfield neural networks with leakage time-varying delays
    Aouiti, Chaouki
    Assali, El Abed
    [J]. NEURAL COMPUTING & APPLICATIONS, 2019, 31 (11) : 7781 - 7803
  • [5] Global exponential convergence of neutral-type competitive neural networks with multi-proportional delays, distributed delays and time-varying delay in leakage delays
    Aouiti, Chaouki
    Assali, El abed
    Cao, Jinde
    Alsaedi, Ahmed
    [J]. INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2018, 49 (10) : 2202 - 2214
  • [6] Arik S, 1996, INT J CIRC THEOR APP, V24, P269, DOI 10.1002/(SICI)1097-007X(199605/06)24:3<269::AID-CTA915>3.0.CO
  • [7] 2-L
  • [8] Equilibrium analysis of delayed CNN's
    Arik, S
    Tavsanoglu, V
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 1998, 45 (02): : 168 - 171
  • [9] Multistability of periodic delayed recurrent neural network with memristors
    Bao, Gang
    Zeng, Zhigang
    [J]. NEURAL COMPUTING & APPLICATIONS, 2013, 23 (7-8) : 1963 - 1967
  • [10] Analysis and design of associative memories based on recurrent neural network with discontinuous activation functions
    Bao, Gang
    Zeng, Zhigang
    [J]. NEUROCOMPUTING, 2012, 77 (01) : 101 - 107