Multistability of Hopfield neural networks with a designed discontinuous sawtooth-type activation function

被引:18
|
作者
Liu, Yang [1 ]
Huang, Xia [2 ]
Li, Yuxia [2 ]
Shen, Hao [3 ]
机构
[1] Shandong Univ Sci & Technol, Coll Math & Syst Sci, Qingdao 266590, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Elect Engn & Automat, Qingdao 266590, Peoples R China
[3] Anhui Univ Technol, Elect & Informat Engn, Maanshan 243002, Peoples R China
基金
中国国家自然科学基金;
关键词
Discontinuous activation functions; Equilibrium point; Hopfield neural networks; Multistability; DYNAMICAL BEHAVIORS; ASSOCIATIVE MEMORY; MULTIPERIODICITY; STABILITY;
D O I
10.1016/j.neucom.2021.05.045
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a class of discontinuous sawtooth-type activation function is designed and the multistability of Hopfield neural networks (HNNs) with such kind of activation function is studied. By virtue of the Brouwer's fixed point theorem and the property of strictly diagonally dominant matrix (SDDM), some sufficient conditions are presented to ensure that the n-neuron HNN can have at least 7(n) equilibria, among which 4(n) equilibria are locally exponentially stable and the remaining 7(n)-4(n) equilibria are unstable. Then, the obtained results are extended to a more general case. We continue to increase the number of the peaks of the sawtooth-type activation function and we find that the n-neuron HNN can have (2k + 3)(n) equilibria, (k + 2)(n) of them are locally exponentially stable and the remaining equilibria are unstable. Therein, k denotes the total number of the peaks in the designed activation function. That is to say, there is a quantitative relationship between the number of the peaks and the number of the equilibria. It implies that one can improve the storage capacity of a HNN by increasing the number of the peaks of the activation function in theory and in practice. To some extent, this method is convenient and flexible. Compared with the existing results, HNN with the designed sawtooth-type activation function can have more total equilibria as well as more locally stable equilibria. Finally, two examples are presented to demonstrate the validity of the obtained results. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:189 / 201
页数:13
相关论文
共 50 条
  • [31] Multistability of state-dependent switching neural networks with discontinuous nonmonotonic piecewise linear activation functions
    Zhang, Jiahui
    Zhu, Song
    Lu, Nannan
    Wen, Shiping
    NEUROCOMPUTING, 2021, 437 (437) : 300 - 311
  • [32] Multistability of Quaternion-Valued Recurrent Neural Networks with Discontinuous Nonmonotonic Piecewise Nonlinear Activation Functions
    Weihao Du
    Jianglian Xiang
    Manchun Tan
    Neural Processing Letters, 2023, 55 : 5855 - 5884
  • [33] Multistability of Second-Order Competitive Neural Networks With Nondecreasing Saturated Activation Functions
    Nie, Xiaobing
    Cao, Jinde
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (11): : 1694 - 1708
  • [34] Multistability and instability of delayed competitive neural networks with nondecreasing piecewise linear activation functions
    Nie, Xiaobing
    Cao, Jinde
    Fei, Shumin
    NEUROCOMPUTING, 2013, 119 : 281 - 291
  • [35] Multistability of complex-valued recurrent neural networks with real-imaginary-type activation functions
    Huang, Yujiao
    Zhang, Huaguang
    Wang, Zhanshan
    APPLIED MATHEMATICS AND COMPUTATION, 2014, 229 : 187 - 200
  • [36] On Stability of Multiple Equilibria for Delayed Neural Networks with Discontinuous Activation Functions
    Nie Xiaobing
    Zheng Wei Xing
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 3542 - 3547
  • [37] Multistability and Instability of Competitive Neural Networks with Mexican-Hat-Type Activation Functions
    Nie, Xiaobing
    Cao, Jinde
    Fei, Shumin
    ABSTRACT AND APPLIED ANALYSIS, 2014,
  • [38] Multistability and multiperiodicity of high-order competitive neural networks with a general class of activation functions
    Nie, Xiaobing
    Huang, Zhenkun
    NEUROCOMPUTING, 2012, 82 : 1 - 13
  • [39] Multistability of delayed complex-valued recurrent neural networks with discontinuous real-imaginarytype activation functions
    黄玉娇
    胡海根
    Chinese Physics B, 2015, (12) : 275 - 283
  • [40] Strongly Unpredictable Oscillations of Hopfield-Type Neural Networks
    Akhmet, Marat
    Tleubergenova, Madina
    Nugayeva, Zakhira
    MATHEMATICS, 2020, 8 (10) : 1 - 14