Analysis and Design of Multivalued High-Capacity Associative Memories Based on Delayed Recurrent Neural Networks

被引:18
作者
Zhang, Jiahui [1 ]
Zhu, Song [1 ]
Bao, Gang [2 ]
Liu, Xiaoyang [3 ]
Wen, Shiping [4 ]
机构
[1] China Univ Min & Technol, Sch Math, Xuzhou 221116, Jiangsu, Peoples R China
[2] China Three Gorges Univ, Sch Hubei Key Lab Cascaded Hydropower Stat Operat, Yichang 443002, Peoples R China
[3] Jiangsu Normal Univ, Sch Comp Sci & Technol, Xuzhou 221116, Jiangsu, Peoples R China
[4] Univ Technol Sydney, Ctr Artificial Intelligence, Ultimo, NSW 2007, Australia
基金
中国国家自然科学基金;
关键词
Associative memory; Biological neural networks; Delays; Probes; Neurons; Delay effects; Stability analysis; exponential stability; mixed delays; multivalued activation functions; neural networks; ACTIVATION FUNCTIONS; EXTERNAL INPUTS; MULTISTABILITY; STABILITY;
D O I
10.1109/TCYB.2021.3095499
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article aims at analyzing and designing the multivalued high-capacity-associative memories based on recurrent neural networks with both asynchronous and distributed delays. In order to increase storage capacities, multivalued activation functions are introduced into associative memories. The stored patterns are retrieved by external input vectors instead of initial conditions, which can guarantee accurate associative memories by avoiding spurious equilibrium points. Some sufficient conditions are proposed to ensure the existence, uniqueness, and global exponential stability of the equilibrium point of neural networks with mixed delays. For neural networks with n neurons, m-dimensional input vectors, and 2k-valued activation functions, the autoassociative memories have (2k)(n) storage capacities and heteroassociative memories have min (2k)(n),(2k)(m) storage capacities. That is, the storage capacities of designed associative memories in this article are obviously higher than the 2(n) and min 2(n),2(m) storage capacities of the conventional ones. Three examples are given to support the theoretical results.
引用
收藏
页码:12989 / 13000
页数:12
相关论文
共 42 条
[1]   Finite-Time Stability of Delayed Memristor-Based Fractional-Order Neural Networks [J].
Chen, Chongyang ;
Zhu, Song ;
Wei, Yongchang ;
Chen, Chongyang .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (04) :1607-1616
[2]   Design and Analysis of Quaternion-Valued Neural Networks for Associative Memories [J].
Chen, Xiaofeng ;
Song, Qiankun ;
Li, Zhongshan .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2018, 48 (12) :2305-2314
[3]   A LOW-COST HIGH-CAPACITY ASSOCIATIVE MEMORY DESIGN USING CELLULAR-AUTOMATA [J].
CHOWDHURY, DR ;
SENGUPTA, I ;
CHAUDHURI, PP .
IEEE TRANSACTIONS ON COMPUTERS, 1995, 44 (10) :1260-1264
[4]   Design and characterization of cellular automata based associative memory for pattern recognition [J].
Ganguly, N ;
Maji, P ;
Sikdar, BK ;
Chaudhuri, PP .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (01) :672-679
[5]   A new approach to design cellular neural networks for associative memories [J].
Grassi, G .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 1997, 44 (09) :835-838
[6]   On discrete-time cellular neural networks for associative memories [J].
Grassi, G .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 2001, 48 (01) :107-111
[7]   Multistability of Recurrent Neural Networks With Piecewise-Linear Radial Basis Functions and State-Dependent Switching Parameters [J].
Guo, Zhenyuan ;
Liu, Linlin ;
Wang, Jun .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (11) :4458-4471
[8]   Multistability of Switched Neural Networks With Piecewise Linear Activation Functions Under State-Dependent Switching [J].
Guo, Zhenyuan ;
Liu, Linlin ;
Wang, Jun .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (07) :2052-2066
[9]   Analysis and design of associative memories based on stability of cellular neural networks [J].
Han, Qi ;
Liao, Xiaofeng ;
Huang, Tingwen ;
Peng, Jun ;
Li, Chuandong ;
Huang, Hongyu .
NEUROCOMPUTING, 2012, 97 :192-200
[10]   NEURAL NETWORKS AND PHYSICAL SYSTEMS WITH EMERGENT COLLECTIVE COMPUTATIONAL ABILITIES [J].
HOPFIELD, JJ .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA-BIOLOGICAL SCIENCES, 1982, 79 (08) :2554-2558