On the capacity of an associative memory model based on neural cliques

被引:6
作者
Heusel, Judith [1 ]
Loewe, Matthias [1 ]
Vermet, Franck [2 ]
机构
[1] Univ Munster, Fachbereich Math & Informat, D-48149 Munster, Germany
[2] Univ Bretagne Occidentale, UMR CNRS 6205, Math Lab, F-29238 Brest M, France
关键词
Neural networks; Associative memory; Exponential inequalities; HOPFIELD MODEL; STORAGE CAPACITY; NETWORKS; PATTERNS; BOUNDS;
D O I
10.1016/j.spl.2015.07.026
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Based on recent work by Gripon and Berrou (2011), we introduce a new model of an associative memory. We give upper and lower bounds on the memory capacity of the model. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:256 / 261
页数:6
相关论文
共 14 条
[1]   Storing Sparse Messages in Networks of Neural Cliques [J].
Aliabadi, Behrooz Kamary ;
Berrou, Claude ;
Gripon, Vincent ;
Jiang, Xiaoran .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (05) :980-989
[2]   Sharp upper bounds on perfect retrieval in the Hopfield model [J].
Bovier, A .
JOURNAL OF APPLIED PROBABILITY, 1999, 36 (03) :941-950
[3]   NONDIRECT CONVERGENCE RADIUS AND NUMBER OF ITERATIONS OF THE HOPFIELD ASSOCIATIVE MEMORY [J].
BURSHTEIN, D .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1994, 40 (03) :838-847
[4]   WILLSHAW MODEL - ASSOCIATIVE MEMORY WITH SPARSE CODING AND LOW FIRING RATES [J].
GOLOMB, D ;
RUBIN, N ;
SOMPOLINSKY, H .
PHYSICAL REVIEW A, 1990, 41 (04) :1843-1854
[5]   Sparse Neural Networks with Large Learning Diversity [J].
Gripon, Vincent ;
Berrou, Claude .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (07) :1087-1096
[6]   CONVERGENCE RESULTS IN AN ASSOCIATIVE MEMORY MODEL [J].
KOMLOS, J ;
PATURI, R .
NEURAL NETWORKS, 1988, 1 (03) :239-250
[7]   The Hopfield Model on a Sparse Erdos-Renyi Graph [J].
Loewe, Matthias ;
Vermet, Franck .
JOURNAL OF STATISTICAL PHYSICS, 2011, 143 (01) :205-214
[8]  
Loukianova D., 1997, PROBAB THEORY REL, V107, P161
[9]   The storage capacity of the Hopfield model and moderate deviations [J].
Löwe, M ;
Vermet, F .
STATISTICS & PROBABILITY LETTERS, 2005, 75 (04) :237-248
[10]   The storage capacity of the Blume-Emery-Griffiths neural network [J].
Löwe, M ;
Vermet, F .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 2005, 38 (16) :3483-3503