The storage capacity of the Blume-Emery-Griffiths neural network

被引:4
作者
Löwe, M
Vermet, F
机构
[1] Univ Munster, Inst Stat Math, Fachbereich Math & Informat, D-48149 Munster, Germany
[2] Univ Bretagne Occidentale, Dept Math, F-29238 Brest, France
来源
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL | 2005年 / 38卷 / 16期
关键词
D O I
10.1088/0305-4470/38/16/002
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
We analyse the so-called Blume-Emery-Griffiths (BEG) neural network at zero temperature. An upper bound on its storage capacity is given if we want the stored patterns to be fixed points of the retrieval dynamics. Besides, we discuss a more liberal notion of storage capacity introduced by Newman (1988 Neural Netw. 1223-38) in the context of the Hopfield model (Hopfield 1982 Proc. Natl Acad. Sci. USA 79 2554-8). We show that, similar to the findings in the neural networks literature, the BEG model with this notion of storage capacity can store a number of patterns proportional to the number of neurons in the model.
引用
收藏
页码:3483 / 3503
页数:21
相关论文
共 27 条
[1]   CHARACTERISTICS OF SPARSELY ENCODED ASSOCIATIVE MEMORY [J].
AMARI, S .
NEURAL NETWORKS, 1989, 2 (06) :451-457
[2]   STATISTICAL-MECHANICS OF NEURAL NETWORKS NEAR SATURATION [J].
AMIT, DJ ;
GUTFREUND, H ;
SOMPOLINSKY, H .
ANNALS OF PHYSICS, 1987, 173 (01) :30-67
[3]   LOWER BOUNDS ON THE CAPACITIES OF BINARY AND TERNARY NETWORKS STORING SPARSE RANDOM VECTORS [J].
BARAM, Y ;
SALEE, D .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1992, 38 (06) :1633-1647
[4]   Optimal capacity of the Blume-Emery-Griffiths perceptron -: art. no. 036113 [J].
Bollé, D ;
Castillo, IP ;
Shim, GM .
PHYSICAL REVIEW E, 2003, 67 (03) :10
[5]   Thermodynamics of fully connected Blume-Emery-Griffiths neural networks [J].
Bollé, D ;
Verbeiren, T .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 2003, 36 (02) :295-305
[6]   An optimal Q-state neural network using mutual information [J].
Bollé, D ;
Verbeiren, T .
PHYSICS LETTERS A, 2002, 297 (3-4) :156-161
[7]   Sharp upper bounds on perfect retrieval in the Hopfield model [J].
Bovier, A .
JOURNAL OF APPLIED PROBABILITY, 1999, 36 (03) :941-950
[8]   NONDIRECT CONVERGENCE RADIUS AND NUMBER OF ITERATIONS OF THE HOPFIELD ASSOCIATIVE MEMORY [J].
BURSHTEIN, D .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1994, 40 (03) :838-847
[9]   Three-state neural network: From mutual information to the Hamiltonian [J].
Dominguez, DRC ;
Korutcheva, E .
PHYSICAL REVIEW E, 2000, 62 (02) :2620-2628
[10]   A LOWER BOUND FOR THE MEMORY CAPACITY IN THE POTTS-HOPFIELD MODEL [J].
FERRARI, PA ;
MARTINEZ, S ;
PICCO, P .
JOURNAL OF STATISTICAL PHYSICS, 1992, 66 (5-6) :1643-1652