STATISTICAL-MECHANICS OF A MULTILAYERED NEURAL NETWORK

被引：78

作者：

BARKAI, E ^{[1
]}

HANSEL, D ^{[1
]}

KANTER, I ^{[1
]}

机构：

[1] HEBREW UNIV JERUSALEM,RACAH INST PHYS,IL-91904 JERUSALEM,ISRAEL

来源：

PHYSICAL REVIEW LETTERS | 1990年 / 65卷 / 18期

关键词：

D O I：

10.1103/PhysRevLett.65.2312

中图分类号：

O4 [物理学];

学科分类号：

0702 ;

摘要：

Statistical mechanics is applied to estimate the maximal information capacity per synapse (c) of a multilayered feedforward neural network, functioning as a parity machine. For a large number of hidden units, K, the replica-symmetric solution overestimates dramatically the capacity,K2. However, a one-step replica-symmetry breaking gives lnK/ln2, which coincides with a theoretical upper bound. It is suggested that this asymptotic behavior is exact. Results for finite K are also discussed. © 1990 The American Physical Society.

引用

页码：2312 / 2315

页数：4

共 16 条

[1]

[Anonymous], 1989, MODELING BRAIN FUNCT

[2]

BARKAI E, UNPUB

[3]

Baum E. B., 1988, Journal of Complexity, V4, P193, DOI 10.1016/0885-064X(88)90020-9

[4] GEOMETRICAL AND STATISTICAL PROPERTIES OF SYSTEMS OF LINEAR INEQUALITIES WITH APPLICATIONS IN PATTERN RECOGNITION [J].

COVER, TM .

IEEE TRANSACTIONS ON ELECTRONIC COMPUTERS, 1965, EC14 (03) :326-&

[5] RANDOM-ENERGY MODEL - AN EXACTLY SOLVABLE MODEL OF DISORDERED-SYSTEMS [J].

DERRIDA, B .

PHYSICAL REVIEW B, 1981, 24 (05) :2613-2626

[6] OPTIMAL STORAGE PROPERTIES OF NEURAL NETWORK MODELS [J].

GARDNER, E ;

DERRIDA, B .

JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1988, 21 (01) :271-284

[7] THE SPACE OF INTERACTIONS IN NEURAL NETWORK MODELS [J].

GARDNER, E .

JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1988, 21 (01) :257-270

[8] SPIN-GLASSES WITH P-SPIN INTERACTIONS [J].

GARDNER, E .

NUCLEAR PHYSICS B, 1985, 257 (06) :747-765

[9]

GARDNER E, 1989, J PHYS A, V22

[10] THE SIMPLEST SPIN-GLASS [J].

GROSS, DJ ;

MEZARD, M .

NUCLEAR PHYSICS B, 1984, 240 (04) :431-452

← 1 2 →