DOMAINS OF SOLUTIONS AND REPLICA SYMMETRY-BREAKING IN MULTILAYER NEURAL NETWORKS

被引：49

作者：

MONASSON, R

OKANE, D

机构：

[1] THEORET PHYS,OXFORD OX1 3NP,ENGLAND

[2] ENS,PHYS THEOR LAB,F-75231 PARIS 05,FRANCE

来源：

EUROPHYSICS LETTERS | 1994年 / 27卷 / 02期

关键词：

D O I：

10.1209/0295-5075/27/2/002

中图分类号：

O4 [物理学];

学科分类号：

0702 ;

摘要：

The relationship between the geometrical structure of weight space and replica symmetry breaking (RSB) in multilayer neural networks is studied using a toy model. The distribution of sizes of the disconnected domains of solution space is computed analytically and compared to the RSB calculation of the Gardner volume. We are able to show explicitly that ergodicity breaking and RSB are not equivalent. Repeating these calculations using the cavity approach allows us to interpret the geometrical meaning of a RSB ansatz.

引用

页码：85 / 90

页数：6

共 11 条

[1]

BAKAI E, 1990, PHYS REV LETT, V65, P18

[2] BROKEN SYMMETRIES IN MULTILAYERED PERCEPTRONS [J].

BARKAI, E ;

HANSEL, D ;

SOMPOLINSKY, H .

PHYSICAL REVIEW A, 1992, 45 (06) :4146-4161

[3] SYMMETRY-BREAKING IN NONMONOTONIC NEURAL NETWORKS [J].

BOFFETTA, G ;

MONASSON, R ;

ZECCHINA, R .

JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1993, 26 (12) :L507-L513

[4] FINITE-SIZE EFFECTS AND BOUNDS FOR PERCEPTRON MODELS [J].

DERRIDA, B ;

GRIFFITHS, RB ;

PRUGELBENNETT, A .

JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1991, 24 (20) :4907-4940

[5] STORAGE CAPACITY AND LEARNING ALGORITHMS FOR 2-LAYER NEURAL NETWORKS [J].

ENGEL, A ;

KOHLER, HM ;

TSCHEPKE, F ;

VOLLMAYR, H ;

ZIPPELIUS, A .

PHYSICAL REVIEW A, 1992, 45 (10) :7590-7609

[6] OPTIMAL STORAGE PROPERTIES OF NEURAL NETWORK MODELS [J].

GARDNER, E ;

DERRIDA, B .

JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1988, 21 (01) :271-284

[7] ON THE CAPACITY OF A NEURON WITH A NONMONOTONE OUTPUT FUNCTION [J].

KOBAYASHI, K .

NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1991, 2 (03) :237-243

[8]

KURCHAN J, 1993, J PHYS I, V3, P1819, DOI 10.1051/jp1:1993217

[9]

Mezard M., 1987, SPIN GLASS THEORY IN, V9

[10] ON A MECHANISM FOR EXPLICIT REPLICA SYMMETRY-BREAKING [J].

PARISI, G ;

VIRASORO, MA .

JOURNAL DE PHYSIQUE, 1989, 50 (22) :3317-3329

← 1 2 →