Generalization of finite size Boolean perceptrons with genetic algorithms

被引:1
作者
Barbato, D. M. L. [1 ]
De Groote, J. J. [1 ]
机构
[1] Fac COC, Lab Inteligencia Artificial & Aplicacoes, BR-14096175 Ribeirao Preto, SP, Brazil
关键词
Networks; Perceptron; Finite size; Boolean; Generalization;
D O I
10.1016/j.neucom.2008.02.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present an investigation of the generalization ability of finite size perceptrons with binary couplings. The results for the expected generalization error provide a guide for practical applications by establishing limits for the learning capacity of finite systems. The method applied to find solutions was the genetic algorithm, which showed to be efficient, even for values of alpha larger then the Gardner-Derrida storage capacity alpha(CD) = 1.245, for which the number of solutions is largely reduced. We show that the generalization error of finite size networks for alpha up to alpha(GD) coincides with the value calculated through the statistical mechanical analysis in the thermodynamic limit. (C) 2008 Elsevier B.V. All rights reserved.
引用
收藏
页码:3650 / 3655
页数:6
相关论文
共 21 条
  • [1] TRAINING A NETWORK WITH TERNARY WEIGHTS USING THE CHIR ALGORITHM
    ABRAMSON, S
    SAAD, D
    MAROM, E
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1993, 4 (06): : 997 - 1000
  • [2] [Anonymous], 1975, Ann Arbor
  • [3] Efficient supervised learning in networks with binary synapses
    Baldassi, Carlo
    Braunstein, Alfredo
    Brunel, Nicolas
    Zecchina, Riccardo
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2007, 104 (26) : 11079 - 11084
  • [4] THE EFFECTS OF LESIONS ON THE GENERALIZATION ABILITY OF A PERCEPTRON
    BARBATO, DML
    FONTANARI, JF
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1993, 26 (08): : 1847 - 1863
  • [5] Variational studies and replica symmetry breaking in the generalization problem of the binary perceptron
    Botelho, E
    Mattos, CR
    Caticha, N
    [J]. PHYSICAL REVIEW E, 2000, 62 (05): : 6999 - 7007
  • [6] Learning in the hypercube: A stepping stone to the binary perceptron
    Bouten, M
    Reimers, L
    Van Rompaey, B
    [J]. PHYSICAL REVIEW E, 1998, 58 (02): : 2378 - 2385
  • [7] EVOLVING A LEARNING ALGORITHM FOR THE BINARY PERCEPTRON
    FONTANARI, JF
    MEIR, R
    [J]. NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1991, 2 (04) : 353 - 359
  • [8] OPTIMAL STORAGE PROPERTIES OF NEURAL NETWORK MODELS
    GARDNER, E
    DERRIDA, B
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1988, 21 (01): : 271 - 284
  • [9] 1ST-ORDER TRANSITION TO PERFECT GENERALIZATION IN A NEURAL NETWORK WITH BINARY SYNAPSES
    GYORGYI, G
    [J]. PHYSICAL REVIEW A, 1990, 41 (12): : 7097 - 7100
  • [10] GYORGYI G, 1990, NEURAL NETWORKS SPIN