Statistical analysis of the parameters of a neuro-genetic algorithm

被引:47
作者
Castillo-Valdivieso, PA [1 ]
Merelo, JJ [1 ]
Prieto, A [1 ]
Rojas, I [1 ]
Romero, G [1 ]
机构
[1] Univ Granada, Dept Architecture & Comp Technol, E-18071 Granada, Spain
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2002年 / 13卷 / 06期
关键词
ANalysis Of the VAriance (ANOVA); artificial neural networks (ANNs); evolutionary algorithms (EAs); hybrid methods; optimization; statistical analysis;
D O I
10.1109/TNN.2002.804281
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Interest in hybrid methods that combine artificial neural networks (ANNs) and evolutionary algorithms (EAs) has grown in the last few years, due to their robustness and ability to design networks by setting initial weight values, by searching the architecture and the learning rule and parameters. However, papers describing the way genetic operators are tested to determine their effectiveness are scarce; moreover, few researchers publish the most suitable values of these operator parameters to solve a given problem. This paper presents an exhaustive analysis of the G-Prop method, and the different parameters the method requires (population size, selection rate, initial weight range, number of training epochs, etc.) are determined. The paper also the discusses the influence of the application of genetic operators on the precision (classification ability or error) and network size in classification problems. When making a detailed statistical analysis of the influence of each parameter, the designer should pay most attention to the parameter presenting values that are statistically most significant. The significance and relative importance of the parameters with respect to the results obtained, as well as suitable values for each, were obtained using ANalysis Of the VAriance (ANOVA). Experiments show the significance of parameters concerning the neural network and learning in the hybrid methods. Combining evolutionary algorithms and neural network learning methods can lead to better results than using those methods alone. Moreover, making the network initial weights evolve is an important factor in the process. The parameters found using this method were used to compare the G-Prop method both to itself with other parameter settings, and to other published methods.
引用
收藏
页码:1374 / 1394
页数:21
相关论文
共 83 条
  • [1] [Anonymous], 1989, GENETIC ALGORITHM SE
  • [2] [Anonymous], NEURAL NETW WORLD
  • [3] [Anonymous], P 1998 IEEE C EV COM
  • [4] [Anonymous], 1991, Handbook of genetic algorithms
  • [5] [Anonymous], 1988, EMPIRICAL STUDY LEAR
  • [6] [Anonymous], 1992, P 1 EUROPEAN C ARTIF
  • [7] [Anonymous], INT C NEUR NETW SAN
  • [8] BACK T, 1993, PROCEEDINGS OF THE FIFTH INTERNATIONAL CONFERENCE ON GENETIC ALGORITHMS, P2
  • [9] BACK T, 1992, PARALLEL PROBLEM SOLVING FROM NATURE, 2, P85
  • [10] Back T., 1997, Handbook of evolutionary computation