A multi-objective micro genetic ELM algorithm

被引:19
作者
Lahoz, David [1 ]
Lacruz, Beatriz [1 ]
Mateo, Pedro M. [1 ]
机构
[1] Univ Zaragoza, Dept Metodos Estadist, E-50009 Zaragoza, Spain
基金
奥地利科学基金会;
关键词
Artificial neural networks; Extreme learning machine; Genetic algorithm; Multi-objective optimization; EXTREME LEARNING-MACHINE;
D O I
10.1016/j.neucom.2012.11.035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The extreme learning machine (ELM) is a methodology for learning single-hidden layer feedforward neural networks (SLFN) which has been proved to be extremely fast and to provide very good generalization performance. ELM works by randomly choosing the weights and biases of the hidden nodes and then analytically obtaining the output weights and biases for a SLFN with the number of hidden nodes previously fixed. In this work, we develop a multi-objective micro genetic ELM (mu G-ELM) which provides the appropriate number of hidden nodes for the problem being solved as well as the weights and biases which minimize the MSE. The multi-objective algorithm is conducted by two criteria: the number of hidden nodes and the mean square error (MSE). Furthermore, as a novelty, mu G-ELM incorporates a regression device in order to decide whether the number of hidden nodes of the individuals of the population should be increased or decreased or unchanged. In general, the proposed algorithm reaches better errors by also implying a smaller number of hidden nodes for the data sets and competitors considered. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:90 / 103
页数:14
相关论文
共 25 条
[1]  
[Anonymous], LIST REFERENCES EVOL
[2]  
[Anonymous], 2007, EVOLUTIONARY ALGORIT
[3]  
[Anonymous], 2010, UCI machine learning repository
[4]  
Beale M.H., 2010, Neural Network ToolboxTM 7: User's Guide
[5]  
Deb K., 1996, Computer Science and informatics, V26, P30
[6]   Comparative performance of some popular artificial neural network algorithms on benchmark and function approximation problems [J].
Dhar, V. K. ;
Tickoo, A. K. ;
Koul, R. ;
Dubey, B. P. .
PRAMANA-JOURNAL OF PHYSICS, 2010, 74 (02) :307-324
[7]  
Eiben A.E., 2007, INTRO EVOLUTIONARY C
[8]   Error Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning [J].
Feng, Guorui ;
Huang, Guang-Bin ;
Lin, Qingping ;
Gay, Robert .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (08) :1352-1357
[9]  
Friedman J., 1999, 4 STANDF U DEP STAT
[10]  
Goldberg DE., 1989, GENETIC ALGORITHMS S, V13