Self-adaptive extreme learning machine

被引:126
作者
Wang, Gai-Ge [1 ,2 ,3 ]
Lu, Mei [1 ]
Dong, Yong-Quan [1 ]
Zhao, Xiang-Jun [1 ]
机构
[1] Jiangsu Normal Univ, Sch Comp Sci & Technol, Xuzhou 221116, Jiangsu, Peoples R China
[2] NE Normal Univ, Inst Algorithm & Big Data Anal, Changchun 130117, Peoples R China
[3] NE Normal Univ, Sch Comp Sci & Informat Technol, Changchun 130117, Peoples R China
基金
中国国家自然科学基金;
关键词
Classification; Self-adaptive; Extreme learning machine; Back propagation; General regression neural network; KRILL HERD ALGORITHM; BIOGEOGRAPHY-BASED OPTIMIZATION; PARTICLE SWARM OPTIMIZATION; FIREFLY ALGORITHM; HARMONY SEARCH; BAT ALGORITHM; EVOLUTIONARY;
D O I
10.1007/s00521-015-1874-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to overcome the disadvantage of the traditional algorithm for SLFN (single-hidden layer feedforward neural network), an improved algorithm for SLFN, called extreme learning machine (ELM), is proposed by Huang et al. However, ELMis sensitive to the neuron number in hidden layer and its selection is a difficult-to-solve problem. In this paper, a self-adaptive mechanism is introduced into the ELM. Herein, a new variant of ELM, called self-adaptive extreme learning machine (SaELM), is proposed. SaELM is a self-adaptive learning algorithm that can always select the best neuron number in hidden layer to form the neural networks. There is no need to adjust any parameters in the training process. In order to prove the performance of the SaELM, it is used to solve the Italian wine and iris classification problems. Through the comparisons between SaELM and the traditional back propagation, basic ELM and general regression neural network, the results have proven that SaELM has a faster learning speed and better generalization performance when solving the classification problem.
引用
收藏
页码:291 / 303
页数:13
相关论文
共 57 条
[1]   Self-Adaptive Evolutionary Extreme Learning Machine [J].
Cao, Jiuwen ;
Lin, Zhiping ;
Huang, Guang-Bin .
NEURAL PROCESSING LETTERS, 2012, 36 (03) :285-305
[2]   Handwritten character recognition using wavelet energy and extreme learning machine [J].
Chacko, Binu P. ;
Krishnan, V. R. Vimal ;
Raju, G. ;
Anto, P. Babu .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2012, 3 (02) :149-161
[3]   Sales forecasting system based on Gray extreme learning machine with Taguchi method in retail industry [J].
Chen, F. L. ;
Ou, T. Y. .
EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (03) :1336-1345
[4]   A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms [J].
Derrac, Joaquin ;
Garcia, Salvador ;
Molina, Daniel ;
Herrera, Francisco .
SWARM AND EVOLUTIONARY COMPUTATION, 2011, 1 (01) :3-18
[5]   Error Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning [J].
Feng, Guorui ;
Huang, Guang-Bin ;
Lin, Qingping ;
Gay, Robert .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (08) :1352-1357
[6]   Interior search algorithm (ISA): A novel approach for global optimization [J].
Gandomi, Amir H. .
ISA TRANSACTIONS, 2014, 53 (04) :1168-1183
[7]   Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems [J].
Gandomi, Amir Hossein ;
Yang, Xin-She ;
Alavi, Amir Hossein .
ENGINEERING WITH COMPUTERS, 2013, 29 (01) :17-35
[8]   Bat algorithm for constrained optimization tasks [J].
Gandomi, Amir Hossein ;
Yang, Xin-She ;
Alavi, Amir Hossein ;
Talatahari, Siamak .
NEURAL COMPUTING & APPLICATIONS, 2013, 22 (06) :1239-1255
[9]   Krill herd: A new bio-inspired optimization algorithm [J].
Gandomi, Amir Hossein ;
Alavi, Amir Hossein .
COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION, 2012, 17 (12) :4831-4845
[10]   A new heuristic optimization algorithm: Harmony search [J].
Geem, ZW ;
Kim, JH ;
Loganathan, GV .
SIMULATION, 2001, 76 (02) :60-68