Let a biogeography-based optimizer train your Multi-Layer Perceptron

被引:246
作者
Mirjalili, Seyedali [1 ]
Mirjalili, Seyed Mohammad [2 ]
Lewis, Andrew [1 ]
机构
[1] Griffith Univ, Sch Informat & Commun Technol, Brisbane, Qld 4111, Australia
[2] ZPS Co, Tehran, Iran
关键词
FNN; Neural network; Learning neural network; Biogeography-Based Optimization; BBO; Evolutionary algorithm; PARTICLE SWARM OPTIMIZATION; ARTIFICIAL NEURAL-NETWORKS; EXTREME LEARNING-MACHINE; KRILL HERD ALGORITHM; CONVERGENCE; RATES; SELECTION;
D O I
10.1016/j.ins.2014.01.038
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The Multi-Lager Perceptron (MLP), as one of the most-widely used Neural Networks (NNs), has been applied to many practical problems. The MLP requires training on specific applications, often experiencing problems of entrapment in local minima, convergence speed, and sensitivity to initialization. This paper proposes the use of the recently developed Biogeography-Based Optimization (BBO) algorithm for training MLPs to reduce these problems. In order to investigate the efficiencies of BBO in training MLPs, five classification datasets, as well as six function approximation datasets are employed. The results are compared to five well-known heuristic algorithms, Back Propagation (BP), and Extreme Learning Machine (ELM) in terms of entrapment in local minima, result accuracy, and convergence rate. The results show that training MLPs by using BBO is significantly better than the current heuristic learning algorithms and BP. Moreover, the results show that BBO is able to provide very competitive results in comparison with ELM. (C) 2014 Elsevier Inc. All rights reserved.
引用
收藏
页码:188 / 209
页数:22
相关论文
共 80 条
[11]  
Blum C., 2005, IEEE
[12]   A survey on optimization metaheuristics [J].
Boussaid, Ilhern ;
Lepagnot, Julien ;
Siarry, Patrick .
INFORMATION SCIENCES, 2013, 237 :82-117
[13]  
Branke J., 1995, Evolutionary algorithms for neural network design and training
[14]   CONJUGATE-GRADIENT ALGORITHM FOR EFFICIENT TRAINING OF ARTIFICIAL NEURAL NETWORKS [J].
CHARALAMBOUS, C .
IEE PROCEEDINGS-G CIRCUITS DEVICES AND SYSTEMS, 1992, 139 (03) :301-310
[15]  
Csaji B.C, 2001, Approximation with artificial neu, V24
[16]  
DasGupta D., 2001, EVOLUTIONARY ALGORIT, V1st
[17]  
Derrac J., 2011, SWARM EVOL COMPUT, P1
[18]  
FAHLMAN SE, 1988, TECHNICAL REPORT
[19]   A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: a case study on the CEC'2005 Special Session on Real Parameter Optimization [J].
Garcia, Salvador ;
Molina, Daniel ;
Lozano, Manuel ;
Herrera, Francisco .
JOURNAL OF HEURISTICS, 2009, 15 (06) :617-644
[20]   Artificial neural networks (the multilayer perceptron) - A review of applications in the atmospheric sciences [J].
Gardner, MW ;
Dorling, SR .
ATMOSPHERIC ENVIRONMENT, 1998, 32 (14-15) :2627-2636