Training feedforward neural networks using multi-verse optimizer for binary classification problems

被引:160
作者
Faris, Hossam [1 ]
Aljarah, Ibrahim [1 ]
Mirjalili, Seyedali [2 ]
机构
[1] Univ Jordan, King Abdullah II Sch Informat Technol, Business Informat Technol Dept, Amman, Jordan
[2] Griffith Univ, Sch Informat & Commun Technol, Brisbane, Qld 4111, Australia
关键词
Multi-verse optimizer; MVO; Multilayer perceptron; MLP; Training neural network; Evolutionary algorithm; GENETIC ALGORITHM;
D O I
10.1007/s10489-016-0767-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper employs the recently proposed nature-inspired algorithm called Multi-Verse Optimizer (MVO) for training the Multi-layer Perceptron (MLP) neural network. The new training approach is benchmarked and evaluated using nine different bio-medical datasets selected from the UCI machine learning repository. The results are compared to five classical and recent evolutionary metaheuristic algorithms: Genetic Algorithm (GA), Particle Swarm Optimization (PSO), Differential Evolution (DE), FireFly (FF) Algorithm and Cuckoo Search (CS). In addition, the results are compared with two well-regarded conventional gradient-based training methods: the conventional Back-Propagation (BP) and the Levenberg-Marquardt (LM) algorithms. The comparative study demonstrates that MVO is very competitive and outperforms other training algorithms in the majority of datasets in terms of improved local optima avoidance and convergence speed.
引用
收藏
页码:322 / 332
页数:11
相关论文
共 35 条
  • [1] [Anonymous], NEURAL PROCESS LETT
  • [2] [Anonymous], J NEURAL NETWORKS, DOI DOI 10.1016/0893-6080(89)90020-8
  • [3] [Anonymous], 2008, P AISB 2008 CONVENTI
  • [4] [Anonymous], PATTERN RECOGNITION
  • [5] [Anonymous], 2008, THESIS U TEKNOLOGI M
  • [6] [Anonymous], HYBR INT SYST 2005 H
  • [7] [Anonymous], 2001, P EUR S ART NEUR NET
  • [8] [Anonymous], P IJCAI
  • [9] [Anonymous], 2012, International Journal of Intelligent Systems and Applications, DOI [10.5815/ijisa10.5815/ijisa:2012.0710.5815/ijisa:2012.07.03, DOI 10.5815/IJISA.2012.07.03]
  • [10] [Anonymous], IEEE 7 JOINT INF TEC