Improved monarch butterfly optimization for unconstrained global search and neural network training

被引:85
|
作者
Faris, Hossam [1 ]
Aljarah, Ibrahim [1 ]
Mirjalili, Seyedali [2 ]
机构
[1] Univ Jordan, King Abdullah Sch Informat Technol 2, Business Informat Technol Dept, Amman, Jordan
[2] Griffith Univ, Sch Informat & Commun Technol, Nathan, Qld 4111, Australia
关键词
MBO; Global optimization; Multilayer perceptron; Neural network; Optimization; GENETIC ALGORITHM; BACKPROPAGATION;
D O I
10.1007/s10489-017-0967-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work is a seminal attempt to address the drawbacks of the recently proposed monarch butterfly optimization (MBO) algorithm. This algorithm suffers from premature convergence, which makes it less suitable for solving real-world problems. The position updating of MBO is modified to involve previous solutions in addition to the best solution obtained thus far. To prove the efficiency of the Improved MBO (IMBO), a set of 23 well-known test functions is employed. The statistical results show that IMBO benefits from high local optima avoidance and fast convergence speed which helps this algorithm to outperform basic MBO and another recent variant of this algorithm called greedy strategy and self-adaptive crossover operator MBO (GCMBO). The results of the proposed algorithm are compared with nine other approaches in the literature for verification. The comparative analysis shows that IMBO provides very competitive results and tends to outperform current algorithms. To demonstrate the applicability of IMBO at solving challenging practical problems, it is also employed to train neural networks as well. The IMBO-based trainer is tested on 15 popular classification datasets obtained from the University of California at Irvine (UCI) Machine Learning Repository. The results are compared to a variety of techniques in the literature including the original MBO and GCMBO. It is observed that IMBO improves the learning of neural networks significantly, proving the merits of this algorithm for solving challenging problems.
引用
收藏
页码:445 / 464
页数:20
相关论文
共 50 条
  • [21] Feedforward neural network training using intelligent global harmony search
    Tavakoli, Saeed
    Valian, Ehsan
    Mohanna, Shahram
    Evolving Systems, 2012, 3 (02) : 125 - 131
  • [22] An Evolutionary Multi-layer Perceptron Neural Network for Solving Unconstrained Global Optimization Problems
    Wu, Jui-Yu
    2016 IEEE/ACIS 15TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS), 2016, : 240 - 245
  • [23] A group search optimization based on improved small world and its application on neural network training in ammonia synthesis
    Yan, Xingdi
    Yang, Wen
    Shi, Hongbo
    NEUROCOMPUTING, 2012, 97 : 94 - 107
  • [24] An improved particle swarm optimization based training algorithm for neural network
    Zhao, FQ
    Hong, Y
    Yu, DM
    Yang, YH
    ICMIT 2005: INFORMATION SYSTEMS AND SIGNAL PROCESSING, 2005, 6041
  • [25] A Global Optimization Method RasID-GA for Neural Network Training
    Sohn, Dongkyu
    Mabu, Shingo
    Shimada, Kaoru
    Hirasawa, Kotaro
    Hu, Jinglu
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2008, 12 (01) : 85 - 93
  • [26] Global Optimization of Neural Network
    Lee, Chae Young
    Lim, Yeon Jun
    Yoon, Taeseon
    2018 20TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT), 2018, : 25 - 28
  • [27] A Memetic Chaotic Gravitational Search Algorithm for unconstrained global optimization problems
    Garcia-Rodenas, Ricardo
    Jimenez Linares, Luis
    Alberto Lopez-Gomez, Julio
    APPLIED SOFT COMPUTING, 2019, 79 : 14 - 29
  • [28] Vortex search optimization algorithm for training of feed-forward neural network
    Sag, Tahir
    Jalil, Zainab Abdullah Jalil
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2021, 12 (05) : 1517 - 1544
  • [29] Vortex search optimization algorithm for training of feed-forward neural network
    Tahir Sağ
    Zainab Abdullah Jalil Jalil
    International Journal of Machine Learning and Cybernetics, 2021, 12 : 1517 - 1544
  • [30] Fast global optimization neural network and its application in data fusion
    Yang, XX
    Jiao, LC
    ICSP '98: 1998 FOURTH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, PROCEEDINGS, VOLS I AND II, 1998, : 1351 - 1354