A robust multiobjective Harris' Hawks Optimization algorithm for the binary classification problem

被引:29
作者
Dokeroglu, Tansel [1 ]
Deniz, Ayca [2 ]
Kiziloz, Hakan Ezgi [3 ,4 ]
机构
[1] Ankara Sci Univ, Dept Comp Engn, Ankara, Turkey
[2] Middle East Tech Univ, Dept Comp Engn, Ankara, Turkey
[3] Univ Turkish Aeronaut Assoc, Dept Comp Engn, Ankara, Turkey
[4] Open Univ, Sch Comp & Commun, Milton Keynes, Bucks, England
关键词
Binary classification; Multiobjective optimization; Feature selection; Harris' Hawks optimization; ARTIFICIAL BEE COLONY; FEATURE-SELECTION; DIFFERENTIAL EVOLUTION; MACHINE;
D O I
10.1016/j.knosys.2021.107219
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Harris' Hawks Optimization (HHO) is a recent metaheuristic inspired by the cooperative behavior of the hawks. These avians apply many intelligent techniques like surprise pounce (seven kills) while they are catching their prey according to the escaping patterns of the target. The HHO simulates these hunting patterns of the hawks to obtain the best/optimal solutions to the problems. In this study, we propose a new multiobjective HHO algorithm for the solution of the well-known binary classification problem. In this multiobjective problem, we reduce the number of selected features and try to keep the accuracy prediction as maximum as possible at the same time. We propose new discrete exploration (perching) and exploitation (besiege) operators for the hunting patterns of the hawks. We calculate the prediction accuracy of the selected features with four machine learning techniques, namely, Logistic Regression, Support Vector Machines, Extreme Learning Machines, and Decision Trees. To verify the performance of the proposed algorithm, we conduct comprehensive experiments on many benchmark datasets retrieved from the University of California, Irvine (UCI) Machine Learning Repository. Moreover, we apply it to a recent real-world dataset, i.e., a Coronavirus disease (COVID-19) dataset. Significant improvements are observed during the comparisons with state-of-the-art metaheuristic algorithms. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:18
相关论文
共 80 条
[1]   Responses of dietary supplementation of probiotic effective microorganisms (EMs) in Oreochromis niloticus on growth, hematological, intestinal histopathological, and antiparasitic activities [J].
Abdel-Aziz, Mohamed ;
Bessat, Mohamed ;
Fadel, Amr ;
Elblehi, Samar .
AQUACULTURE INTERNATIONAL, 2020, 28 (03) :947-963
[2]   Approaches to Multi-Objective Feature Selection: A Systematic Literature Review [J].
Al-Tashi, Qasem ;
Abdulkadir, Said Jadid ;
Rais, Helmi Md ;
Mirjalili, Seyedali ;
Alhussian, Hitham .
IEEE ACCESS, 2020, 8 :125076-125096
[3]   Binary Optimization Using Hybrid Grey Wolf Optimization for Feature Selection [J].
Al-Tashi, Qasem ;
Kadir, Said Jadid Abdul ;
Rais, Helmi Md ;
Mirjalili, Seyedali ;
Alhussian, Hitham .
IEEE ACCESS, 2019, 7 :39496-39508
[4]  
Alpaydin E, 2014, ADAPT COMPUT MACH LE, P1
[5]   Optimizing multi-objective PSO based feature selection method using a feature elitism mechanism [J].
Amoozegar, Maryam ;
Minaei-Bidgoli, Behrouz .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 113 :499-514
[6]   Binary butterfly optimization approaches for feature selection [J].
Arora, Sankalap ;
Anand, Priyanka .
EXPERT SYSTEMS WITH APPLICATIONS, 2019, 116 :147-160
[7]   On the performance improvement of Butterfly Optimization approaches for global optimization and Feature Selection [J].
Assiri, Adel Saad .
PLOS ONE, 2021, 16 (01)
[8]  
Bairathi D, 2018, INT C INT SYST DES A
[9]   A survey on optimization metaheuristics [J].
Boussaid, Ilhern ;
Lepagnot, Julien ;
Siarry, Patrick .
INFORMATION SCIENCES, 2013, 237 :82-117
[10]   Some Tricks in Parameter Selection for Extreme Learning Machine [J].
Cao, Weipeng ;
Gao, Jinzhu ;
Ming, Zhong ;
Cai, Shubin .
2017 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE APPLICATIONS AND TECHNOLOGIES (AIAAT 2017), 2017, 261