A binary water wave optimization for feature selection

被引:34
作者
Ibrahim, Abdelmonem M. [1 ,3 ]
Tawhid, M. A. [3 ]
Ward, Rabab K. [2 ]
机构
[1] Al Azhar Univ, Fac Sci, Dept Math, Assiut Branch, Assiut, Egypt
[2] Univ British Columbia, Elect & Comp Engn Dept, Vancouver, BC V6T 1Z4, Canada
[3] Thompson Rivers Univ, Fac Sci, Dept Math & Stat, Kamloops, BC V2C 0C8, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Classification; Feature selection; Metaheuristics; Rough set theory; Water wave optimization; Wrapper approaches; PARTICLE SWARM OPTIMIZATION; ROUGH SET APPROACH; ATTRIBUTE REDUCTION; INTELLIGENCE; ALGORITHM; NETWORKS; SEARCH;
D O I
10.1016/j.ijar.2020.01.012
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A search method that finds a minimal subset of features (over a feature space) that yields maximum classification accuracy is proposed. This method employs rough set theory (RST) along with a newly introduced binary version of the water wave optimization approach (WWO) which is denoted by BWWO. WWO simulates the phenomena of water waves, such as propagation, refraction, and breaking and is one of the newest nature inspired methods for global optimization problems. In our approach, BWWO utilizes the phenomena of water waves propagation, refraction, and breaking in a binary version. Two main experiments based on the rough set approach and wrapper method as a part of the objective function are carried out to verify the performance of the proposed algorithm. In the first experiment, the effectiveness of the proposed approach based on RST is demonstrated on 16 different datasets. The proposed approach is compared with various typical attribute reduction methods and popular optimizers in the literature, such as ant colony, nonlinear great deluge algorithm, scatter search and others. For the second experiment, a feature subset that maximizes the classification accuracy (using cross-validated kNN classifier) with minimizing the number of selected features is obtained over 17 different datasets. In wrapper experiment BWWO is compared with the binary gray wolf optimization, binary particle swarm optimizer, binary cat swarm optimization, binary dragonfly algorithm and the binary bat algorithm. The computational results demonstrate the efficiency and effectiveness of the proposed approach in finding a minimal features subset that maximize the classification accuracy. Furthermore, Friedman test and Wilcoxon's rank-sum test are carried out at 5% significance level in this study. (C) 2020 Elsevier Inc. All rights reserved.
引用
收藏
页码:74 / 91
页数:18
相关论文
共 71 条
[21]   A wrapper-based approach for feature selection and classification of major depressive disorder-bipolar disorders [J].
Erguzel, Turker Tekin ;
Tas, Cumhur ;
Cebi, Merve .
COMPUTERS IN BIOLOGY AND MEDICINE, 2015, 64 :127-137
[22]  
Hedar A.R., 2018, P GEN EV COMP C COMP, P1394, DOI [10.1145/3205651.3208286, DOI 10.1145/3205651.3208286]
[23]   Tabu search for attribute reduction in rough set theory [J].
Hedar, Abdel-Rahman ;
Wang, Jue ;
Fukushima, Masao .
SOFT COMPUTING, 2008, 12 (09) :909-918
[24]   K-Means Cloning: Adaptive Spherical K-Means Clustering [J].
Hedar, Abdel-Rahman ;
Ibrahim, Abdel-Monem M. ;
Abdel-Hakim, Alaa E. ;
Sewisy, Adel A. .
ALGORITHMS, 2018, 11 (10)
[25]   The capacitated vehicle routing problem with evidential demands [J].
Helal, Nathalie ;
Pichon, Frederic ;
Porumbel, Daniel ;
Mercier, David ;
Lefevre, Eric .
INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2018, 95 :124-151
[26]   MORE POWERFUL PROCEDURES FOR MULTIPLE SIGNIFICANCE TESTING [J].
HOCHBERG, Y ;
BENJAMINI, Y .
STATISTICS IN MEDICINE, 1990, 9 (07) :811-818
[27]  
Jaddi NS, 2013, J INF SCI ENG, V29, P49
[28]   Semantics-preserving dimensionality reduction: Rough and fuzzy-rough-based approaches [J].
Jensen, R ;
Shen, Q .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2004, 16 (12) :1457-1471
[29]   Minimum cost attribute reduction in decision-theoretic rough set models [J].
Jia, Xiuyi ;
Liao, Wenhe ;
Tang, Zhenmin ;
Shang, Lin .
INFORMATION SCIENCES, 2013, 219 :151-167
[30]   Wilcoxon signed-ranks test: symmetry should be confirmed before the test [J].
Kasuya, Eiiti .
ANIMAL BEHAVIOUR, 2010, 79 (03) :765-767