A novel binary gaining-sharing knowledge-based optimization algorithm for feature selection

被引:74
作者
Agrawal, Prachi [1 ]
Ganesh, Talari [1 ]
Mohamed, Ali Wagdy [2 ,3 ]
机构
[1] Natl Inst Technol Hamirpur, Dept Math & Sci Comp, Hamirpur 177005, Himachal Prades, India
[2] Cairo Univ, Fac Grad Studies Stat Res, Dept Operat Res, Giza 12613, Egypt
[3] Nile Univ, Sch Engn & Appl Sci, Wireless Intelligent Networks Ctr WINC, Giza, Egypt
关键词
Gaining– sharing knowledge-based optimization algorithm; Feature selection; Classification; K-NN classifier; ANT COLONY OPTIMIZATION; DIFFERENTIAL EVOLUTION; SEARCH ALGORITHM;
D O I
10.1007/s00521-020-05375-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To obtain the optimal set of features in feature selection problems is the most challenging and prominent problem in machine learning. Very few human-related metaheuristic algorithms were developed and solved this type of problem. It motivated us to check the performance of recently developed gaining-sharing knowledge-based optimization algorithm (GSK), which is based on the concept of gaining and sharing knowledge of humans throughout their lifespan. It depends on two stages: beginners-intermediate gaining and sharing stage and intermediate-experts gaining and sharing stage. In this study, two approaches are proposed to solve feature selection problems: FS-BGSK: a novel binary version of GSK algorithm that relies on these two stages with knowledge factor 1 and FS-pBGSK: a population reduction technique that is employed on BGSK algorithm to enhance the exploration and exploitation quality of FS-BGSK. The proposed approaches are checked on twenty two feature selection benchmark datasets from UCI repository that contains small, medium and large dimensions datasets. The obtained results are compared with seven state-of-the-art metaheuristic algorithms; binary differential evolution, binary particle swarm optimization algorithm, binary bat algorithm, binary grey wolf optimizer, binary ant lion optimizer, binary dragonfly algorithm and binary salp swarm algorithm. It concludes that FS-pBGSK and FS-BGSK outperform other algorithms in terms of accuracy, convergence and robustness in most of the datasets.
引用
收藏
页码:5989 / 6008
页数:20
相关论文
共 68 条
[1]  
Akinyelu AA, 2019, INT CONF SOFT COMP, P7, DOI [10.1109/iscmi47871.2019.9004305, 10.1109/ISCMI47871.2019.9004305]
[2]   Binary multi-verse optimization algorithm for global optimization and discrete problems [J].
Al-Madi, Nailah ;
Faris, Hossam ;
Mirjalili, Seyedali .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (12) :3445-3465
[3]   Optimal feature selection using binary teaching learning based optimization algorithm [J].
Allam, Mohan ;
Nandhini, M. .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (02) :329-341
[4]   BMNABC: Binary Multi-Neighborhood Artificial Bee Colony for High-Dimensional Discrete Optimization Problems [J].
Beheshti, Zahra .
CYBERNETICS AND SYSTEMS, 2018, 49 (7-8) :452-474
[5]   Self-adaptive differential evolution algorithm using population size reduction and three strategies [J].
Brest, Janez ;
Maucec, Mirjam Sepesy .
SOFT COMPUTING, 2011, 15 (11) :2157-2174
[6]   A survey on feature selection methods [J].
Chandrashekar, Girish ;
Sahin, Ferat .
COMPUTERS & ELECTRICAL ENGINEERING, 2014, 40 (01) :16-28
[7]   Feature selection using binary grey wolf optimizer with elite-based crossover for Arabic text classification [J].
Chantar, Hamouda ;
Mafarja, Majdi ;
Alsawalqah, Hamad ;
Heidari, Ali Asghar ;
Aljarah, Ibrahim ;
Faris, Hossam .
NEURAL COMPUTING & APPLICATIONS, 2020, 32 (16) :12201-12220
[8]   Enhancing distributed differential evolution with multicultural migration for global numerical optimization [J].
Cheng, Jixiang ;
Zhang, Gexiang ;
Neri, Ferrante .
INFORMATION SCIENCES, 2013, 247 :72-93
[9]   Improved binary PSO for feature selection using gene expression data [J].
Chuang, Li-Yeh ;
Chang, Hsueh-Wei ;
Tu, Chung-Jui ;
Yang, Cheng-Hong .
COMPUTATIONAL BIOLOGY AND CHEMISTRY, 2008, 32 (01) :29-38
[10]   Optimal solutions for singular linear systems of Caputo fractional differential equations [J].
Dassios, Ioannis ;
Baleanu, Dumitru .
MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2021, 44 (10) :7884-7896