S-shaped and V-shaped gaining-sharing knowledge-based algorithm for feature selection

被引:52
作者
Agrawal, Prachi [1 ]
Ganesh, Talari [1 ]
Oliva, Diego [2 ,3 ]
Mohamed, Ali Wagdy [4 ,5 ]
机构
[1] Natl Inst Technol Hamirpur, Dept Math & Sci Comp, Hamirpur 177005, Himachal Prades, India
[2] Univ Oberta Catalunya, IN3 Comp Sci Dept, Castelldefels, Spain
[3] Univ Guadalajara, CUCEI, Dept Ciencias Computacales, Guadalajara, Jal, Mexico
[4] Cairo Univ, Fac Grad Studies Stat Res, Operat Res Dept, Giza 12613, Egypt
[5] Nile Univ, Sch Engn & Appl Sci, Wireless Intelligent Networks Ctr WINC, Giza, Egypt
关键词
Gaining-sharing knowledge-based optimization algorithm; S-shaped and V-shaped transfer functions; Feature selection; Classification; K-NN classifier; FEATURE SUBSET-SELECTION; PARTICLE SWARM OPTIMIZATION; GENETIC ALGORITHM; CLASSIFICATION;
D O I
10.1007/s10489-021-02233-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In machine learning, searching for the optimal feature subset from the original datasets is a very challenging and prominent task. The metaheuristic algorithms are used in finding out the relevant, important features, that enhance the classification accuracy and save the resource time. Most of the algorithms have shown excellent performance in solving feature selection problems. A recently developed metaheuristic algorithm, gaining-sharing knowledge-based optimization algorithm (GSK), is considered for finding out the optimal feature subset. GSK algorithm was proposed over continuous search space; therefore, a total of eight S-shaped and V-shaped transfer functions are employed to solve the problems into binary search space. Additionally, a population reduction scheme is also employed with the transfer functions to enhance the performance of proposed approaches. It explores the search space efficiently and deletes the worst solutions from the search space, due to the updation of population size in every iteration. The proposed approaches are tested over twenty-one benchmark datasets from UCI repository. The obtained results are compared with state-of-the-art metaheuristic algorithms including binary differential evolution algorithm, binary particle swarm optimization, binary bat algorithm, binary grey wolf optimizer, binary ant lion optimizer, binary dragonfly algorithm, binary salp swarm algorithm. Among eight transfer functions, V-4 transfer function with population reduction on binary GSK algorithm outperforms other optimizers in terms of accuracy, fitness values and the minimal number of features. To investigate the results statistically, two non-parametric statistical tests are conducted that concludes the superiority of the proposed approach.
引用
收藏
页码:81 / 112
页数:32
相关论文
共 67 条
[1]   A competitive chain-based Harris Hawks Optimizer for global optimization and multi-level image thresholding problems [J].
Abd Elaziz, Mohamed ;
Heidari, Ali Asghar ;
Fujita, Hamido ;
Moayedi, Hossein .
APPLIED SOFT COMPUTING, 2020, 95
[2]  
Abe S., 2005, Proc. ESANN, P163
[3]   A novel binary gaining-sharing knowledge-based optimization algorithm for feature selection [J].
Agrawal, Prachi ;
Ganesh, Talari ;
Mohamed, Ali Wagdy .
NEURAL COMPUTING & APPLICATIONS, 2021, 33 (11) :5989-6008
[4]   Binary multi-verse optimization algorithm for global optimization and discrete problems [J].
Al-Madi, Nailah ;
Faris, Hossam ;
Mirjalili, Seyedali .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (12) :3445-3465
[5]   Optimal feature selection using binary teaching learning based optimization algorithm [J].
Allam, Mohan ;
Nandhini, M. .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (02) :329-341
[6]   Self-adaptive differential evolution algorithm using population size reduction and three strategies [J].
Brest, Janez ;
Maucec, Mirjam Sepesy .
SOFT COMPUTING, 2011, 15 (11) :2157-2174
[7]   Enhancing distributed differential evolution with multicultural migration for global numerical optimization [J].
Cheng, Jixiang ;
Zhang, Gexiang ;
Neri, Ferrante .
INFORMATION SCIENCES, 2013, 247 :72-93
[8]   Improved binary PSO for feature selection using gene expression data [J].
Chuang, Li-Yeh ;
Chang, Hsueh-Wei ;
Tu, Chung-Jui ;
Yang, Cheng-Hong .
COMPUTATIONAL BIOLOGY AND CHEMISTRY, 2008, 32 (01) :29-38
[9]  
Dash M., 1997, Intelligent Data Analysis, V1
[10]   Minimum redundancy feature selection from microarray gene expression data [J].
Ding, C ;
Peng, HC .
PROCEEDINGS OF THE 2003 IEEE BIOINFORMATICS CONFERENCE, 2003, :523-528