Recursive elimination-election algorithms for wrapper feature selection

被引:27
|
作者
Liu, Wei [1 ]
Wang, Jianyu [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Automat, Nanjing 210094, Peoples R China
关键词
Wrapper feature selection; Classification; Recursion technique; High dimensionality; PARTICLE SWARM OPTIMIZATION; FLOATING SEARCH METHODS; GENETIC ALGORITHM; CLASSIFICATION;
D O I
10.1016/j.asoc.2021.107956
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For classification tasks in machine learning, this paper proposes a brand-new wrapper feature selection algorithm prototype named recursive elimination-election (REE), which is conceived in a simple but exquisite structure inspired by the recursion technique in computer science. Prevalent metaheuristic methods such as differential evolution (DE), particle swarm optimization (PSO), etc., from evolutionary computation (EC) and swarm intelligence (SI) communities have recently been widely applied to feature selection research, but suffer from severe drawbacks including but not limited to low efficient binary representation transformation, poor population diversity, excessive control parameter adjustments and sophisticated mechanisms. Instead, REE is organically constructed with an ordinary subset representation of feature indexes, simple operators, getting rid of extra control parameters. Specifically, REE is assembled of two basic recursive sub-algorithms, i.e., recursive random bisection elimination (RRBE) and recursive greedy binary election (RGBE), which somewhat embody the idea of "divide-and-conquer". By inspecting smaller and potential feature subsets in recursive ways, better subsets are returned automatically. A comprehensive experimental study was conducted on 14 UCI and ASU benchmark datasets with feature sizes ranging from dozens to thousands by using REE together with 6 state-of-the-art metaheuristic algorithms for comparison. The results show that the proposed REE has competitive search ability for feature selection problems, and it is especially prominent in handling high-dimensional datasets. Therefore, REE is promising to become a wrapper feature selection search paradigm with low solution cost and high efficiency. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] A HYBRID FILTER-WRAPPER FEATURE SELECTION APPROACH FOR AUTHORSHIP ATTRIBUTION
    Ma, Jianbin
    Xue, Bing
    Zhang, Mengjie
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2019, 15 (05): : 1989 - 2006
  • [22] A Hybrid Genetic Algorithm With Wrapper-Embedded Approaches for Feature Selection
    Liu, Xiao-Ying
    Liang, Yong
    Wang, Sai
    Yang, Zi-Yi
    Ye, Han-Shuo
    IEEE ACCESS, 2018, 6 : 22863 - 22874
  • [23] A Hybrid Filter/Wrapper Approach of Feature Selection for Gene Expression Data
    Ke, Chao-Hsuan
    Yang, Cheng-Hong
    Chuang, Li-Yeh
    Yang, Cheng-San
    2008 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), VOLS 1-6, 2008, : 2663 - +
  • [24] A Hybrid Feature Selection Approach for Parkinson's Detection Based on Mutual Information Gain and Recursive Feature Elimination
    Lamba, Rohit
    Gulati, Tarun
    Jain, Anurag
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2022, 47 (08) : 10263 - 10276
  • [25] A wrapper feature selection approach using Markov blankets
    Hassan, Atif
    Paik, Jiaul Hoque
    Khare, Swanand Ravindra
    Hassan, Syed Asif
    PATTERN RECOGNITION, 2025, 158
  • [26] Wrapper Method for Feature Selection to Classify Cardiac Arrhythmia
    Mustaqeem, Anam
    Anwar, Syed Muhammad
    Majid, Muhammad
    Khan, Abdul Rashid
    2017 39TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2017, : 3656 - 3659
  • [27] A novel relation aware wrapper method for feature selection
    Liu, Zhaogeng
    Yang, Jielong
    Wang, Li
    Chang, Yi
    PATTERN RECOGNITION, 2023, 140
  • [28] MF-GARF: Hybridizing Multiple Filters and GA Wrapper for Feature Selection of Microarray Cancer Datasets
    Saqib, Pakizah
    Qamar, Usman
    Khan, Reda Ayesha
    Aslam, Andleeb
    2020 22ND INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT): DIGITAL SECURITY GLOBAL AGENDA FOR SAFE SOCIETY!, 2020, : 517 - 524
  • [29] A novel wrapper method for feature selection and its applications
    Chen, Gang
    Chen, Jin
    NEUROCOMPUTING, 2015, 159 : 219 - 226
  • [30] A WRAPPER FEATURE SELECTION FOR THE POLARIMETRIC SAR DATA CLASSIFICATION
    Maghsoudi, Yasser
    Collins, Michael
    Leckie, Donald G.
    2012 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2012, : 4347 - 4350