Recursive elimination-election algorithms for wrapper feature selection

被引:27
|
作者
Liu, Wei [1 ]
Wang, Jianyu [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Automat, Nanjing 210094, Peoples R China
关键词
Wrapper feature selection; Classification; Recursion technique; High dimensionality; PARTICLE SWARM OPTIMIZATION; FLOATING SEARCH METHODS; GENETIC ALGORITHM; CLASSIFICATION;
D O I
10.1016/j.asoc.2021.107956
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For classification tasks in machine learning, this paper proposes a brand-new wrapper feature selection algorithm prototype named recursive elimination-election (REE), which is conceived in a simple but exquisite structure inspired by the recursion technique in computer science. Prevalent metaheuristic methods such as differential evolution (DE), particle swarm optimization (PSO), etc., from evolutionary computation (EC) and swarm intelligence (SI) communities have recently been widely applied to feature selection research, but suffer from severe drawbacks including but not limited to low efficient binary representation transformation, poor population diversity, excessive control parameter adjustments and sophisticated mechanisms. Instead, REE is organically constructed with an ordinary subset representation of feature indexes, simple operators, getting rid of extra control parameters. Specifically, REE is assembled of two basic recursive sub-algorithms, i.e., recursive random bisection elimination (RRBE) and recursive greedy binary election (RGBE), which somewhat embody the idea of "divide-and-conquer". By inspecting smaller and potential feature subsets in recursive ways, better subsets are returned automatically. A comprehensive experimental study was conducted on 14 UCI and ASU benchmark datasets with feature sizes ranging from dozens to thousands by using REE together with 6 state-of-the-art metaheuristic algorithms for comparison. The results show that the proposed REE has competitive search ability for feature selection problems, and it is especially prominent in handling high-dimensional datasets. Therefore, REE is promising to become a wrapper feature selection search paradigm with low solution cost and high efficiency. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] EEG Feature Selection for Emotion Recognition Based on Cross-subject Recursive Feature Elimination
    Zhang, Wei
    Yin, Zhong
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 6256 - 6261
  • [22] Parkinson’s disease classification using nature inspired feature selection and recursive feature elimination
    Prabhleen Kaur Chawla
    Meera S. Nair
    Dattakumar Gajanan Malkhede
    Hemprasad Yashwant Patil
    Sumit Kumar Jindal
    Avinash Chandra
    Mahadev Anant Gawas
    Multimedia Tools and Applications, 2024, 83 : 35197 - 35220
  • [23] Wrapper-based optimized feature selection using nature-inspired algorithms
    Karlupia, Namrata
    Abrol, Pawanesh
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (17): : 12675 - 12689
  • [24] WERFE: A Gene Selection Algorithm Based on Recursive Feature Elimination and Ensemble Strategy
    Chen, Qi
    Meng, Zhaopeng
    Su, Ran
    FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2020, 8
  • [25] Variable selection in kernel Fisher discriminant analysis by means of recursive feature elimination
    Louw, N.
    Steel, S. J.
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2006, 51 (03) : 2043 - 2055
  • [26] Recursive Feature Elimination by Sensitivity Testing
    Escanilla, Nicholas Sean
    Hellerstein, Lisa
    Kleiman, Ross
    Kuang, Zhaobin
    Shull, James D.
    Page, David
    2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, : 40 - 47
  • [27] Scale Abbreviation with Recursive Feature Elimination and Genetic Algorithms: An Illustration with the Test Emotions Questionnaire
    Kilmen, Sevilay
    Bulut, Okan
    INFORMATION, 2023, 14 (02)
  • [28] Feature Selection of Power System Transient Stability Assessment Based on Random Forest and Recursive Feature Elimination
    Zhang, Chun
    Li, Yansong
    Yu, Zhihong
    Tian, Fang
    2016 IEEE PES ASIA-PACIFIC POWER AND ENERGY ENGINEERING CONFERENCE (APPEEC), 2016, : 1264 - 1268
  • [29] Cross-Subject EEG Feature Selection for Emotion Recognition Using Transfer Recursive Feature Elimination
    Yin, Zhong
    Wang, Yongxiong
    Liu, Li
    Zhang, Wei
    Zhang, Jianhua
    FRONTIERS IN NEUROROBOTICS, 2017, 11
  • [30] Subject-generic EEG Feature Selection for Emotion Classification via Transfer Recursive Feature Elimination
    Yin Zhong
    Zhang Jianhua
    PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017), 2017, : 11005 - 11010