Hybrid particle swarm optimization with spiral-shaped mechanism for feature selection

被引:137
|
作者
Chen, Ke [1 ]
Zhou, Feng-Yu [1 ]
Yuan, Xian-Feng [2 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Shandong, Peoples R China
[2] Shandong Univ, Sch Mech Elect & Informat Engn, Weihai 264209, Peoples R China
基金
中国国家自然科学基金;
关键词
Particle swarm optimization; Feature selection; Classification; Optimization; ANT COLONY OPTIMIZATION; UNSUPERVISED FEATURE-SELECTION; INTEGRATING FEATURE-SELECTION; REDUNDANCY FEATURE-SELECTION; FEATURE SUBSET-SELECTION; GENE SELECTION; DIFFERENTIAL EVOLUTION; KRILL HERD; ALGORITHM; CLASSIFICATION;
D O I
10.1016/j.eswa.2019.03.039
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The "curse of dimensionality" is one of the largest problems that influences the quality of the optimization process in most data mining, pattern recognition, and machine learning tasks. Using high dimensional datasets to train a classification model may reduce the generalization performance of the learned model. In addition, high dimensionality of the dataset results in high computational and memory costs. Feature selection is an important data preprocessing approach in many practical application domains that are relevant to expert and intelligent systems. Feature selection aims at selecting a subset of informative and relevant features from an original feature dataset. Therefore, using a feature selection approach to process the original data prior to the learning process is essential for enhancing the performance on the classification task. In this paper, hybrid particle swarm optimization with a spiral shaped mechanism (HPSO-SSM) is proposed for selecting the optimal feature subset for classification via a wrapper-based approach. In HPSO-SSM, we make three improvements: First, a logistic map sequence is used to enhance the diversity in the search process. Second, two new parameters are introduced into the original position update formula, which can effectively improve the position quality of the next generation. Finally, a spiral-shaped mechanism is adopted as a local search operator around the known optimal solution region. For a complete evaluation, the proposed HPSO-SSM method is compared with six state-of-the-art meta-heuristic optimization algorithms, ten well-known wrapper-based feature selection techniques, and six classic filter-based feature selection methods. Various assessment indicators are used to properly evaluate and compare the performances of these approaches on twenty classic benchmark classification datasets from the UCI machine learning repository. According to the experimental results and statistical tests, the developed methods effectively and efficiently improve the classification accuracy compared with other wrapper-based approaches and filter-based approaches. The results demonstrate the high performance of the HPSO-SSM method in searching the feasible feature space and selecting the most informative attributes for solving classification problems. Therefore, the HPSO-SSM method has broad application prospects as a new feature selection approach. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:140 / 156
页数:17
相关论文
共 50 条
  • [21] Feature selection with clustering probabilistic particle swarm optimization
    Gao, Jinrui
    Wang, Ziqian
    Lei, Zhenyu
    Wang, Rong-Long
    Wu, Zhengwei
    Gao, Shangce
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (09) : 3599 - 3617
  • [22] Chunking and cooperation in particle swarm optimization for feature selection
    Sarhani, Malek
    Voss, Stefan
    ANNALS OF MATHEMATICS AND ARTIFICIAL INTELLIGENCE, 2022, 90 (7-9) : 893 - 913
  • [23] Particle Swarm Optimization for Feature Selection in Emotion Categorization
    Shehu, Harisu Abdullahi
    Browne, Will
    Eisenbarth, Hedwig
    2021 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC 2021), 2021, : 752 - 759
  • [24] Hybrid particle swarm optimization with sequential one point flipping algorithm for feature selection
    Isuwa, Jeremiah
    Abdullahi, Mohammed
    Ali, Yusuf Sahabi
    Abdulrahim, Abdulrazaq
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (25):
  • [25] Evolutionary feature selection based on hybrid bald eagle search and particle swarm optimization
    Liu, Zhao
    Wang, Aimin
    Sun, Geng
    Li, Jiahui
    Bao, Haiming
    Liu, Yanheng
    INTELLIGENT DATA ANALYSIS, 2024, 28 (01) : 121 - 159
  • [26] A diversity enhanced hybrid particle swarm optimization and crow search algorithm for feature selection
    Osei-kwakye, Jeremiah
    Han, Fei
    Amponsah, Alfred Adutwum
    Ling, Qing-Hua
    Abeo, Timothy Apasiba
    APPLIED INTELLIGENCE, 2023, 53 (17) : 20535 - 20560
  • [27] A Feature Selection Method Based on Hybrid Improved Binary Quantum Particle Swarm Optimization
    wu, Qing
    Ma, Zheping
    Fan, Jin
    Xu, Gang
    Shen, Yuanfeng
    IEEE ACCESS, 2019, 7 : 80588 - 80601
  • [28] Hybrid distributed feature selection using particle swarm optimization-mutual information
    Robindro K.
    Devi S.S.
    Clinton U.B.
    Takhellambam L.
    Singh Y.R.
    Hoque N.
    Data Sci. Manag., 1 (64-73): : 64 - 73
  • [29] An Efficient Feature Selection Method Using Hybrid Particle Swarm Optimization with Genetic Algorithm
    Narayanan, Arya
    Praveen, A. N.
    INTERNATIONAL CONFERENCE ON INTELLIGENT DATA COMMUNICATION TECHNOLOGIES AND INTERNET OF THINGS, ICICI 2018, 2019, 26 : 1148 - 1155
  • [30] A diversity enhanced hybrid particle swarm optimization and crow search algorithm for feature selection
    Jeremiah Osei-kwakye
    Fei Han
    Alfred Adutwum Amponsah
    Qing-Hua Ling
    Timothy Apasiba Abeo
    Applied Intelligence, 2023, 53 : 20535 - 20560