An Evolutionary Multitasking Algorithm With Multiple Filtering for High-Dimensional Feature Selection

被引:44
作者
Li, Lingjie [1 ]
Xuan, Manlin [1 ]
Lin, Qiuzhen [1 ]
Jiang, Min [2 ]
Ming, Zhong [1 ]
Tan, Kay Chen [3 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[2] Xiamen Univ, Sch Informat, Xiamen 361005, Peoples R China
[3] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Competitive swarm optimizer (CSO); evolutionary algorithm (EA); evolutionary multitasking (EMT); feature selection (FS); high-dimensional classification; COMPETITIVE SWARM OPTIMIZER; CLASSIFICATION;
D O I
10.1109/TEVC.2023.3254155
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, evolutionary multitasking (EMT) has been successfully used in the field of high-dimensional classification. However, the generation of multiple tasks in the existing EMT-based feature selection (FS) methods is relatively simple, using only the Relief- F method to collect related features with similar importance into one task, which cannot provide more diversified tasks for knowledge transfer. Thus, this article devises a new EMT algorithm for FS in high-dimensional classification, which first adopts different filtering methods to produce multiple tasks and then modifies a competitive swarm optimizer (CSO) to efficiently solve these related tasks via knowledge transfer. First, a diversified multiple task generation method is designed based on multiple filtering methods, which generates several relevant low-dimensional FS tasks by eliminating irrelevant features. In this way, useful knowledge for solving simple and relevant tasks can be transferred to simplify and speed up the solution of the original high-dimensional FS task. Then, a CSO is modified to simultaneously solve these relevant FS tasks by transferring useful knowledge among them. Numerous empirical results demonstrate that the proposed EMT-based FS method can obtain a better feature subset than several state-of-the-art FS methods on 18 high-dimensional datasets.
引用
收藏
页码:802 / 816
页数:15
相关论文
共 60 条
[21]   A survey of artificial immune algorithms for multi-objective optimization [J].
Li, Lingjie ;
Lin, Qiuzhen ;
Ming, Zhong .
NEUROCOMPUTING, 2022, 489 :211-229
[22]   Multiobjective Evolutionary Multitasking With Two-Stage Adaptive Knowledge Transfer Based on Population Distribution [J].
Liang, Zhengping ;
Liang, Weiqi ;
Wang, Zhiqiang ;
Ma, Xiaoliang ;
Liu, Ling ;
Zhu, Zexuan .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (07) :4457-4469
[23]   An Embedded Feature Selection Method for Imbalanced Data Classification [J].
Liu, Haoyue ;
Zhou, MengChu ;
Liu, Qing .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2019, 6 (03) :703-715
[24]  
Liu S., 2022, IEEE T EVOLUT COMPUT, DOI DOI 10.1109/TEVC.2022.3166482
[25]   Learning to Accelerate Evolutionary Search for Large-Scale Multiobjective Optimization [J].
Liu, Songbai ;
Li, Jun ;
Lin, Qiuzhen ;
Tian, Ye ;
Tan, Kay Chen .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2023, 27 (01) :67-81
[26]   An Adaptive Localized Decision Variable Analysis Approach to Large-Scale Multiobjective and Many-Objective Optimization [J].
Ma, Lianbo ;
Huang, Min ;
Yang, Shengxiang ;
Wang, Rui ;
Wang, Xingwei .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (07) :6684-6696
[27]   A Review of Feature Reduction Techniques in Neuroimaging [J].
Mwangi, Benson ;
Tian, Tian Siva ;
Soares, Jair C. .
NEUROINFORMATICS, 2014, 12 (02) :229-244
[28]  
Patterson G, 2007, LECT NOTES COMPUT SC, V4830, P769
[29]   Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy [J].
Peng, HC ;
Long, FH ;
Ding, C .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27 (08) :1226-1238
[30]  
Press W.H., 2007, Numerical Recipes: The Art of Scientific Computing, V3rd