An Evolutionary Multitasking Algorithm With Multiple Filtering for High-Dimensional Feature Selection

被引:44
作者
Li, Lingjie [1 ]
Xuan, Manlin [1 ]
Lin, Qiuzhen [1 ]
Jiang, Min [2 ]
Ming, Zhong [1 ]
Tan, Kay Chen [3 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[2] Xiamen Univ, Sch Informat, Xiamen 361005, Peoples R China
[3] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Competitive swarm optimizer (CSO); evolutionary algorithm (EA); evolutionary multitasking (EMT); feature selection (FS); high-dimensional classification; COMPETITIVE SWARM OPTIMIZER; CLASSIFICATION;
D O I
10.1109/TEVC.2023.3254155
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, evolutionary multitasking (EMT) has been successfully used in the field of high-dimensional classification. However, the generation of multiple tasks in the existing EMT-based feature selection (FS) methods is relatively simple, using only the Relief- F method to collect related features with similar importance into one task, which cannot provide more diversified tasks for knowledge transfer. Thus, this article devises a new EMT algorithm for FS in high-dimensional classification, which first adopts different filtering methods to produce multiple tasks and then modifies a competitive swarm optimizer (CSO) to efficiently solve these related tasks via knowledge transfer. First, a diversified multiple task generation method is designed based on multiple filtering methods, which generates several relevant low-dimensional FS tasks by eliminating irrelevant features. In this way, useful knowledge for solving simple and relevant tasks can be transferred to simplify and speed up the solution of the original high-dimensional FS task. Then, a CSO is modified to simultaneously solve these relevant FS tasks by transferring useful knowledge among them. Numerous empirical results demonstrate that the proposed EMT-based FS method can obtain a better feature subset than several state-of-the-art FS methods on 18 high-dimensional datasets.
引用
收藏
页码:802 / 816
页数:15
相关论文
共 60 条
[1]   An approach to feature selection for keystroke dynamics systems based on PSO and feature weighting [J].
Azevedo, Gabriel L. F. B. G. ;
Cavalcanti, George D. C. ;
Carvalho Filho, E. C. B. .
2007 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-10, PROCEEDINGS, 2007, :3577-3584
[2]   Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II [J].
Bali, Kavitesh Kumar ;
Ong, Yew Soon ;
Gupta, Abhishek ;
Tan, Puay Siew .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2020, 24 (01) :69-83
[3]   Evolutionary Multitasking for Feature Selection in High-Dimensional Classification via Particle Swarm Optimization [J].
Chen, Ke ;
Xue, Bing ;
Zhang, Mengjie ;
Zhou, Fengyu .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2022, 26 (03) :446-460
[4]   An Evolutionary Multitasking-Based Feature Selection Method for High-Dimensional Classification [J].
Chen, Ke ;
Xue, Bing ;
Zhang, Mengjie ;
Zhou, Fengyu .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (07) :7172-7186
[5]   Novel chaotic grouping particle swarm optimization with a dynamic regrouping strategy for solving numerical optimization tasks [J].
Chen, Ke ;
Xue, Bing ;
Zhang, Mengjie ;
Zhou, Fengyu .
KNOWLEDGE-BASED SYSTEMS, 2020, 194
[6]   Hybrid particle swarm optimization with spiral-shaped mechanism for feature selection [J].
Chen, Ke ;
Zhou, Feng-Yu ;
Yuan, Xian-Feng .
EXPERT SYSTEMS WITH APPLICATIONS, 2019, 128 :140-156
[7]   A Steering-Matrix-Based Multiobjective Evolutionary Algorithm for High-Dimensional Feature Selection [J].
Cheng, Fan ;
Chu, Feixiang ;
Xu, Yi ;
Zhang, Lei .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (09) :9695-9708
[8]   A Competitive Swarm Optimizer for Large Scale Optimization [J].
Cheng, Ran ;
Jin, Yaochu .
IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (02) :191-204
[9]  
Chikhi Salim, 2009, International Journal of Business Intelligence and Data Mining, V4, P375, DOI 10.1504/IJBIDM.2009.029085
[10]   The Boon of Gene-Culture Interaction for Effective Evolutionary Multitasking [J].
Da, Bingshui ;
Gupta, Abhishek ;
Ong, Yew Soon ;
Feng, Liang .
ARTIFICIAL LIFE AND COMPUTATIONAL INTELLIGENCE, ACALCI 2016, 2016, 9592 :54-65