Towards multi-objective high-dimensional feature selection via evolutionary multitasking

被引:6
作者
Feng, Yinglan [1 ]
Feng, Liang [2 ]
Liu, Songbai [3 ]
Kwong, Sam [4 ]
Tan, Kay Chen [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[2] Chongqing Univ, Coll Comp Sci, Chongqing, Peoples R China
[3] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen, Peoples R China
[4] Lingnan Univ, Hong Kong, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Feature selection; Evolutionary multitasking; High -dimensional classification; Multi -objective optimization; ALGORITHMS;
D O I
10.1016/j.swevo.2024.101618
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature selection (FS) plays a crucial role in high -dimensional classification problems by identifying relevant features that contribute to model performance. Evolutionary multitasking (EMT) has recently shown success in FS problems. However, existing EMT -based FS methods have limitations in terms of diversity in task construction, evolutionary search, and knowledge transfer, leading to inadequate acquisition, exploration, and utilization of knowledge. To this end, this paper develops a novel EMT framework for multi -objective highdimensional FS problems, namely MO-FSEMT. In particular, multiple auxiliary tasks are constructed by distinct formulation methods to provide diverse search spaces and information representations and then simultaneously addressed with the original task by leveraging multiple evolutionary solvers with different biases and search preferences. A task -specific -based knowledge transfer mechanism is designed to leverage the advantageous information from each task, facilitating the discovery and effective transmission of high -quality solutions during the search process. Comprehensive experimental results on 27 real high -dimensional datasets demonstrate the superiority of MO-FSEMT over state-of-the-art FS methods in terms of effectiveness and efficiency. Ablation studies further confirm the contributions of key components of the proposed MO-FSEMT.
引用
收藏
页数:16
相关论文
共 62 条
[1]   Breast cancer diagnosis using GA feature selection and Rotation Forest [J].
Alickovic, Emina ;
Subasi, Abdulhamit .
NEURAL COMPUTING & APPLICATIONS, 2017, 28 (04) :753-763
[2]   A survey on swarm intelligence approaches to feature selection in data mining [J].
Bach Hoai Nguyen ;
Xue, Bing ;
Zhang, Mengjie .
SWARM AND EVOLUTIONARY COMPUTATION, 2020, 54
[3]   A GRASP algorithm for fast hybrid (filter-wrapper) feature subset selection in high-dimensional datasets [J].
Bermejo, Pablo ;
Gamez, Jose A. ;
Puerta, Jose M. .
PATTERN RECOGNITION LETTERS, 2011, 32 (05) :701-711
[4]   A survey on feature selection methods [J].
Chandrashekar, Girish ;
Sahin, Ferat .
COMPUTERS & ELECTRICAL ENGINEERING, 2014, 40 (01) :16-28
[5]   Evolutionary Multitasking for Feature Selection in High-Dimensional Classification via Particle Swarm Optimization [J].
Chen, Ke ;
Xue, Bing ;
Zhang, Mengjie ;
Zhou, Fengyu .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2022, 26 (03) :446-460
[6]   An Evolutionary Multitasking-Based Feature Selection Method for High-Dimensional Classification [J].
Chen, Ke ;
Xue, Bing ;
Zhang, Mengjie ;
Zhou, Fengyu .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (07) :7172-7186
[7]   A Steering-Matrix-Based Multiobjective Evolutionary Algorithm for High-Dimensional Feature Selection [J].
Cheng, Fan ;
Chu, Feixiang ;
Xu, Yi ;
Zhang, Lei .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (09) :9695-9708
[8]   A Competitive Swarm Optimizer for Large Scale Optimization [J].
Cheng, Ran ;
Jin, Yaochu .
IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (02) :191-204
[9]  
Deb Kalyanmoy, 2014, International Journal of Artificial Intelligence and Soft Computing, V4, P1, DOI 10.1504/IJAISC.2014.059280
[10]   An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints [J].
Deb, Kalyanmoy ;
Jain, Himanshu .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2014, 18 (04) :577-601