Feature Selection Using Diversity-Based Multi-objective Binary Differential Evolution

被引:44
作者
Wang, Peng [1 ]
Xue, Bing [1 ]
Liang, Jing [2 ,3 ]
Zhang, Mengjie [1 ]
机构
[1] Victoria Univ Wellington, Sch Engn & Comp Sci, Wellington 6012, New Zealand
[2] Henan Inst Technol, Sch Elect Engn & Automat, Xinxiang 453000, Peoples R China
[3] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-objective optimization; differential evolution; feature selection; population diversity; GENETIC ALGORITHM; OPTIMIZATION; RELEVANCE;
D O I
10.1016/j.ins.2022.12.117
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
By identifying relevant features from the original data, feature selection methods can maintain or improve the classification accuracy and reduce the dimensionality. Recently, many multi -objective evolutionary methods have been proposed for feature selection. However, effectively handling the trade-offs between convergence and diversity of the non-dominated solutions re-mains a major challenge, especially for high-dimensional datasets. To cover this issue, this work studies a diversity-based multi-objective differential evolution approach to feature selection. During the environmental selection process, each of the solutions in the candidate pool will have a diversity score, and solutions with large diversity score values will be preferred so as to improve the population diversity. To reduce the search space, irrelevant and weakly relevant features are detected and removed in the proposed method. A new binary mutation operator using the neighborhood information of individuals is also proposed, aiming to produce better feature subsets. Experimental results on 14 datasets with varying difficulties show that the proposed feature selection method can obtain significantly better feature selection performance than cur-rent popular multi-objective feature selection methods.
引用
收藏
页码:586 / 606
页数:21
相关论文
共 50 条
[1]   Approaches to Multi-Objective Feature Selection: A Systematic Literature Review [J].
Al-Tashi, Qasem ;
Abdulkadir, Said Jadid ;
Rais, Helmi Md ;
Mirjalili, Seyedali ;
Alhussian, Hitham .
IEEE ACCESS, 2020, 8 :125076-125096
[2]  
[Anonymous], 2001, SWARM INTELL-US
[3]   A survey on swarm intelligence approaches to feature selection in data mining [J].
Bach Hoai Nguyen ;
Xue, Bing ;
Zhang, Mengjie .
SWARM AND EVOLUTIONARY COMPUTATION, 2020, 54
[4]   Maximum relevance minimum common redundancy feature selection for nonlinear data [J].
Che, Jinxing ;
Yang, Youlong ;
Li, Li ;
Bai, Xuying ;
Zhang, Shenghu ;
Deng, Chengzhi .
INFORMATION SCIENCES, 2017, 409 :68-86
[5]  
Chen K., IEEE T EVOLUT COMPUT
[6]  
Cheng F., IEEE T EVOLUT COMPUT
[7]   A Steering-Matrix-Based Multiobjective Evolutionary Algorithm for High-Dimensional Feature Selection [J].
Cheng, Fan ;
Chu, Feixiang ;
Xu, Yi ;
Zhang, Lei .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (09) :9695-9708
[8]   A fast and elitist multiobjective genetic algorithm: NSGA-II [J].
Deb, K ;
Pratap, A ;
Agarwal, S ;
Meyarivan, T .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) :182-197
[9]  
Dua D., 2017, UCI MACHINE LEARNING
[10]   Research on collaborative negotiation for e-commerce. [J].
Feng, YQ ;
Lei, Y ;
Li, Y ;
Cao, RZ .
2003 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-5, PROCEEDINGS, 2003, :2085-2088