ECM-EFS: An ensemble feature selection based on enhanced co-association matrix

被引:14
|
作者
Wu, Ting [1 ]
Hao, Yihang [1 ]
Yang, Bo [1 ,2 ]
Peng, Lizhi [1 ,2 ]
机构
[1] Univ Jinan, Prov Key Lab Network Based Intelligent Comp, Jinan 250022, Peoples R China
[2] Quancheng Lab, Jinan 250022, Peoples R China
基金
中国国家自然科学基金;
关键词
Ensemble feature selection; Machine learning; Feature kernel; Relative -co -association matrix (RCM); CLASSIFICATION;
D O I
10.1016/j.patcog.2023.109449
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Currently, feature selection faces a huge challenge that no single feature selection method can effectively deal with various data sets for all real cases. Ensemble learning is a potential promising solution to address this problem. We propose an ensemble feature selection method based on enhanced co-association matrix (ECM-EFS). Positive-co-association matrix (PCM), negative-co-association matrix (NCM), and relative-co-association matrix (RCM) are first introduced to discover the relationship among features by ensembling the results in multiple feature selection methods. To further produce a more stable feature selection result, "Feature Kernel" is also introduced and used as a starting point for feature selection. Comparative experiments with four state-of-the-art methods have confirmed that the ECM-EFS can provide more robust results. Moreover, compared with traditional ensemble feature selection methods, our method can compensate information loss and reduce computational cost significantly. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] A Feature Selection Based Serial SVM Ensemble Classifier
    Cao, Jianjun
    Lv, Guojun
    Chang, Chen
    Li, Hongmei
    IEEE ACCESS, 2019, 7 : 144516 - 144523
  • [42] Stopping criteria for ensemble-based feature selection
    Windeatt, Terry
    Prior, Matthew
    MULTIPLE CLASSIFIER SYSTEMS, PROCEEDINGS, 2007, 4472 : 271 - +
  • [43] Ensemble Feature Selection Method Based on Adaptive Weights
    Li, Yanbiao
    Zhao, Zeyuan
    Yu, Ke
    Wu, Xiaofei
    PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON NETWORK INFRASTRUCTURE AND DIGITAL CONTENT (IEEE IC-NIDC), 2018, : 203 - 208
  • [44] A pareto-based ensemble of feature selection algorithms
    Hashemi, Amin
    Dowlatshahi, Mohammad Bagher
    Nezamabadi-pour, Hossein
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 180
  • [45] Enhanced Evolutionary Feature Selection and Ensemble Method for Cardiovascular Disease Prediction
    Jothi Prakash, V.
    Karthikeyan, N. K.
    INTERDISCIPLINARY SCIENCES-COMPUTATIONAL LIFE SCIENCES, 2021, 13 (03) : 389 - 412
  • [46] Multiple Relevant Feature Ensemble Selection Based on Multilayer Co-Evolutionary Consensus MapReduce
    Ding, Weiping
    Lin, Chin-Teng
    Pedrycz, Witold
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (02) : 425 - 439
  • [47] Multiple Relevant Feature Ensemble Selection Based on Multilayer Co-Evolutionary Consensus MapReduce
    School of Computer Science and Technology, Nantong University, Nantong
    226019, China
    不详
    NSW
    2007, Australia
    不详
    AB
    T6R 2V4, Canada
    IEEE Trans. Cybern., 2020, 2 (425-439): : 425 - 439
  • [48] A discernibility matrix based algorithm for feature selection
    Liu, Fuyan
    2006 International Conference on Computational Intelligence and Security, Pts 1 and 2, Proceedings, 2006, : 155 - 158
  • [49] A feature selection algorithm based on discernibility matrix
    Liu, Fuyan
    Lu, Shaoyi
    COMPUTATIONAL INTELLIGENCE AND SECURITY, 2007, 4456 : 259 - +
  • [50] Detection for JPEG steganography based on evolutionary feature selection and classifier ensemble selection
    Ma, Xiaofeng
    Zhang, Yi
    Song, Xiangfeng
    Fan, Chao
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2017, 11 (11): : 5592 - 5609