Two-Dimensional Unsupervised Feature Selection via Sparse Feature Filter

被引:10
作者
Li, Junyu [1 ]
Chen, Jiazhou [1 ]
Qi, Fei [1 ]
Dan, Tingting [1 ]
Weng, Wanlin [1 ]
Zhang, Bin [1 ]
Yuan, Haoliang [2 ]
Cai, Hongmin [1 ]
Zhong, Cheng [3 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[2] Guangdong Univ Technol, Sch Automat, Guangzhou, Peoples R China
[3] Guangxi Univ, Sch Comp Elect & Informat, Nanning, Guangxi, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Feature extraction; Sparse matrices; Optimization; Task analysis; Training; Mutual information; Limiting; 2-D data; feature filter; learnable weighting; sparse regularization; unsupervised feature selection; MULTIVIEW FEATURE-SELECTION; FACE RECOGNITION; REGRESSION;
D O I
10.1109/TCYB.2022.3162908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unsupervised feature selection is a vital yet challenging topic for effective data learning. Recently, 2-D feature selection methods show good performance on image analysis by utilizing the structure information of image. Current 2-D methods usually adopt a sparse regularization to spotlight the key features. However, such scheme introduces additional hyperparameter needed for pruning, limiting the applicability of unsupervised algorithms. To overcome these challenges, we design a feature filter to estimate the weight of image features for unsupervised feature selection. Theoretical analysis shows that a sparse regularization can be derived from the feature filter by transformation, indicating that the filter plays the same role as the popular sparse regularization does. We deploy two distinct strategies in terms of feature selection, called multiple feature filters and single common feature filter. The former divides the optimization problem into multiple independent subproblems and selects features that meet the respective interests of each subproblem. The latter selects features that are in the interest of the overall optimization problem. Extensive experiments on seven benchmark datasets show that our unsupervised 2-D weight-based feature selection methods achieve superior performance over the state-of-the-art methods.
引用
收藏
页码:5605 / 5617
页数:13
相关论文
共 45 条
  • [1] Regularized symmetric indefinite systems in interior point methods for linear and quadratic optimization
    Altman, A
    Gondzio, J
    [J]. OPTIMIZATION METHODS & SOFTWARE, 1999, 11-2 (1-4) : 275 - 302
  • [2] Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection
    Belhumeur, PN
    Hespanha, JP
    Kriegman, DJ
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) : 711 - 720
  • [3] Cai D., 2010, P 16 ACM SIGKDD INT, P333
  • [4] Tensor-based Multi-view Feature Selection with Applications to Brain Diseases
    Cao, Bokai
    He, Lifang
    Kong, Xiangnan
    Yu, Philip S.
    Hao, Zhifeng
    Ragin, Ann B.
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2014, : 40 - 49
  • [5] Face recognition based on multi-class mapping of Fisher scores
    Chen, L
    Man, H
    Nefian, AV
    [J]. PATTERN RECOGNITION, 2005, 38 (06) : 799 - 811
  • [6] Local Adaptive Projection Framework for Feature Selection of Labeled and Unlabeled Data
    Chen, Xiaojun
    Yuan, Guowen
    Wang, Wenting
    Nie, Feiping
    Chang, Xiaojun
    Huang, Joshua Zhexue
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (12) : 6362 - 6373
  • [7] Chen XJ, 2017, PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P1525
  • [8] Multiple Relevant Feature Ensemble Selection Based on Multilayer Co-Evolutionary Consensus MapReduce
    Ding, Weiping
    Lin, Chin-Teng
    Pedrycz, Witold
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (02) : 425 - 439
  • [9] LOW-RANK MATRIX RECOVERY VIA ITERATIVELY REWEIGHTED LEAST SQUARES MINIMIZATION
    Fornasier, Massimo
    Rauhut, Holger
    Ward, Rachel
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2011, 21 (04) : 1614 - 1640
  • [10] Generalised bilinear regression
    Gabriel, KR
    [J]. BIOMETRIKA, 1998, 85 (03) : 689 - 700