Joint Adaptive Graph Learning and Discriminative Analysis for Unsupervised Feature Selection

被引:14
作者
Zhao, Haifeng [1 ]
Li, Qi [1 ]
Wang, Zheng [2 ,3 ]
Nie, Feiping [2 ,3 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Anhui Prov Key Lab Multimodal Cognit Computat, Hefei 230601, Anhui, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Shaanxi, Peoples R China
[3] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Unsupervised feature selection; Adaptive graph learning; Intrinsic structure exploiting; Uncorrelated constraint; CLASSIFICATION;
D O I
10.1007/s12559-021-09875-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised feature selection plays a dominant role in the process of high-dimensional and unlabeled data. Conventional spectral-based unsupervised feature selection methods always learn the subspace based on the predefined graph which constructed by the original features. Therefore, if the data is corrupted by the noise or redundancy existing in the high-dimensional, then the graph will be incorrect and further degrade the performance of downstream tasks. In this paper, we propose a new unsupervised feature selection method, in which the graph is self-adjusting by the original graph and learned subspace, so as to be the optimal one. Besides, the uncorrelated constraint is added to enhance the discriminability of the model. To optimize the model, we propose an alternative iterative algorithm and provide strict convergence proof. Extensive experiments are conducted to evaluate the performance of our method in comparison with other SOTA methods. The proposed adaptive graph learning strategy can learn a high-quality graph with the information of data structure more accurate. Besides, the uncorrelated constraint extremely ensures the discriminability of selected features.
引用
收藏
页码:1211 / 1221
页数:11
相关论文
共 24 条
  • [1] Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection
    Belhumeur, PN
    Hespanha, JP
    Kriegman, DJ
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) : 711 - 720
  • [2] Exploiting Combination Effect for Unsupervised Feature Selection by l2,0 Norm
    Du, Xingzhong
    Nie, Feiping
    Wang, Weiqing
    Yang, Yi
    Zhou, Xiaofang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (01) : 201 - 214
  • [4] Hammer P., 1962, SIAM Rev, V4, P163, DOI DOI 10.1137/1004050
  • [5] Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature Selection
    Hou, Chenping
    Nie, Feiping
    Li, Xuelong
    Yi, Dongyun
    Wu, Yi
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (06) : 793 - 804
  • [6] Combining Expression Data and Knowledge Ontology for Gene Clustering and Network Reconstruction
    Lee, Wei-Po
    Lin, Chung-Hsun
    [J]. COGNITIVE COMPUTATION, 2016, 8 (02) : 217 - 227
  • [7] Generalized Uncorrelated Regression with Adaptive Graph for Unsupervised Feature Selection
    Li, Xuelong
    Zhang, Han
    Zhang, Rui
    Liu, Yun
    Nie, Feiping
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (05) : 1587 - 1595
  • [8] Automatic classification of single facial images
    Lyons, MJ
    Budynek, J
    Akamatsu, S
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1999, 21 (12) : 1357 - 1362
  • [9] Efficient Hybrid Nature-Inspired Binary Optimizers for Feature Selection
    Mafarja, Majdi
    Qasem, Asma
    Heidari, Ali Asghar
    Aljarah, Ibrahim
    Faris, Hossam
    Mirjalili, Seyedali
    [J]. COGNITIVE COMPUTATION, 2020, 12 (01) : 150 - 175
  • [10] Subspace Sparse Discriminative Feature Selection
    Nie, Feiping
    Wang, Zheng
    Tian, Lai
    Wang, Rong
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (06) : 4221 - 4233