Feature selection via Non-convex constraint and latent representation learning with Laplacian embedding

被引:22
作者
Shang, Ronghua [1 ]
Kong, Jiarui [1 ]
Feng, Jie [1 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Shanxi, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Unsupervised feature selection; Latent representation learning; Pseudo-labels; Non-convex constraint; UNSUPERVISED FEATURE-SELECTION; SPARSE REGRESSION;
D O I
10.1016/j.eswa.2022.118179
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In unsupervised feature selection, the relationship between pseudo-labels is often ignored, and the intercon-nection information between the data is not fully utilized. In order to solve these problems, this paper proposes a feature selection method via non-convex constraint and latent representation learning with Laplacian embedding (NLRL-LE). NLRL-LE keeps the correlation between the pseudo-labels to make the pseudo-label closer to the true label. And it combines with the interconnection information between data, learns the latent representation matrix to guide feature selection. Specifically, first, NLRL-LE regards each pseudo-label as a latent feature of the sample, constructs a latent feature graph, and retains the inherent attributes of the pseudo-labels. Second, latent representation learning is performed in the space which is made up of the latent feature space and data space. Since the latent feature graph retains the correlation between pseudo-labels, latent representation learning considers the interconnection information between data, and the information contained in the latent represen-tation space is more complete. In addition, in order to make full use of pseudo-labels, the learned latent rep-resentation matrix is used as pseudo-label information to provide cluster labels in the latent representation space to guide feature selection. Finally, non-negative and l2,1-2-norm non-convex constraint are applied to the feature transformation matrix. The combination of non-negative constraint and non-convex constraint, compared with convex constraint, can ensure the row sparsity of the feature transformation matrix, select low-redundant fea-tures, and improve the feature selection effect. The experimental results show that the ACC and NMI of the NLRL-LE are better than the other seven compared algorithms on twelve datasets.
引用
收藏
页数:15
相关论文
共 38 条
  • [1] Graph Regularized Nonnegative Matrix Factorization for Data Representation
    Cai, Deng
    He, Xiaofei
    Han, Jiawei
    Huang, Thomas S.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (08) : 1548 - 1560
  • [2] Cai X., 2013, 23 INT JOINT C ARTIF, DOI [10.5555/2540128.2540307, DOI 10.5555/2540128.2540307]
  • [3] Fanty M., 1990, P 3 INT C NEUR INF P, P220
  • [4] Hybrid feature selection based on enhanced genetic algorithm for text categorization
    Ghareb, Abdullah Saeed
    Abu Bakar, Azuraliza
    Hamdan, Abdul Razak
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2016, 49 : 31 - 47
  • [5] A novel wrapper feature selection algorithm based on iterated greedy metaheuristic for sentiment classification
    Gokalp, Osman
    Tasci, Erdal
    Ugur, Aybars
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2020, 146
  • [6] He X., 2005, P 18 INT C NEUR INF, P507
  • [7] He XF, 2004, ADV NEUR IN, V16, P153
  • [8] Symmetric Nonnegative Matrix Factorization: Algorithms and Applications to Probabilistic Clustering
    He, Zhaoshui
    Xie, Shengli
    Zdunek, Rafal
    Zhou, Guoxu
    Cichocki, Andrzej
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (12): : 2117 - 2131
  • [9] Support vector machines
    Hearst, MA
    [J]. IEEE INTELLIGENT SYSTEMS & THEIR APPLICATIONS, 1998, 13 (04): : 18 - 21
  • [10] Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature Selection
    Hou, Chenping
    Nie, Feiping
    Li, Xuelong
    Yi, Dongyun
    Wu, Yi
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (06) : 793 - 804