Local Sensitive Dual Concept Factorization for Unsupervised Feature Selection

被引:4
|
作者
Zhao, Hua [1 ]
Du, Liang [2 ,3 ]
Wei, Jianglai [1 ]
Fan, Yalong [2 ]
机构
[1] Shanxi Univ, Business Coll, Taiyuan 030006, Peoples R China
[2] Shanxi Univ, Sch Comp & Informat Technol, Taiyuan 030006, Peoples R China
[3] Shanxi Univ, Inst Big Data Sci & Ind, Taiyuan 030006, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Clustering algorithms; Task analysis; Learning systems; Approximation algorithms; Machine learning; Licenses; Dual concept learning; local sensitive regularization; corr-entropy induced metric; unsupervised feature selection;
D O I
10.1109/ACCESS.2020.3010862
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present a novel Local Sensitive Dual Concept Learning (LSDCL) method for the task of unsupervised feature selection. We first reconstruct the original data matrix by the proposed dual concept learning model, which inherits the merit of co-clustering based dual learning mechanism for more interpretable and compact data reconstruction. We then adopt the local sensitive loss function, which emphasizes more on most similar pairs with small errors to better characterize the local structure of data. In this way, our method can select features with better clustering results by more compact data reconstruction and more faithful local structure preserving. An iterative algorithm with convergence guarantee is also developed to find the optimal solution. We fully investigate the performance improvement by the newly developed terms, individually and simultaneously. Extensive experiments on benchmark datasets further show that LSDCL outperforms many state-of-the-art unsupervised feature selection algorithms.
引用
收藏
页码:133128 / 133143
页数:16
相关论文
共 50 条
  • [1] Orthogonally constrained matrix factorization for robust unsupervised feature selection with local preserving
    Luo, Chuan
    Zheng, Jian
    Li, Tianrui
    Chen, Hongmei
    Huang, Yanyong
    Peng, Xi
    INFORMATION SCIENCES, 2022, 586 : 662 - 675
  • [2] Unsupervised feature selection by regularized matrix factorization
    Qi, Miao
    Wang, Ting
    Liu, Fucong
    Zhang, Baoxue
    Wang, Jianzhong
    Yi, Yugen
    NEUROCOMPUTING, 2018, 273 : 593 - 610
  • [3] Dual Regularized Unsupervised Feature Selection Based on Matrix Factorization and Minimum Redundancy with application in gene selection
    Saberi-Movahed, Farid
    Rostami, Mehrdad
    Berahmand, Kamal
    Karami, Saeed
    Tiwari, Prayag
    Oussalah, Mourad
    Band, Shahab S.
    KNOWLEDGE-BASED SYSTEMS, 2022, 256
  • [4] Dual Regularized Unsupervised Feature Selection Based on Matrix Factorization and Minimum Redundancy with application in gene selection
    Saberi-Movahed, Farid
    Rostami, Mehrdad
    Berahmand, Kamal
    Karami, Saeed
    Tiwari, Prayag
    Oussalah, Mourad
    Band, Shahab S.
    Knowledge-Based Systems, 2022, 256
  • [5] Robust unsupervised feature selection via matrix factorization
    Du, Shiqiang
    Ma, Yide
    Li, Shouliang
    Ma, Yurun
    NEUROCOMPUTING, 2017, 241 : 115 - 127
  • [6] Ordinal preserving matrix factorization for unsupervised feature selection
    Yi, Yugen
    Zhou, Wei
    Liu, Qinghua
    Luo, Guoliang
    Wang, Jianzhong
    Fang, Yuming
    Zheng, Caixia
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 67 : 118 - 131
  • [7] Feature Selection for Adaptive Dual-Graph Regularized Concept Factorization for Data Representation
    Jun Ye
    Zhong Jin
    Neural Processing Letters, 2017, 45 : 667 - 688
  • [8] Feature Selection for Adaptive Dual-Graph Regularized Concept Factorization for Data Representation
    Ye, Jun
    Jin, Zhong
    NEURAL PROCESSING LETTERS, 2017, 45 (02) : 667 - 688
  • [9] Unsupervised feature selection based on matrix factorization and adaptive graph
    Cao L.
    Lin X.
    Su S.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2021, 43 (08): : 2197 - 2208
  • [10] Unsupervised Feature Selection Based on Matrix Factorization with Redundancy Minimization
    Fan, Yang
    Dai, Jianhua
    Xu, Siqi
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT III, 2019, 11955 : 549 - 560