Precise feature selection via non-convex regularized graph embedding and self-representation for unsupervised learning

被引:1
作者
Bai, Hanru [1 ]
Huang, Ming [1 ]
Zhong, Ping [1 ]
机构
[1] China Agr Univ, Coll Sci, Beijing 100083, Peoples R China
关键词
Unsupervised feature selection; Self-representation; Graph optimization; e'20-norm constraint; ALGORITHM;
D O I
10.1016/j.knosys.2024.111900
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In graph embedding learning with unsupervised feature selection fields, similarity matrices are usually obtained only from the initial noise -laden samples, and the probable association between various features is often ignored. To tackle the issues described above, this article proposes an effective unsupervised group feature selection approach via non -convex regularized graph embedding and self -representation (NLGMS). NLGMS integrates the similarity matrix and feature selection as a joint system on the basis of graph. It combines selfrepresentation learning into the system to preserve the global structure and learns the nonconvex projection matrix to direct the procedure of feature selection. Specifically, first, NLGMS presents a unified framework for global structure learning, local structure learning, and feature selection process so the data's intrinsic structure is excellently captured and learned adaptively. Second, nonconvex e' 2 , 0 -norm is enforced upon the projection matrix to perform the process of feature selection, ensuring that the optimal feature subset can be picked precisely. Nonconvex e' 2 , 0 -norm constraint considers the probable association between various features so that it can deliver optimal performance by considering the feature subset as an integral whole, which other convex regularized constraints often fail to achieve. Finally, the introduction to self -representation learning can facilitate the reconstruction of samples in low -rank subspaces, strengthening the model's robustness. To tackle this challenging nonconvex model, an innovative alternative optimization technique is exploited. In addition, to validate the superiority of NLGMS, exhaustive experiments are performed on one synthetic dataset, six benchmark datasets, and one fish image dataset. The source code is available at: https://github.com/hrbai/ NLGMS.
引用
收藏
页数:15
相关论文
共 54 条
[41]   Robust multi-class feature selection via l2,0-norm regularization minimization [J].
Sun, Zhenzhen ;
Yu, Yuanlong .
INTELLIGENT DATA ANALYSIS, 2022, 26 (01) :57-73
[42]   A novel wrapper-based feature subset selection method using modified binary differential evolution algorithm [J].
Tarkhaneh, Omid ;
Thanh Thi Nguyen ;
Mazaheri, Samaneh .
INFORMATION SCIENCES, 2021, 565 :278-305
[43]   Structured learning for unsupervised feature selection with high-order matrix factorization [J].
Wang, Shiping ;
Chen, Jiawei ;
Guo, Wenzhong ;
Liu, Genggeng .
EXPERT SYSTEMS WITH APPLICATIONS, 2020, 140
[44]   Retargeted multi-view classification via structured sparse learning [J].
Wang, Zhi ;
Shen, Zhencai ;
Zou, Hui ;
Zhong, Ping ;
Chen, Yingyi .
SIGNAL PROCESSING, 2022, 197
[45]  
Wei XK, 2016, JMLR WORKSH CONF PRO, V51, P995
[46]   Global and Local Structure Preservation for Nonlinear High-dimensional Spectral Clustering [J].
Wen, Guoqiu ;
Zhu, Yonghua ;
Chen, Linjun ;
Zhan, Mengmeng ;
Xie, Yangcai .
COMPUTER JOURNAL, 2021, 64 (07) :993-1004
[47]  
Yang Y., 2011, IJCAI INT JOINT C AR
[48]   Robust discriminant feature selection via joint L2,1-norm distance minimization and maximization [J].
Yang, Zhangjing ;
Ye, Qiaolin ;
Chen, Qiao ;
Ma, Xu ;
Fu, Liyong ;
Yang, Guowei ;
Yan, He ;
Liu, Fan .
KNOWLEDGE-BASED SYSTEMS, 2020, 207
[49]   Hierarchical Deep Click Feature Prediction for Fine-Grained Image Recognition [J].
Yu, Jun ;
Tan, Min ;
Zhang, Hongyuan ;
Tao, Dacheng ;
Rui, Yong .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) :563-578
[50]   Learning to Rank Using User Clicks and Visual Features for Image Retrieval [J].
Yu, Jun ;
Tao, Dacheng ;
Wang, Meng ;
Rui, Yong .
IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (04) :767-779