Joint Self-expression with Adaptive Graph for Unsupervised Feature Selection

被引:4
作者
Yuan, Aihong [1 ,3 ,4 ]
Gao, Xiaoyu [1 ]
You, Mengbo [1 ,3 ,4 ]
He, Dongjian [2 ,3 ,4 ]
机构
[1] Northwest A&F Univ, Coll Informat Engn, Xianyang 712100, Shaanxi, Peoples R China
[2] Northwest A&F Univ, Coll Mech & Elect Engn, Yangling 712100, Xianyang, Peoples R China
[3] Minist Agr & Rural Affairs, Key Lab Agr Internet Things, Beijing 712100, Peoples R China
[4] Shaanxi Key Lab Agr Informat Percept & Intelligen, Yangling 712100, Xianyang, Peoples R China
来源
PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2020, PT III | 2020年 / 12307卷
关键词
Unsupervised feature selection; Self-expression; Adaptive graph constraint; Maximum entropy;
D O I
10.1007/978-3-030-60636-7_16
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature selection usually takes unsupervised way to preprocess the data before clustering. In the unsupervised feature selection, the embedding based method can capture more discriminative information contained in data compared to the other methods. Considering many existing methods learn a cluster indicator matrix which may bring noise, and at the same time, these kinds of methods does not make good use of the geometry structure of the data. In order to address the existing problems, we propose a novel model based on joint self-expression model with adaptive graph constraint. The joint self-expression module is utilized to explore the relationship between features. Different from the conventional self-expression, our joint self-expression module contains two types self-expression, i.e., conventional self-expression and the convex non-negative matrix factorization (CNMF) which can extract more representative features. Furthermore, we introduce manifold learning to maintain the structural characteristics of the original data. Adaptive graph regularization term is also incorporated based on the principle of maximum entropy into our model. In order to solve the final model, an alternative algorithm is well designed. Finally, experiment is well designed on five benchmark datasets and the experimental results show that the model proposed in this paper is more effectiveness than the state-of-the-art comparison models.
引用
收藏
页码:185 / 196
页数:12
相关论文
共 21 条
[1]   Speeding up incremental wrapper feature subset selection with Naive Bayes classifier [J].
Bermejo, Pablo ;
Gamez, Jose A. ;
Puerta, Jose M. .
KNOWLEDGE-BASED SYSTEMS, 2014, 55 :140-147
[2]  
Cai Deng, 2010, P 16 ACM SIGKDD INT, P333, DOI DOI 10.1145/1835804.1835848
[3]   Exploiting Combination Effect for Unsupervised Feature Selection by l2,0 Norm [J].
Du, Xingzhong ;
Nie, Feiping ;
Wang, Weiqing ;
Yang, Yi ;
Zhou, Xiaofang .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (01) :201-214
[4]  
Duda R.O., 2012, PATTERN CLASSIFICATI
[5]  
Gu QQ, 2012, Arxiv, DOI [arXiv:1202.3725, DOI 10.48550/ARXIV.1202.3725]
[6]   A new graph-preserving unsupervised feature selection embedding LLE with low-rank constraint and feature-level representation [J].
Han, Xiaohong ;
Chai, Haishui ;
Liu, Ping ;
Li, Dengao ;
Wang, Li .
ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (04) :2875-2903
[7]  
He X., 2005, In Advances in Neural Information Processing Systems (NIPS), V18, DOI [10.5555/2976248.2976312, DOI 10.5555/2976248.2976312]
[8]   A new wrapper feature selection approach using neural network [J].
Kabir, Md Monirul ;
Islam, Md Monirul ;
Murase, Kazuyuki .
NEUROCOMPUTING, 2010, 73 (16-18) :3273-3283
[9]   Camera-Aware Multi-Resolution Analysis for Raw Image Sensor Data Compression [J].
Lee, Yeejin ;
Hirakawa, Keigo ;
Nguyen, Truong Q. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (06) :2806-2817
[10]   Discriminative and Uncorrelated Feature Selection With Constrained Spectral Analysis in Unsupervised Learning [J].
Li, Xuelong ;
Zhang, Han ;
Zhang, Rui ;
Nie, Feiping .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (01) :2139-2149