Adaptive Graph Fusion for Unsupervised Feature Selection

被引:0
作者
Niu, Sijia [1 ]
Zhu, Pengfei [1 ]
Hu, Qinghua [1 ]
Shi, Hong [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
来源
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: DEEP LEARNING, PT II | 2019年 / 11728卷
关键词
Graph fusion; Unsupervised feature selection; Self-representation; ROBUST;
D O I
10.1007/978-3-030-30484-3_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The massive high-dimensional data brings about great time complexity, high storage burden and poor generalization ability of learning models. Feature selection can alleviate curse of dimensionality by selecting a subset of features. Unsupervised feature selection is much challenging due to lack of label information. Most methods rely on spectral clustering to generate pseudo labels to guide feature selection in unsupervised setting. Graphs for spectral clustering can be constructed in different ways, e.g., kernel similarity, or self-representation. The construction of adjacency graphs could be affected by the parameters of kernel functions, the number of nearest neighbors or the size of the neighborhood. However, it is difficult to evaluate the effectiveness of different graphs in unsupervised feature selection. Most existing algorithms only select one graph by experience. In this paper, we propose a novel adaptive multi-graph fusion based unsupervised feature selection model (GFFS). The proposed model is free of graph selection and can combine the complementary information of different graphs. Experiments on benchmark datasets show that GFFS outperforms the state-of-the-art unsupervised feature selection algorithms.
引用
收藏
页码:3 / 15
页数:13
相关论文
共 29 条
[1]  
[Anonymous], 2012, P 18 ACM SIGKDD INT
[2]   Efficient Semi-Supervised Feature Selection: Constraint, Relevance, and Redundancy [J].
Benabdeslem, Khalid ;
Hindawi, Mohammed .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (05) :1131-1143
[3]   Document clustering using locality preserving indexing [J].
Cai, D ;
He, XF ;
Han, JW .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (12) :1624-1637
[4]  
Cai D., 2010, P 16 ACM SIGKDD INT, P333, DOI [10.1145/1835804.1835848, DOI 10.1145/1835804.1835848]
[5]   Unsupervised feature selection applied to content-based retrieval of lung images [J].
Dy, JG ;
Brodley, CE ;
Kak, A ;
Broderick, LS ;
Aisen, AM .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2003, 25 (03) :373-378
[6]  
Elhamifar Ehsan, 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), P2790, DOI 10.1109/CVPRW.2009.5206547
[7]   Graph-oriented Learning via Automatic Group Sparsity for Data Analysis [J].
Fang, Yuqiang ;
Wang, Ruili ;
Dai, Bin .
12TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2012), 2012, :251-259
[8]  
Guyon I., 2020, J MACH LEARN RES, V3, P1157, DOI [DOI 10.1162/153244303322753616, 10.1162/153244303322753616]
[9]   Face recognition using Laplacianfaces [J].
He, XF ;
Yan, SC ;
Hu, YX ;
Niyogi, P ;
Zhang, HJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27 (03) :328-340
[10]  
He Xiaofei, 2006, Adv. Neural Inf. Process. Syst., P507