Unsupervised feature analysis with sparse adaptive learning

被引:10
作者
Wang, Xiao-dong [1 ,2 ]
Chen, Rung-Ching [2 ]
Hong, Chao-qun [1 ]
Zeng, Zhi-qiang [1 ]
机构
[1] Xiamen Univ Technol, Coll Comp & Informat Engn, Xiamen 361024, Peoples R China
[2] Chaoyang Univ Technol, Dept Informat Management, Taichung 41349, Taiwan
关键词
Unsupervised learning; Feature selection; Adaptive structure learning; l(2)-Norm; FEATURE-SELECTION;
D O I
10.1016/j.patrec.2017.12.022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised feature learning has played an important role in machine learning due to its ability to save human labor cost. Since the absence of labels in such scenario, a commonly used approach is to select features according to the similarity matrix derived from the original feature space. However, their similarity matrices suffer from noises and redundant features, with which are frequently confronted in high-dimensional data. In this paper, we propose a novel unsupervised feature selection algorithm. Compared with the previous works, there are mainly two merits of the proposed algorithm: (1) The similarity matrix is adaptively adjusted with a comprehensive strategy to fully utilize the information in the projected data and the original data. (2) To guarantee the clarity of the dramatically learned manifold structure, a non-squared l(2)-norm based sparsity method is imposed into the objective function. The proposed objective function involves several non-smooth constraints, making it difficult to solve. We also design an efficient iterative algorithm to optimize it. Experimental results demonstrate the effectiveness of our algorithm compared with the state-of-the-art algorithms on several kinds of publicly available datasets. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:89 / 94
页数:6
相关论文
共 26 条
[1]   Feature selection via binary simultaneous perturbation stochastic approximation. [J].
Aksakalli, Vural ;
Malekipirbazari, Milad .
PATTERN RECOGNITION LETTERS, 2016, 75 :41-47
[2]  
[Anonymous], 2011, IJCAI INT JOINT C AR
[3]  
Cai D, 2010, P 16 ACM SIGKDD INT, P333, DOI DOI 10.1145/1835804.1835848
[4]   Semisupervised Feature Analysis by Mining Correlations Among Multiple Tasks [J].
Chang, Xiaojun ;
Yang, Yi .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (10) :2294-2305
[5]   Unsupervised Feature Selection with Adaptive Structure Learning [J].
Du, Liang ;
Shen, Yi-Dong .
KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, :209-218
[7]  
He X., 2006, P ADV NEURAL INFORM, P507
[8]   Trace Ratio Problem Revisited [J].
Jia, Yangqing ;
Nie, Feiping ;
Zhang, Changshui .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (04) :729-735
[9]  
Li Z., 2012, P AAAI C ART INT
[10]   Discriminating Joint Feature Analysis for Multimedia Data Understanding [J].
Ma, Zhigang ;
Nie, Feiping ;
Yang, Yi ;
Uijlings, Jasper R. R. ;
Sebe, Nicu ;
Hauptmann, Alexander G. .
IEEE TRANSACTIONS ON MULTIMEDIA, 2012, 14 (06) :1662-1672