Global discriminative-based nonnegative spectral clustering

被引:72
作者
Shang, Ronghua [1 ]
Zhang, Zhu [1 ]
Jiao, Licheng [1 ]
Wang, Wenbing [1 ]
Yang, Shuyuan [1 ]
机构
[1] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Spectral clustering; Nonnegative matrix factorization (NMF); Global discrimination information; MATRIX FACTORIZATION; FISHER DISCRIMINANT; KERNEL; EFFICIENT; ALGORITHM; PARTS;
D O I
10.1016/j.patcog.2016.01.035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Based on spectral graph theory, spectral clustering is an optimal graph partition problem. It has been proven that the spectral clustering is equivalent to nonnegative matrix factorization (NMF) under certain conditions. Based on the equivalence, some spectral clustering methods are proposed, but the global discriminative information of the dataset is neglected. In this paper, based on the equivalence between spectral clustering and NMF, we simultaneously maximize the between-class scatter matrix and minimize the within-class scatter matrix to enhance the discriminating power. We integrate the geometrical structure and discriminative structure in a joint framework. With a global discriminative regularization term added into the nonnegative matrix factorization framework, we propose two novel spectral clustering methods, named global discriminative-based nonnegative and spectral clustering (GDBNSC-Ncut and GDBNSC-Rcut) These new spectral clustering algorithms can preserve both the global geometrical structure and global discriminative structure. The intrinsic geometrical information of the dataset is detected, and clustering quality is improved with enhanced discriminating power. In addition, the proposed algorithms also have very good abilities of handling out-of-sample data. Experimental results on real word data demonstrate that the proposed algorithms outperform some state-of-the-art methods with good clustering qualities. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:172 / 182
页数:11
相关论文
共 52 条
[1]  
[Anonymous], P SIAM DAT MIN C
[2]  
[Anonymous], 1998, COMBINATORIAL OPTIMI
[3]   AN ALGORITHM FOR PARTITIONING THE NODES OF A GRAPH [J].
BARNES, ER .
SIAM JOURNAL ON ALGEBRAIC AND DISCRETE METHODS, 1982, 3 (04) :541-550
[4]   Generalized discriminant analysis using a kernel approach [J].
Baudat, G ;
Anouar, FE .
NEURAL COMPUTATION, 2000, 12 (10) :2385-2404
[5]   RECOGNITION-BY-COMPONENTS - A THEORY OF HUMAN IMAGE UNDERSTANDING [J].
BIEDERMAN, I .
PSYCHOLOGICAL REVIEW, 1987, 94 (02) :115-147
[6]   Graph Regularized Nonnegative Matrix Factorization for Data Representation [J].
Cai, Deng ;
He, Xiaofei ;
Han, Jiawei ;
Huang, Thomas S. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (08) :1548-1560
[7]   Non-negative Matrix Factorization on Manifold [J].
Cai, Deng ;
He, Xiaofei ;
Wu, Xiaoyun ;
Han, Jiawei .
ICDM 2008: EIGHTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2008, :63-+
[8]   SPECTRAL K-WAY RATIO-CUT PARTITIONING AND CLUSTERING [J].
CHAN, PK ;
SCHLAG, MDF ;
ZIEN, JY .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 1994, 13 (09) :1088-1096
[9]  
De la Torre Fernando, 2006, ACM Proc. of ICML, P241, DOI DOI 10.1145/1143844.1143875
[10]  
Ding C., 2006, P NAT C ART INT