Multi-View Kernel Spectral Clustering

被引:91
作者
Houthuys, Lynn [1 ]
Langone, Rocco [1 ]
Suykens, Johan A. K. [1 ]
机构
[1] Katholieke Univ Leuven, ESAT STADIUS, Dept Elect Engn, Kasteelpk Arenberg 10, B-3001 Leuven, Belgium
基金
欧洲研究理事会;
关键词
Multi-view learning; Clustering; Out-of-sample extension; Kernel CCA; ALGORITHM; FUSION;
D O I
10.1016/j.inffus.2017.12.002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In multi-view clustering, datasets are comprised of different representations of the data, or views. Although each view could individually be used, exploiting information from all views together could improve the cluster quality. In this paper a new model Multi-View Kernel Spectral Clustering (MVKSC) is proposed that performs clustering when two or more views are available. This model is formulated as a weighted kernel canonical correlation analysis in a primal-dual optimization setting typical of Least Squares Support Vector Machines (LSSVM). The primal model includes, in particular, a coupling term, which enforces the clustering scores corresponding to the different views to align. Because of the out-of-sample extension, this model is easily applied to large-scale datasets. The performance of the proposed model is shown on synthetic and real-world datasets, as well as on some large-scale datasets. Experimental comparisons with a number of other methods show that using multiple views improves the clustering results and that the proposed method is competitive with other state-ofthe-art algorithms in terms of clustering accuracy and runtime. Especially on the large-scale datasets the advantage of the proposed method is clearly shown, as it is able to handle larger datasets than the other state-ofthe-art algorithms.
引用
收藏
页码:46 / 56
页数:11
相关论文
共 44 条
[1]   Multiway Spectral Clustering with Out-of-Sample Extensions through Weighted Kernel PCA [J].
Alzate, Carlos ;
Suykens, Johan A. K. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (02) :335-347
[2]  
Amini M.-R., 2009, P 22 INT C NEURAL IN, V22, P28
[3]  
[Anonymous], 2013, Advances in Neural Information Processing Systems (NIPS)
[4]  
[Anonymous], 1997, Spectral Graph Theory
[5]   Kernel independent component analysis [J].
Bach, FR ;
Jordan, MI .
JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (01) :1-48
[6]   Multi-View Probabilistic Classification of Breast Microcalcifications [J].
Bekker, Alan Joseph ;
Shalhon, Moran ;
Greenspan, Hayit ;
Goldberger, Jacob .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (02) :645-653
[7]  
Bishop C.M., 1995, Neural networks for pattern recognition
[8]  
Blum A., 1998, Proceedings of the Eleventh Annual Conference on Computational Learning Theory, P92, DOI 10.1145/279943.279962
[9]  
Chaudhuri K., 2009, ICML, P129
[10]   When Does Cotraining Work in Real Data? [J].
Du, Jun ;
Ling, Charles X. ;
Zhou, Zhi-Hua .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2011, 23 (05) :788-799