Self-Constrained Spectral Clustering

被引:21
作者
Bai, Liang [1 ]
Liang, Jiye [1 ]
Zhao, Yunxiao [1 ]
机构
[1] Shanxi Univ, Sch Comp & Informat Technol, Taiyuan 030006, Shanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Clustering algorithms; Optimization; Linear programming; Kernel; Computational efficiency; Neural networks; Deep learning; Label constraints; optimization model; pairwise constraints; self-constrained clustering; spectral clustering; CUTS;
D O I
10.1109/TPAMI.2022.3188160
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a leading graph clustering technique, spectral clustering is one of the most widely used clustering methods to capture complex clusters in data. Some additional prior information can help it to further reduce the difference between its clustering results and users' expectations. However, it is hard to get the prior information under unsupervised scene to guide the clustering process. To solve this problem, we propose a self-constrained spectral clustering algorithm. In this algorithm, we extend the objective function of spectral clustering by adding pairwise and label self-constrained terms to it. We provide the theoretical analysis to show the roles of the self-constrained terms and the extensibility of the proposed algorithm. Based on the new objective function, we build an optimization model for self-constrained spectral clustering so that we can simultaneously learn the clustering results and constraints. Furthermore, we propose an iterative method to solve the new optimization problem. Compared to other existing versions of spectral clustering algorithms, the new algorithm can discover a high-quality cluster structure of a data set without prior information. Extensive experiments on benchmark data sets illustrate the effectiveness of the proposed algorithm.
引用
收藏
页码:5126 / 5138
页数:13
相关论文
共 41 条
[1]  
Aggarwal CC, 2014, CH CRC DATA MIN KNOW, P1
[2]  
Bai L, 2020, AAAI CONF ARTIF INTE, V34, P3211
[3]   Semi-Supervised Clustering With Constraints of Different Types From Multiple Information Sources [J].
Bai, Liang ;
Liang, JiYe ;
Cao, Fuyuan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (09) :3247-3258
[4]   2 ALGORITHMS FOR COMPUTING REGULAR EQUIVALENCE [J].
BORGATTI, SP ;
EVERETT, MG .
SOCIAL NETWORKS, 1993, 15 (04) :361-376
[5]   Large Scale Spectral Clustering Via Landmark-Based Sparse Representation [J].
Cai, Deng ;
Chen, Xinlei .
IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (08) :1669-1680
[6]   Deep Self-Evolution Clustering [J].
Chang, Jianlong ;
Meng, Gaofeng ;
Wang, Lingfeng ;
Xiang, Shiming ;
Pan, Chunhong .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (04) :809-823
[7]   Parallel Spectral Clustering in Distributed Systems [J].
Chen, Wen-Yen ;
Song, Yangqiu ;
Bai, Hongjie ;
Lin, Chih-Jen ;
Chang, Edward Y. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (03) :568-586
[8]  
Dhillon IS, 2007, IEEE T PATTERN ANAL, V29, P1944, DOI [10.1109/TPAMI.2007.1115, 10.1109/TP'AMI.2007.1115]
[9]  
Elhamifar Ehsan, 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), P2790, DOI 10.1109/CVPRW.2009.5206547
[10]   Spectral grouping using the Nystrom method [J].
Fowlkes, C ;
Belongie, S ;
Chung, F ;
Malik, J .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (02) :214-225