Spectral Clustering With Adaptive Neighbors for Deep Learning

被引:13
作者
Zhao, Yang [1 ,2 ]
Li, Xuelong [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Key Lab Intelligent Interact & Applicat, Minist Ind & Informat Technol, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Laplace equations; Clustering algorithms; Deep learning; Unsupervised learning; Complexity theory; Task analysis; Scalability; Anchor graph; neural networks; spectral clustering; unsupervised learning; LARGE-SCALE;
D O I
10.1109/TNNLS.2021.3105822
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spectral clustering is a well-known clustering algorithm for unsupervised learning, and its improved algorithms have been successfully adapted for many real-world applications. However, traditional spectral clustering algorithms are still facing many challenges to the task of unsupervised learning for large-scale datasets because of the complexity and cost of affinity matrix construction and the eigen-decomposition of the Laplacian matrix. From this perspective, we are looking forward to finding a more efficient and effective way by adaptive neighbor assignments for affinity matrix construction to address the above limitation of spectral clustering. It tries to learn an affinity matrix from the view of global data distribution. Meanwhile, we propose a deep learning framework with fully connected layers to learn a mapping function for the purpose of replacing the traditional eigen-decomposition of the Laplacian matrix. Extensive experimental results have illustrated the competitiveness of the proposed algorithm. It is significantly superior to the existing clustering algorithms in the experiments of both toy datasets and real-world datasets.
引用
收藏
页码:2068 / 2078
页数:11
相关论文
共 46 条
[1]   Spectral clustering via ensemble deep autoencoder learning (SC-EDAE) [J].
Affeldt, Severine ;
Labiod, Lazhar ;
Nadif, Mohamed .
PATTERN RECOGNITION, 2020, 108
[2]  
Bengio, 2011, P 28 INT C MACH LEAR, P833
[3]   Large Scale Spectral Clustering Via Landmark-Based Sparse Representation [J].
Cai, Deng ;
Chen, Xinlei .
IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (08) :1669-1680
[4]   LABIN: Balanced Min Cut for Large-Scale Data [J].
Chen, Xiaojun ;
Chen, Renjie ;
Wu, Qingyao ;
Fang, Yixiang ;
Nie, Feiping ;
Huang, Joshua Zhexue .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (03) :725-736
[5]   Improving Spectral Clustering with Deep Embedding and Cluster Estimation [J].
Duan, Liang ;
Aggarwal, Charu ;
Ma, Shuai ;
Sathe, Saket .
2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, :170-179
[6]   Spectral grouping using the Nystrom method [J].
Fowlkes, C ;
Belongie, S ;
Chung, F ;
Malik, J .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (02) :214-225
[7]   A dimensionality reduction method based on structured sparse representation for face recognition [J].
Gu, Guanghua ;
Hou, Zhichao ;
Chen, Chunxia ;
Zhao, Yao .
ARTIFICIAL INTELLIGENCE REVIEW, 2016, 46 (04) :431-443
[8]   NEW SPECTRAL METHODS FOR RATIO CUT PARTITIONING AND CLUSTERING [J].
HAGEN, L ;
KAHNG, AB .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 1992, 11 (09) :1074-1085
[9]   Fast Semisupervised Learning With Bipartite Graph for Large-Scale Data [J].
He, Fang ;
Nie, Feiping ;
Wang, Rong ;
Li, Xuelong ;
Jia, Weimin .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (02) :626-638
[10]   Ultra-Scalable Spectral Clustering and Ensemble Clustering [J].
Huang, Dong ;
Wang, Chang-Dong ;
Wu, Jian-Sheng ;
Lai, Jian-Huang ;
Kwoh, Chee-Keong .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2020, 32 (06) :1212-1226