Enhancing generalized spectral clustering with embedding Laplacian graph regularization

被引:0
|
作者
Zhang, Hengmin [1 ]
Yang, Jian [2 ,3 ]
Zhang, Bob [4 ]
Tang, Yang [5 ,6 ]
Du, Wenli [5 ,6 ]
Wen, Bihan [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[2] Nanjing Univ Sci & Technol, PCA Lab, Nanjing, Peoples R China
[3] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens Inf, Minist Educ, Nanjing, Peoples R China
[4] Univ Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Peoples R China
[5] East China Univ Sci & Technol, Dept Automat, Minist Educ, Shanghai, Peoples R China
[6] East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Minist Educ, Shanghai, Peoples R China
基金
中国博士后科学基金;
关键词
clustering; graph theory; optimisation; LOW-RANK; SUBSPACE SEGMENTATION; VARIABLE SELECTION; ALGORITHM; NONCONVEX;
D O I
10.1049/cit2.12308
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An enhanced generalised spectral clustering framework that addresses the limitations of existing methods by incorporating the Laplacian graph and group effect into a regularisation term is presented. By doing so, the framework significantly enhances discrimination power and proves highly effective in handling noisy data. Its versatility enables its application to various clustering problems, making it a valuable contribution to unsupervised learning tasks. To optimise the proposed model, the authors have developed an efficient algorithm that utilises the standard Sylvester equation to compute the coefficient matrix. By setting the derivatives to zero, computational efficiency is maintained without compromising accuracy. Additionally, the authors have introduced smoothing strategies to make the non-convex and non-smooth terms differentiable. This enables the use of an alternative iteration re-weighted procedure (AIwRP), which distinguishes itself from other first-order optimisation algorithms by introducing auxiliary variables. The authors provide a provable convergence analysis of AIwRP based on the iteration procedures of unconstrained problems to support its effectiveness. Extensive numerical tests have been conducted on synthetic and benchmark databases to validate the superiority of their approaches. The results demonstrate improved clustering performance and computational efficiency compared to several existing spectral clustering methods, further reinforcing the advantages of their proposed framework. The source code is available at .
引用
收藏
页数:18
相关论文
共 50 条
  • [1] GLASS: A Graph Laplacian Autoencoder with Subspace Clustering Regularization for Graph Clustering
    Dengdi Sun
    Liang Liu
    Bin Luo
    Zhuanlian Ding
    Cognitive Computation, 2023, 15 : 803 - 821
  • [2] GLASS: A Graph Laplacian Autoencoder with Subspace Clustering Regularization for Graph Clustering
    Sun, Dengdi
    Liu, Liang
    Luo, Bin
    Ding, Zhuanlian
    COGNITIVE COMPUTATION, 2023, 15 (03) : 803 - 821
  • [3] Variational Graph Embedding and Clustering with Laplacian Eigenmaps
    Chen, Zitai
    Chen, Chuan
    Zhang, Zong
    Zheng, Zibin
    Zou, Qingsong
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 2144 - 2150
  • [4] Laplacian eigenmaps and spectral techniques for embedding and clustering
    Belkin, M
    Niyogi, P
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 14, VOLS 1 AND 2, 2002, 14 : 585 - 591
  • [5] Nonlinear Discriminative Embedding for Clustering via Spectral Regularization
    Zhan, Yubin
    Yin, Jianping
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT I: 15TH PACIFIC-ASIA CONFERENCE, PAKDD 2011, 2011, 6634 : 237 - 248
  • [6] Spectral embedding network for attributed graph clustering
    Zhang, Xiaotong
    Liu, Han
    Wu, Xiao-Ming
    Zhang, Xianchao
    Liu, Xinyue
    NEURAL NETWORKS, 2021, 142 : 388 - 396
  • [7] Enhancing framelet GCNs with generalized p-Laplacian regularization
    Shao, Zhiqi
    Shi, Dai
    Han, Andi
    Vasnev, Andrey
    Guo, Yi
    Gao, Junbin
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (04) : 1553 - 1573
  • [8] Enhancing framelet GCNs with generalized p-Laplacian regularization
    Zhiqi Shao
    Dai Shi
    Andi Han
    Andrey Vasnev
    Yi Guo
    Junbin Gao
    International Journal of Machine Learning and Cybernetics, 2024, 15 : 1553 - 1573
  • [9] Spectral Embedding Norm: Looking Deep into the Spectrum of the Graph Laplacian
    Cheng, Xiuyuan
    Mishne, Gal
    SIAM JOURNAL ON IMAGING SCIENCES, 2020, 13 (02): : 1015 - 1048
  • [10] Generalized Class Representative Computation with Graph Embedding and Clustering
    Aydos, Fahri
    Demirci, M. Fatih
    2015 23RD SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2015, : 2525 - 2528