Deep convolutional self-paced clustering

被引:0
|
作者
Rui Chen
Yongqiang Tang
Lei Tian
Caixia Zhang
Wensheng Zhang
机构
[1] Foshan University,Department of Automation
[2] Chinese Academy of Sciences,Research Center of Precision Sensing and Control, Institute of Automation
[3] University of Chinese Academy of Sciences,School of Artificial Intelligence
来源
Applied Intelligence | 2022年 / 52卷
关键词
Deep clustering; Convolutional autoencoder; Local structure preservation; Self-paced learning;
D O I
暂无
中图分类号
学科分类号
摘要
Clustering is a crucial but challenging task in data mining and machine learning. Recently, deep clustering, which derives inspiration primarily from deep learning approaches, has achieved state-of-the-art performance in various applications and attracted considerable attention. Nevertheless, most of these approaches fail to effectively learn informative cluster-oriented features for data with spatial correlation structure, e.g., images. To tackle this problem, in this paper, we develop a deep convolutional self-paced clustering (DCSPC) method. Specifically, in the pretraining stage, we propose to utilize a convolutional autoencoder to extract a high-quality data representation that contains the spatial correlation information. Then, in the finetuning stage, a clustering loss is directly imposed on the learned features to jointly perform feature refinement and cluster assignment. We retain the decoder to avoid the feature space being distorted by the clustering loss. To stabilize the training process of the whole network, we further introduce a self-paced learning mechanism and select the most confident samples in each iteration. Through comprehensive experiments on seven popular image datasets, we demonstrate that the proposed algorithm can consistently outperform state-of-the-art rivals.
引用
收藏
页码:4858 / 4872
页数:14
相关论文
共 50 条
  • [31] Self-paced Learning for Imbalanced Data
    Zieba, Maciej
    Tomczak, Jakub M.
    Swiatek, Jerzy
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS, ACIIDS 2016, PT I, 2016, 9621 : 564 - 573
  • [32] Self-paced annotations of crowd workers
    Kang, Xiangping
    Yu, Guoxian
    Domeniconi, Carlotta
    Wang, Jun
    Guo, Wei
    Ren, Yazhou
    Zhang, Xiayan
    Cui, Lizhen
    KNOWLEDGE AND INFORMATION SYSTEMS, 2022, 64 (12) : 3235 - 3263
  • [33] Mixture Self-paced Learning for Multi-view K-means Clustering
    Yu, Hong
    Lian, Yahong
    Xu, Xiujuan
    Zhao, Xiaowei
    2017 IEEE 15TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 15TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 3RD INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS(DASC/PICOM/DATACOM/CYBERSCI, 2017, : 1210 - 1215
  • [34] Self-Paced Multi-View Clustering via a Novel Soft Weighted Regularizer
    Huang, Zongmo
    Ren, Yazhou
    Liu, Wenli
    Pu, Xiaorong
    IEEE ACCESS, 2019, 7 : 168629 - 168636
  • [35] Tensor Multi-Elastic Kernel Self-Paced Learning for Time Series Clustering
    Tang, Yongqiang
    Xie, Yuan
    Yang, Xuebing
    Niu, Jinghao
    Zhang, Wensheng
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (03) : 1223 - 1237
  • [36] Self-paced active learning for deep CNNs via effective loss function
    Yin, Tianxiang
    Liu, Ningzhong
    Sun, Han
    NEUROCOMPUTING, 2021, 424 (424) : 1 - 8
  • [37] MATHEMATICA BASED PLATFORM FOR SELF-PACED LEARNING
    Zinder, Y.
    Nicorovici, N.
    Langtry, T.
    EDULEARN10: INTERNATIONAL CONFERENCE ON EDUCATION AND NEW LEARNING TECHNOLOGIES, 2010, : 323 - 330
  • [38] Self-paced contrastive learning for knowledge tracing
    Dai, Huan
    Yun, Yue
    Zhang, Yupei
    An, Rui
    Zhang, Wenxin
    Shang, Xuequn
    NEUROCOMPUTING, 2024, 609
  • [39] Self-Paced Learning with Statistics Uncertainty Prior
    Guo, Lihua
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (03) : 812 - 816
  • [40] Self-paced hierarchical metric learning (SPHML)
    Mohammed Al-taezi
    Pengfei Zhu
    Qinghua Hu
    Yu Wang
    Abdulrahman Al-badwi
    International Journal of Machine Learning and Cybernetics, 2021, 12 : 2529 - 2541