Deep convolutional self-paced clustering

被引:14
作者
Chen, Rui [1 ,2 ]
Tang, Yongqiang [2 ]
Tian, Lei [2 ,3 ]
Zhang, Caixia [1 ]
Zhang, Wensheng [2 ,3 ]
机构
[1] Foshan Univ, Dept Automat, Foshan, Peoples R China
[2] Chinese Acad Sci, Inst Automat, Res Ctr Precis Sensing & Control, Beijing, Peoples R China
[3] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep clustering; Convolutional autoencoder; Local structure preservation; Self-paced learning; DIMENSIONALITY;
D O I
10.1007/s10489-021-02569-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Clustering is a crucial but challenging task in data mining and machine learning. Recently, deep clustering, which derives inspiration primarily from deep learning approaches, has achieved state-of-the-art performance in various applications and attracted considerable attention. Nevertheless, most of these approaches fail to effectively learn informative cluster-oriented features for data with spatial correlation structure, e.g., images. To tackle this problem, in this paper, we develop a deep convolutional self-paced clustering (DCSPC) method. Specifically, in the pretraining stage, we propose to utilize a convolutional autoencoder to extract a high-quality data representation that contains the spatial correlation information. Then, in the finetuning stage, a clustering loss is directly imposed on the learned features to jointly perform feature refinement and cluster assignment. We retain the decoder to avoid the feature space being distorted by the clustering loss. To stabilize the training process of the whole network, we further introduce a self-paced learning mechanism and select the most confident samples in each iteration. Through comprehensive experiments on seven popular image datasets, we demonstrate that the proposed algorithm can consistently outperform state-of-the-art rivals.
引用
收藏
页码:4858 / 4872
页数:15
相关论文
共 65 条
  • [1] [Anonymous], 2011, Advances in neural information processing systems
  • [2] Representation Learning: A Review and New Perspectives
    Bengio, Yoshua
    Courville, Aaron
    Vincent, Pascal
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) : 1798 - 1828
  • [3] Bishop C. M., 2006, PATTERN RECOGN
  • [4] Bo D, 2020, WEB C 2020 P WORLD
  • [5] Invariant Scattering Convolution Networks
    Bruna, Joan
    Mallat, Stephane
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) : 1872 - 1886
  • [6] Chang JL, 2017, IEEE I CONF COMP VIS, P5880, DOI [10.1109/ICCV.2017.626, 10.1109/ICCV.2017.627]
  • [7] [陈锐 Chen Rui], 2021, [模式识别与人工智能, Pattern Recognition and Artificial Intelligence], V34, P14
  • [8] Cox T.F., 2001, MULTIDIMENSIONAL SCA
  • [9] de Campos TE, 2009, VISAPP 2009: PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 2, P273
  • [10] Low-rank local tangent space embedding for subspace clustering
    Deng, Tingquan
    Ye, Dongsheng
    Ma, Rong
    Fujita, Hamido
    Xiong, Lvnan
    [J]. INFORMATION SCIENCES, 2020, 508 : 1 - 21