From Ensemble Clustering to Subspace Clustering: Cluster Structure Encoding

被引:23
|
作者
Tao, Zhiqiang [1 ]
Li, Jun [2 ]
Fu, Huazhu [3 ]
Kong, Yu [4 ]
Fu, Yun [5 ,6 ]
机构
[1] Santa Clara Univ, Dept Comp Sci & Engn, Santa Clara, CA 95053 USA
[2] MIT, Inst Med Engn & Sci, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[3] ASTAR, Inst High Performance Comp IHPC, Singapore 138632, Singapore
[4] Rochester Inst Technol, B Thomas Golisano Coll Comp & Informat Sci, Rochester, NY 14623 USA
[5] Northeastern Univ, Dept Elect & Comp Engn, Boston, MA 02115 USA
[6] Northeastern Univ, Khoury Coll Comp & Informat Sci, Boston, MA 02115 USA
关键词
Encoding; Codes; Clustering algorithms; Predictive coding; Optimization; Training; Sparse matrices; Encoder network; ensemble clustering (EC); higher order relationship; subspace clustering (SC); SPARSE; ALGORITHM; CONSENSUS;
D O I
10.1109/TNNLS.2021.3107354
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this study, we propose a novel algorithm to encode the cluster structure by incorporating ensemble clustering (EC) into subspace clustering (SC). First, the low-rank representation (LRR) is learned from a higher order data relationship induced by ensemble K-means coding, which exploits the cluster structure in a co-association matrix of basic partitions (i.e., clustering results). Second, to provide a fast predictive coding mechanism, an encoding function parameterized by neural networks is introduced to predict the LRR derived from partitions. These two steps are jointly proceeded to seamlessly integrate partition information and original features and thus deliver better representations than the ones obtained from each single source. Moreover, an alternating optimization framework is developed to learn the LRR, train the encoding function, and fine-tune the higher order relationship. Extensive experiments on eight benchmark datasets validate the effectiveness of the proposed algorithm on several clustering tasks compared with state-of-the-art EC and SC methods.
引用
收藏
页码:2670 / 2681
页数:12
相关论文
共 50 条
  • [1] The Core Cluster-Based Subspace Weighted Clustering Ensemble
    Huang, Xuan
    Qin, Fang
    Lin, Lin
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [2] Subspace Structure-aware Spectral Clustering for Robust Subspace Clustering
    Yamaguchi, Masataka
    Irie, Go
    Kawanishi, Takahito
    Kashino, Kunio
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9874 - 9883
  • [3] Subspace Selective Ensemble Algorithm Based on Feature Clustering
    Tao, Hui
    Ma, Xiao-ping
    Qiao, Mei-ying
    JOURNAL OF COMPUTERS, 2013, 8 (02) : 509 - 516
  • [4] SOFT SUBSPACE CLUSTERING ENSEMBLE BASED ON HEDONIC GAMES
    Li, Man
    Wang, Lihong
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2021, 17 (04): : 1327 - 1343
  • [5] From clustering to clustering ensemble selection: A review
    Golalipour, Keyvan
    Akbari, Ebrahim
    Hamidi, Seyed Saeed
    Lee, Malrey
    Enayatifar, Rasul
    Lee, Malrey (mrlee@jbnu.ac.kr), 1600, Elsevier Ltd (104):
  • [6] Subspace Clustering for High-Dimensional Data Using Cluster Structure Similarity
    Fatehi, Kavan
    Rezvani, Mohsen
    Fateh, Mansoor
    Pajoohan, Mohammad-Reza
    INTERNATIONAL JOURNAL OF INTELLIGENT INFORMATION TECHNOLOGIES, 2018, 14 (03) : 38 - 55
  • [7] Structure-Aware Subspace Clustering
    Kou, Simin
    Yin, Xuesong
    Wang, Yigang
    Chen, Songcan
    Chen, Tieming
    Wu, Zizhao
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (10) : 10569 - 10582
  • [8] Fuzzy clustering ensemble considering cluster dependability
    School of Information Engineering, China University of Geosciences , Beijing, China
    不详
    不详
    不详
    不详
    不详
    不详
    Int. J. on Artif. Intell. Tools, 2021, 2
  • [9] Fair Clustering Ensemble With Equal Cluster Capacity
    Zhou, Peng
    Li, Rongwen
    Ling, Zhaolong
    Du, Liang
    Liu, Xinwang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (03) : 1729 - 1746
  • [10] Clustering Categorical Data:A Cluster Ensemble Approach
    何增友
    High Technology Letters, 2003, (04) : 8 - 12