GoMIC: Multi-view image clustering via self-supervised contrastive heterogeneous graph co-learning

被引:0
|
作者
Uno Fang
Jianxin Li
Naveed Akhtar
Man Li
Yan Jia
机构
[1] Deakin University,School of IT
[2] The University of Western Australia,School of Physics, Mathematics and Computing
[3] Harbin Institute of Technology,Department of Computer Science and Technology
来源
World Wide Web | 2023年 / 26卷
关键词
Multi-view clustering; Contrastive graph learning; Feature propagation; Heterogeneous graph learning;
D O I
暂无
中图分类号
学科分类号
摘要
Graph learning is being increasingly applied to image clustering to reveal intra-class and inter-class relationships in data. However, existing graph learning-based image clustering focuses on grouping images under a single view, which under-utilises the information provided by the data. To address that, we propose a self-supervised multi-view image clustering technique under contrastive heterogeneous graph learning. Our method computes a heterogeneous affinity graph for multi-view image data. It conducts Local Feature Propagation (LFP) for reasoning over the local neighbourhood of each node and executes an Influence-aware Feature Propagation (IFP) from each node to its influential node for learning the clustering intention. The proposed framework pioneeringly employs two contrastive objectives. The first targets to contrast and fuse multiple views for the overall LFP embedding, and the second maximises the mutual information between LFP and IFP representations. We conduct extensive experiments on the benchmark datasets for the problem, i.e. COIL-20, Caltech7 and CASIA-WebFace. Our evaluation shows that our method outperforms the state-of-the-art methods, including the popular techniques MVGL, MCGC and HeCo.
引用
收藏
页码:1667 / 1683
页数:16
相关论文
共 50 条
  • [1] GoMIC: Multi-view image clustering via self-supervised contrastive heterogeneous graph co-learning
    Fang, Uno
    Li, Jianxin
    Akhtar, Naveed
    Li, Man
    Jia, Yan
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (04): : 1667 - 1683
  • [2] Multi-view Self-supervised Heterogeneous Graph Embedding
    Zhao, Jianan
    Wen, Qianlong
    Sun, Shiyu
    Ye, Yanfang
    Zhang, Chuxu
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2021: RESEARCH TRACK, PT II, 2021, 12976 : 319 - 334
  • [3] Self-Supervised Graph Convolutional Network for Multi-View Clustering
    Xia, Wei
    Wang, Qianqian
    Gao, Quanxue
    Zhang, Xiangdong
    Gao, Xinbo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 24 : 3182 - 3192
  • [4] Self-Supervised Graph Completion for Incomplete Multi-View Clustering
    Liu, Cheng
    Wu, Si
    Li, Rui
    Jiang, Dazhi
    Wong, Hau-San
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (09) : 9394 - 9406
  • [5] Self-supervised Multi-view Clustering for Unsupervised Image Segmentation
    Fang, Tiyu
    Liang, Zhen
    Shao, Xiuli
    Dong, Zihao
    Li, Jinping
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2021, PT V, 2021, 12895 : 113 - 125
  • [6] Partial Multi-View Clustering via Self-Supervised Network
    Feng, Wei
    Sheng, Guoshuai
    Wang, Qianqian
    Gao, Quanxue
    Tao, Zhiqiang
    Dong, Bo
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 11, 2024, : 11988 - 11995
  • [7] Heterogeneous Graph Contrastive Multi-view Learning
    Wang, Zehong
    Li, Qi
    Yu, Donghua
    Han, Xiaolong
    Gao, Xiao-Zhi
    Shen, Shigen
    PROCEEDINGS OF THE 2023 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2023, : 136 - 144
  • [8] Multi-view self-supervised learning on heterogeneous graphs for recommendation
    Zhang, Yunjia
    Zhang, Yihao
    Liao, Weiwen
    Li, Xiaokang
    Wang, Xibin
    APPLIED SOFT COMPUTING, 2025, 174
  • [9] Sleep Stage Classification Via Multi-View Based Self-Supervised Contrastive Learning of EEG
    Zhao, Chen
    Wu, Wei
    Zhang, Haoyi
    Zhang, Ruiyan
    Zheng, Xinyue
    Kong, Xiangzeng
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (12) : 7068 - 7077
  • [10] Self-Supervised Discriminative Feature Learning for Deep Multi-View Clustering
    Xu, Jie
    Ren, Yazhou
    Tang, Huayi
    Yang, Zhimeng
    Pan, Lili
    Yang, Yang
    Pu, Xiaorong
    Yu, Philip S.
    He, Lifang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (07) : 7470 - 7482