Unsupervised Embedding Learning With Mutual-Information Graph Convolutional Networks

被引:2
|
作者
Zhang, Lin [1 ]
Zhang, Mingxin [1 ]
Song, Ran [1 ]
Zhao, Ziying [2 ]
Li, Xiaolei [1 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250012, Shandong, Peoples R China
[2] Sun Yat Sen Univ, Sch Engn & Comp Sci, Guangzhou 510275, Peoples R China
基金
中国国家自然科学基金;
关键词
Unsupervised learning; image retrieval; embedding learning; graph neural network; mutual information;
D O I
10.1109/TMM.2022.3200852
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, methods for unsupervised embedding learning have exhibited promising results for extracting desirable representations from unlabeled samples. In general, most methods learn the feature embeddings by handling each sample individually while the structural and semantic relationships between samples are not fully exploited. As a result, the learned embeddings are not sufficiently discriminative. To make use of such inter-sample information for deep embedding learning, this paper proposes an unsupervised method based on the graph convolutional network (GCN). On one hand, our method encodes structural information between the samples corresponding to the nodes in a local neighbourhood of the GCN graph. On the other hand, it leverages the mutual information between the original samples and the augmented ones to ensure that they are globally consistent with each other. Extensive experiments show that our method is not just robust to augmentation perturbations, but also learns discriminative embeddings. Consequently, it achieves the state-of-the-art performance on several challenging datasets.
引用
收藏
页码:5916 / 5926
页数:11
相关论文
共 50 条
  • [1] Heterogeneous Information Network Embedding with Convolutional Graph Attention Networks
    Cao, Meng
    Ma, Xiying
    Zhu, Kai
    Xu, Ming
    Wang, Chongjun
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [2] Deep convolutional adversarial graph autoencoder using positive pointwise mutual information for graph embedding
    马秀慧
    WANG Rong
    CHEN Shudong
    DU Rong
    ZHU Danyang
    ZHAO Hua
    High Technology Letters, 2022, 28 (01) : 98 - 106
  • [3] Deep convolutional adversarial graph autoencoder using positive pointwise mutual information for graph embedding
    Ma X.
    Wang R.
    Chen S.
    Du R.
    Zhu D.
    Zhao H.
    High Technology Letters, 2022, 28 (01) : 98 - 106
  • [4] Cognitive Relay Networks with Energy and Mutual-Information Accumulation
    Atat, Rachad
    Ma, Junchao
    Chen, Hao
    Lee, Ulysses
    Ashdown, Jonathan
    Liu, Lingjia
    IEEE INFOCOM 2018 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2018, : 640 - 644
  • [5] Facial Animation Retargeting by Unsupervised Learning of Graph Convolutional Networks
    Dou, Yuhao
    Mukai, Tomohiko
    2024 NICOGRAPH INTERNATIONAL, NICOINT 2024, 2024, : 69 - 75
  • [6] Recalibration convolutional networks for learning interaction knowledge graph embedding
    Li, Zhifei
    Liu, Hai
    Zhang, Zhaoli
    Liu, Tingting
    Shu, Jiangbo
    NEUROCOMPUTING, 2021, 427 : 118 - 130
  • [7] Routing in cooperative wireless networks with mutual-information accumulation
    Draper, Stark C.
    Liu, Lingjia
    Molisch, Andreas F.
    Yedidia, Jonathan S.
    2008 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, PROCEEDINGS, VOLS 1-13, 2008, : 4272 - +
  • [8] Graph Convolutional Networks Embedding Textual Structure Information for Relation Extraction
    Wei, Chuyuan
    Li, Jinzhe
    Wang, Zhiyuan
    Wan, Shanshan
    Guo, Maozu
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 79 (02): : 3299 - 3314
  • [9] Mutual teaching for graph convolutional networks
    Zhan, Kun
    Niu, Chaoxi
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 115 : 837 - 843
  • [10] Unsupervised Graph Embedding via Adaptive Graph Learning
    Zhang, Rui
    Zhang, Yunxing
    Lu, Chengjun
    Li, Xuelong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 5329 - 5336