Unsupervised Embedding Learning With Mutual-Information Graph Convolutional Networks

被引:2
|
作者
Zhang, Lin [1 ]
Zhang, Mingxin [1 ]
Song, Ran [1 ]
Zhao, Ziying [2 ]
Li, Xiaolei [1 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250012, Shandong, Peoples R China
[2] Sun Yat Sen Univ, Sch Engn & Comp Sci, Guangzhou 510275, Peoples R China
基金
中国国家自然科学基金;
关键词
Unsupervised learning; image retrieval; embedding learning; graph neural network; mutual information;
D O I
10.1109/TMM.2022.3200852
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, methods for unsupervised embedding learning have exhibited promising results for extracting desirable representations from unlabeled samples. In general, most methods learn the feature embeddings by handling each sample individually while the structural and semantic relationships between samples are not fully exploited. As a result, the learned embeddings are not sufficiently discriminative. To make use of such inter-sample information for deep embedding learning, this paper proposes an unsupervised method based on the graph convolutional network (GCN). On one hand, our method encodes structural information between the samples corresponding to the nodes in a local neighbourhood of the GCN graph. On the other hand, it leverages the mutual information between the original samples and the augmented ones to ensure that they are globally consistent with each other. Extensive experiments show that our method is not just robust to augmentation perturbations, but also learns discriminative embeddings. Consequently, it achieves the state-of-the-art performance on several challenging datasets.
引用
收藏
页码:5916 / 5926
页数:11
相关论文
共 50 条
  • [21] Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learning
    Park, Jiwoong
    Lee, Minsik
    Chang, Hyung Jin
    Lee, Kyuewang
    Choi, Jin Young
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6518 - 6527
  • [22] Bipartite Graph Embedding via Mutual Information Maximization
    Cao, Jiangxia
    Lin, Xixun
    Guo, Shu
    Liu, Luchen
    Liu, Tingwen
    Wang, Bin
    WSDM '21: PROCEEDINGS OF THE 14TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2021, : 635 - 643
  • [23] Continuous sampling in mutual-information registration
    Seppa, Mika
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (05) : 823 - 826
  • [24] Unsupervised Author Disambiguation using Heterogeneous Graph Convolutional Network Embedding
    Qiao, Ziyue
    Du, Yi
    Fu, Yanjie
    Wang, Pengfei
    Zhou, Yuanchun
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 910 - 919
  • [25] Cooperative Routing for Underlay Cognitive Radio Networks Using Mutual-Information Accumulation
    Chen, Hao
    Liu, Lingjia
    Matyjas, John D.
    Medley, Michael J.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2015, 14 (12) : 7110 - 7122
  • [26] Generalized Mutual-Information Based Independence Tests
    Keziou, Amor
    Regnault, Philippe
    GEOMETRIC SCIENCE OF INFORMATION, GSI 2015, 2015, 9389 : 454 - 463
  • [27] Unsupervised Do am Adaptive Graph Convolutional Networks
    Wu, Man
    Pan, Shirui
    Zhou, Chuan
    Chang, Xiaojun
    Zhu, Xingquan
    WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, : 1457 - 1467
  • [28] Contrastive Graph Learning with Graph Convolutional Networks
    Nagendar, G.
    Sitaram, Ramachandrula
    DOCUMENT ANALYSIS SYSTEMS, DAS 2022, 2022, 13237 : 96 - 110
  • [29] Automatic Virtual Network Embedding: A Deep Reinforcement Learning Approach With Graph Convolutional Networks
    Yan, Zhongxia
    Ge, Jingguo
    Wu, Yulei
    Li, Liangxiong
    Li, Tong
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (06) : 1040 - 1057
  • [30] Heterogeneous Attributed Network Embedding with Graph Convolutional Networks
    Wang, Yueyang
    Duan, Ziheng
    Liao, Binbing
    Wu, Fei
    Zhuang, Yueting
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 10061 - 10062