GMNI: Achieve good data augmentation in unsupervised graph contrastive learning

被引:0
|
作者
Xiong, Xin [1 ]
Wang, Xiangyu [1 ]
Yang, Suorong [1 ]
Shen, Furao [1 ]
Zhao, Jian [2 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[2] Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural network; Graph contrastive learning; Data augmentation;
D O I
10.1016/j.neunet.2024.106804
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning (GCL) shows excellent potential in unsupervised graph representation learning. Data augmentation (DA), responsible for generating diverse views, plays a vital role in GCL, and its optimal choice heavily depends on the downstream task. However, it is impossible to measure task-relevant information under an unsupervised setting. Therefore, many GCL methods risk insufficient information by failing to preserve essential information necessary for the downstream task or risk encoding redundant information. In this paper, we propose a novel method called Minimal Noteworthy Information for unsupervised Graph contrastive learning (GMNI), featuring automated DA. It achieves good DA by balancing missing and excessive information, approximating the optimal views in contrastive learning. We employ an adversarial training strategy to generate views that share minimal noteworthy information (MNI), reducing nuisance information by minimization optimization and ensuring sufficient information by emphasizing noteworthy information. Besides, we introduce randomness based on MNI to augmentation, thereby enhancing view diversity and stabilizing the model against perturbations. Extensive experiments on unsupervised and semi-supervised learning over 14 datasets demonstrate the superiority of GMNI over GCL methods with automated and manual DA. GMNI achieves up to a 1.64% improvement over the state-of-the-art in unsupervised node classification, up to a 1.97% improvement in unsupervised graph classification, and up to a 3.57% improvement in semi-supervised graph classification.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Unsupervised Anomaly Detection on Attributed Networks With Graph Contrastive Learning for Consumer Electronics Security
    Xu, Bo
    Wang, Jinpeng
    Zhao, Zhehuan
    Lin, Hongfei
    Xia, Feng
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (01) : 4062 - 4072
  • [42] Learning to solve graph metric dimension problem based on graph contrastive learning
    Jian Wu
    Li Wang
    Weihua Yang
    Haixia Zhao
    Rui Wang
    Jianji Cao
    Fuhong Wei
    Applied Intelligence, 2023, 53 : 30300 - 30318
  • [43] Learning to solve graph metric dimension problem based on graph contrastive learning
    Wu, Jian
    Wang, Li
    Yang, Weihua
    Zhao, Haixia
    Wang, Rui
    Cao, Jianji
    Wei, Fuhong
    APPLIED INTELLIGENCE, 2023, 53 (24) : 30300 - 30318
  • [44] Graph contrastive learning based on negative-sample-free loss and adaptive augmentation
    Zhou T.-Q.
    Yang Y.
    Zhang J.-J.
    Yin S.-W.
    Guo Z.-Q.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (02): : 259 - 266
  • [45] Multi-view Negative-Free Contrastive Learning on Adaptive Graph Augmentation
    Wang, Xingyue
    Liu, Huazhong
    Ding, Jihong
    Tan, Peng
    2024 IEEE 24TH INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING, CCGRID 2024, 2024, : 291 - 298
  • [46] Unlocking the Potential of Data Augmentation in Contrastive Learning for Hyperspectral Image Classification
    Li, Jinhui
    Li, Xiaorun
    Yan, Yunfeng
    REMOTE SENSING, 2023, 15 (12)
  • [47] OFDM Emitter Identification Method Based on Data Augmentation and Contrastive Learning
    Yu, Jiaqi
    Yuan, Ye
    Zhang, Qian
    Zhang, Wei
    Fan, Ziyu
    Jin, Fusheng
    APPLIED SCIENCES-BASEL, 2023, 13 (01):
  • [48] Entropy Neural Estimation for Graph Contrastive Learning
    Ma, Yixuan
    Zhang, Xiaolin
    Zhang, Peng
    Zhan, Kun
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 435 - 443
  • [49] Self-supervised contrastive graph representation with node and graph augmentation?
    Duan, Haoran
    Xie, Cheng
    Li, Bin
    Tang, Peng
    NEURAL NETWORKS, 2023, 167 : 223 - 232
  • [50] Hyperedge Graph Contrastive Learning
    Zhang, Junfeng
    Zeng, Weixin
    Tang, Jiuyang
    Zhao, Xiang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (12) : 8502 - 8514