GMNI: Achieve good data augmentation in unsupervised graph contrastive learning

被引:0
|
作者
Xiong, Xin [1 ]
Wang, Xiangyu [1 ]
Yang, Suorong [1 ]
Shen, Furao [1 ]
Zhao, Jian [2 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[2] Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural network; Graph contrastive learning; Data augmentation;
D O I
10.1016/j.neunet.2024.106804
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning (GCL) shows excellent potential in unsupervised graph representation learning. Data augmentation (DA), responsible for generating diverse views, plays a vital role in GCL, and its optimal choice heavily depends on the downstream task. However, it is impossible to measure task-relevant information under an unsupervised setting. Therefore, many GCL methods risk insufficient information by failing to preserve essential information necessary for the downstream task or risk encoding redundant information. In this paper, we propose a novel method called Minimal Noteworthy Information for unsupervised Graph contrastive learning (GMNI), featuring automated DA. It achieves good DA by balancing missing and excessive information, approximating the optimal views in contrastive learning. We employ an adversarial training strategy to generate views that share minimal noteworthy information (MNI), reducing nuisance information by minimization optimization and ensuring sufficient information by emphasizing noteworthy information. Besides, we introduce randomness based on MNI to augmentation, thereby enhancing view diversity and stabilizing the model against perturbations. Extensive experiments on unsupervised and semi-supervised learning over 14 datasets demonstrate the superiority of GMNI over GCL methods with automated and manual DA. GMNI achieves up to a 1.64% improvement over the state-of-the-art in unsupervised node classification, up to a 1.97% improvement in unsupervised graph classification, and up to a 3.57% improvement in semi-supervised graph classification.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Invariant Risk Minimization Augmentation for Graph Contrastive Learning
    Qin, Peng
    Chen, Weifu
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT IV, 2025, 15034 : 135 - 147
  • [22] Graph Contrastive Learning With Adaptive Proximity-Based Graph Augmentation
    Zhuo, Wei
    Tan, Guang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 14301 - 14314
  • [23] AFANS: Augmentation-Free Graph Contrastive Learning with Adversarial Negative Sampling
    Wang, Shihao
    Wang, Chenxu
    Meng, Panpan
    Wang, Zhanggong
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT XII, ICIC 2024, 2024, 14873 : 376 - 387
  • [24] Dual-view data augmentation at subgraph level and graph contrastive learning for sequential recommendation
    Mu, Caihong
    Yu, Haikun
    Qin, Lang
    Liu, Yi
    MACHINE LEARNING, 2025, 114 (03)
  • [25] A data augmentation model integrating supervised and unsupervised learning for recommendation
    Chen, Jiaying
    Zhu, Zhongrui
    Li, Haoyang
    Jiang, Wanlong
    Jeon, Gwanggil
    Qian, Yurong
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [26] Joint data augmentations for automated graph contrastive learning and forecasting
    Liu, Jiaqi
    Chen, Yifu
    Ren, Qianqian
    Gao, Yang
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (05) : 6481 - 6490
  • [27] Unsupervised Multiview Graph Contrastive Feature Learning for Hyperspectral Image Classification
    Chang, Yuan
    Liu, Quanwei
    Zhang, Yuxiang
    Dong, Yanni
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [28] A Unique Framework of Heterogeneous Augmentation Graph Contrastive Learning for Both Node and Graph Classification
    Shao, Qi
    Chen, Duxin
    Yu, Wenwu
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (06): : 5818 - 5828
  • [29] Hierarchical Graph Contrastive Learning
    Yan, Hao
    Wang, Senzhang
    Yin, Jun
    Li, Chaozhuo
    Zhu, Junxing
    Wang, Jianxin
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT II, 2023, 14170 : 700 - 715
  • [30] COSTA: Covariance-Preserving Feature Augmentation for Graph Contrastive Learning
    Zhang, Yifei
    Zhu, Hao
    Song, Zixing
    Koniusz, Piotr
    King, Irwin
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 2524 - 2534