GMNI: Achieve good data augmentation in unsupervised graph contrastive learning

被引:0
|
作者
Xiong, Xin [1 ]
Wang, Xiangyu [1 ]
Yang, Suorong [1 ]
Shen, Furao [1 ]
Zhao, Jian [2 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[2] Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural network; Graph contrastive learning; Data augmentation;
D O I
10.1016/j.neunet.2024.106804
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning (GCL) shows excellent potential in unsupervised graph representation learning. Data augmentation (DA), responsible for generating diverse views, plays a vital role in GCL, and its optimal choice heavily depends on the downstream task. However, it is impossible to measure task-relevant information under an unsupervised setting. Therefore, many GCL methods risk insufficient information by failing to preserve essential information necessary for the downstream task or risk encoding redundant information. In this paper, we propose a novel method called Minimal Noteworthy Information for unsupervised Graph contrastive learning (GMNI), featuring automated DA. It achieves good DA by balancing missing and excessive information, approximating the optimal views in contrastive learning. We employ an adversarial training strategy to generate views that share minimal noteworthy information (MNI), reducing nuisance information by minimization optimization and ensuring sufficient information by emphasizing noteworthy information. Besides, we introduce randomness based on MNI to augmentation, thereby enhancing view diversity and stabilizing the model against perturbations. Extensive experiments on unsupervised and semi-supervised learning over 14 datasets demonstrate the superiority of GMNI over GCL methods with automated and manual DA. GMNI achieves up to a 1.64% improvement over the state-of-the-art in unsupervised node classification, up to a 1.97% improvement in unsupervised graph classification, and up to a 3.57% improvement in semi-supervised graph classification.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Semi-Supervised Graph Contrastive Learning With Virtual Adversarial Augmentation
    Dong, Yixiang
    Luo, Minnan
    Li, Jundong
    Liu, Ziqi
    Zheng, Qinghua
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (08) : 4232 - 4244
  • [32] Co-augmentation of structure and feature for boosting graph contrastive learning
    Bao, Peng
    Yan, Rong
    Pan, Shirui
    INFORMATION SCIENCES, 2024, 676
  • [33] Heterogeneous graph contrastive learning with adaptive data augmentation for semi-supervised short text classification
    Wu, Mingqiang
    Xu, Zhuoming
    Zheng, Lei
    EXPERT SYSTEMS, 2025, 42 (02)
  • [34] FAGCL: frequency-based augmentation graph contrastive learning for recommendation
    Xu, Jingyu
    Yang, Bo
    Li, Zimu
    Liu, Wei
    Qiao, Hao
    APPLIED INTELLIGENCE, 2025, 55 (01)
  • [35] A Graph Neural Network for EEG-Based Emotion Recognition With Contrastive Learning and Generative Adversarial Neural Network Data Augmentation
    Gilakjani, Sareh Soleimani
    Al Osman, Hussein
    IEEE ACCESS, 2024, 12 : 113 - 130
  • [36] LMACL: Improving Graph Collaborative Filtering with Learnable Model Augmentation Contrastive Learning
    Liu, Xinru
    Hao, Yongjing
    Zhao, Lei
    Liu, Guanfeng
    Sheng, Victor S.
    Zhao, Pengpeng
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (07)
  • [37] Distribution-aware hybrid noise augmentation in graph contrastive learning for recommendation
    Zhu, Kuiyu
    Qin, Tao
    Wang, Xin
    Liu, Zhaoli
    Wang, Chenxu
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 124
  • [38] Augmentation-Free Graph Contrastive Learning of Invariant-Discriminative Representations
    Li, Haifeng
    Cao, Jun
    Zhu, Jiawei
    Luo, Qinyao
    He, Silu
    Wang, Xuyin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) : 11157 - 11167
  • [39] Contrastive Graph Convolutional Networks with adaptive augmentation for text classification
    Yang, Yintao
    Miao, Rui
    Wang, Yili
    Wang, Xin
    INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (04)
  • [40] Harnessing Unsupervised Insights: Enhancing Black-Box Graph Injection Attacks with Graph Contrastive Learning
    Liu, Xiao
    Huang, Junjie
    Chen, Zihan
    Pan, Yi
    Xiong, Maoyi
    Zhao, Wentao
    APPLIED SCIENCES-BASEL, 2024, 14 (20):