MuHca: Mixup Heterogeneous Graphs for Contrastive Learning with Data Augmentation

被引:0
作者
Liang, Dengzhe [1 ]
Li, Binglin [1 ]
Li, Hongxi [1 ]
Jiang, Yuncheng [1 ,2 ]
机构
[1] South China Normal Univ, Sch Artificial Intelligence, Foshan, Peoples R China
[2] South China Normal Univ, Sch Comp Sci, Guangzhou, Peoples R China
来源
PRICAI 2023: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I | 2024年 / 14325卷
基金
中国国家自然科学基金;
关键词
Data augmentation; Heterogeneous graph; Contrastive learning;
D O I
10.1007/978-981-99-7019-3_35
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Contrastive learning has become a highly promising learning paradigm and demonstrated significant potential when few labels are available. The effectiveness of contrastive learning on graphs is largely dependent on the quality of positive and negative pairs, which can be improved by developing data augmentation (DA). However, the majority of the current DA methods rely on homogeneous graphs while less on heterogeneous graphs. In this paper, we present a method named MuHca, a node augmentation module for the problem of heterogeneity in DA. Concretely, MuHca separately employs nodes embedding of two views, namely meta-path and network schema, into a novel contrasting generative adversarial nets structure to implement data augmentation. By adopting the contrasting generative paradigm of GANs, MuHca can generate and optimize effective negatives. To enhance the robustness of MuHca, we exploit the potential information from the original data and extend our approaches by mixing up generated negatives with original ones. The final stage involves training a generator for edges in parallel with the modeling of edge presence among nodes, culminating in contrastive learning for heterogeneous graphs. The conducted experiments on three datasets validate the effectiveness of our proposed method, surpassing various state-of-the-art and even semi-supervised methods.
引用
收藏
页码:377 / 388
页数:12
相关论文
共 24 条
[11]  
Park C, 2020, AAAI CONF ARTIF INTE, V34, P5371
[12]  
Park J., 2021, INT C LEARN REPR ICL
[13]  
Rong Y., 2020, 8 INT C LEARN REPR I, DOI [10.48550/arXiv.1907.10903, DOI 10.48550/ARXIV.1907.10903]
[14]  
Shi C., 2022, Heterogeneous Graph Representation Learning and Applications, DOI [10.1007/978-981-16-6166-2, DOI 10.1007/978-981-16-6166-2]
[15]   Heterogeneous Information Network Embedding for Recommendation [J].
Shi, Chuan ;
Hu, Binbin ;
Zhao, Wayne Xin ;
Yu, Philip S. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2019, 31 (02) :357-370
[16]  
Velickovic P., 2019, 7 INT C LEARN REPR
[17]   Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning [J].
Wang, Xiao ;
Liu, Nian ;
Han, Hui ;
Shi, Chuan .
KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, :1726-1736
[18]   Heterogeneous Graph Attention Network [J].
Wang, Xiao ;
Ji, Houye ;
Shi, Chuan ;
Wang, Bai ;
Cui, Peng ;
Yu, P. ;
Ye, Yanfang .
WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, :2022-2032
[19]   Graph Neural Networks: Foundation, Frontiers and Applications [J].
Wu, Lingfei ;
Cui, Peng ;
Pei, Jian ;
Zhao, Liang ;
Guo, Xiaojie .
PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, :4840-4841
[20]   Self-Supervised Learning on Graphs: Contrastive, Generative, or Predictive [J].
Wu, Lirong ;
Lin, Haitao ;
Tan, Cheng ;
Gao, Zhangyang ;
Li, Stan Z. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) :4216-4235