MuHca: Mixup Heterogeneous Graphs for Contrastive Learning with Data Augmentation

被引:0
作者
Liang, Dengzhe [1 ]
Li, Binglin [1 ]
Li, Hongxi [1 ]
Jiang, Yuncheng [1 ,2 ]
机构
[1] South China Normal Univ, Sch Artificial Intelligence, Foshan, Peoples R China
[2] South China Normal Univ, Sch Comp Sci, Guangzhou, Peoples R China
来源
PRICAI 2023: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I | 2024年 / 14325卷
基金
中国国家自然科学基金;
关键词
Data augmentation; Heterogeneous graph; Contrastive learning;
D O I
10.1007/978-981-99-7019-3_35
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Contrastive learning has become a highly promising learning paradigm and demonstrated significant potential when few labels are available. The effectiveness of contrastive learning on graphs is largely dependent on the quality of positive and negative pairs, which can be improved by developing data augmentation (DA). However, the majority of the current DA methods rely on homogeneous graphs while less on heterogeneous graphs. In this paper, we present a method named MuHca, a node augmentation module for the problem of heterogeneity in DA. Concretely, MuHca separately employs nodes embedding of two views, namely meta-path and network schema, into a novel contrasting generative adversarial nets structure to implement data augmentation. By adopting the contrasting generative paradigm of GANs, MuHca can generate and optimize effective negatives. To enhance the robustness of MuHca, we exploit the potential information from the original data and extend our approaches by mixing up generated negatives with original ones. The final stage involves training a generator for edges in parallel with the modeling of edge presence among nodes, culminating in contrastive learning for heterogeneous graphs. The conducted experiments on three datasets validate the effectiveness of our proposed method, surpassing various state-of-the-art and even semi-supervised methods.
引用
收藏
页码:377 / 388
页数:12
相关论文
共 24 条
[1]   MEGNN: Meta-path extracted graph neural network for heterogeneous [J].
Chang, Yaomin ;
Chen, Chuan ;
Hu, Weibo ;
Zheng, Zibin ;
Zhou, Xiaocong ;
Chen, Shouzhi .
KNOWLEDGE-BASED SYSTEMS, 2022, 235
[2]  
Chen Y, 2022, Arxiv, DOI arXiv:2212.00024
[3]   MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embedding [J].
Fu, Xinyu ;
Zhang, Jiani ;
Men, Ziqiao ;
King, Irwin .
WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, :2331-2341
[4]   Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1026-1034
[5]   Higher-Order Attribute-Enhancing Heterogeneous Graph Neural Networks [J].
Li, Jianxin ;
Peng, Hao ;
Cao, Yuwei ;
Dou, Yingtong ;
Zhang, Hekai ;
Yu, Philip S. ;
He, Lifang .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (01) :560-574
[6]   Generative Semantic Manipulation with Mask-Contrasting GAN [J].
Liang, Xiaodan ;
Zhang, Hao ;
Lin, Liang ;
Xing, Eric .
COMPUTER VISION - ECCV 2018, PT XIII, 2018, 11217 :574-590
[7]   Cross-perspective Graph Contrastive Learning [J].
Lin, Shiyang ;
Dong, Chenhe ;
Shen, Ying .
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, 2022, 13368 :58-70
[8]   Hierarchical Contrastive Learning Enhanced Heterogeneous Graph Neural Network [J].
Liu N. ;
Wang X. ;
Han H. ;
Shi C. .
IEEE Transactions on Knowledge and Data Engineering, 2023, 35 (10) :10884-10896
[9]   Graph Self-Supervised Learning: A Survey [J].
Liu, Yixin ;
Jin, Ming ;
Pan, Shirui ;
Zhou, Chuan ;
Zheng, Yu ;
Xia, Feng ;
Yu, Philip S. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (06) :5879-5900
[10]  
Memmi G., 2022, 15 INT C KNOWLEDGE S, V13368, DOI 10.1007978-3-031-10989-8