Multi-relational graph contrastive learning with learnable graph augmentation

被引:4
作者
Mo, Xian [1 ,4 ]
Pang, Jun [2 ]
Wan, Binyuan [1 ]
Tang, Rui [3 ]
Liu, Hao [1 ,4 ]
Jiang, Shuyu [3 ]
机构
[1] Ningxia Univ, Sch Informat Engn, Yinchuan 750021, Peoples R China
[2] Univ Luxembourg, Fac Sci Technol & Med, L-4364 Esch Sur Alzette, Luxembourg
[3] Sichuan Univ, Sch Cyber Sci & Engn, Chengdu 610065, Sichuan, Peoples R China
[4] Ningxia Univ, Ningxia Key Lab Artificial Intelligence & Informat, Yinchuan 750021, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive learning; Learnable graph augmentation; Multi-relational graph learning; NETWORK;
D O I
10.1016/j.neunet.2024.106757
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-relational graph learning aims to embed entities and relations in knowledge graphs into low-dimensional representations, which has been successfully applied to various multi-relationship prediction tasks, such as information retrieval, question answering, and etc. Recently, contrastive learning has shown remarkable performance in multi-relational graph learning by data augmentation mechanisms to deal with highly sparse data. In this paper, we present a Multi-Relational Graph Contrastive L earning architecture (MRGCL) for multi- relational graph learning. More specifically, our MRGCL first proposes a Multi-relational Graph Hierarchical Attention Networks (MGHAN) to identify the importance between entities, which can learn the importance at different levels between entities for extracting the local graph dependency. Then, two graph augmented views with adaptive topology are automatically learned by the variant MGHAN, which can automatically adapt for different multi-relational graph datasets from diverse domains. Moreover, a subgraph contrastive loss is designed, which generates positives per anchor by calculating strongly connected subgraph embeddings of the anchor as the supervised signals. Comprehensive experiments on multi-relational datasets from three application domains indicate the superiority of our MRGCL over various state-of-the-art methods.
引用
收藏
页数:9
相关论文
共 57 条
[1]  
Balazevic I, 2019, ADV NEUR IN, V32
[2]  
Bansal T, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P4387
[3]  
Binkowski Jakub, 2023, Computational Science - ICCS 2023: 23rd International Conference, Proceedings. Lecture Notes in Computer Science (14073), P393, DOI 10.1007/978-3-031-35995-8_28
[4]  
Bordes A., 2013, Advances in Neural Information Processing Systems, V26
[5]   Cross-modal Knowledge Graph Contrastive Learning for Machine Learning Method Recommendation [J].
Cao, Xianshuai ;
Shi, Yuliang ;
Wang, Jihu ;
Yu, Han ;
Wang, Xinjun ;
Yan, Zhongmin .
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, :3694-3702
[6]  
Chen C, 2020, AAAI CONF ARTIF INTE, V34, P19
[7]  
Chen GZ, 2022, AAAI CONF ARTIF INTE, P5530
[8]   Attentive Knowledge-aware Graph Convolutional Networks with Collaborative Guidance for Personalized Recommendation [J].
Chen, Yankai ;
Yang, Yaming ;
Wang, Yujing ;
Bai, Jing ;
Song, Xiangchen ;
King, Irwin .
2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, :299-311
[9]   MUFFIN: multi-scale feature fusion for drug-drug interaction prediction [J].
Chen, Yujie ;
Ma, Tengfei ;
Yang, Xixi ;
Wang, Jianmin ;
Song, Bosheng ;
Zeng, Xiangxiang .
BIOINFORMATICS, 2021, 37 (17) :2651-2658
[10]   MRGAT: Multi-Relational Graph Attention Network for knowledge graph completion [J].
Dai, Guoquan ;
Wang, Xizhao ;
Zou, Xiaoying ;
Liu, Chao ;
Cen, Si .
NEURAL NETWORKS, 2022, 154 :234-245