Relation-attention semantic-correlative knowledge graph embedding for inductive link prediction

被引:5
作者
Li, Xiaonan [1 ]
Ning, Bo [1 ]
Li, Guanyu [1 ]
Wang, Jie [1 ]
机构
[1] Dalian Maritime Univ, Fac Informat Sci & Technol, Dalian 116026, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Knowledge graph embedding; Inductive link prediction; Relational subgraph; Graph neural network;
D O I
10.1007/s13042-023-01865-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Link prediction has increasingly been the focus of significant research interest, benefited from the explosion of machine learning and deep learning techniques. Graph embedding has been proven to be an effective method for predicting missing links in graph-based structure. In this work, we propose a novel relation-attention semantic-correlative graph embedding for inductive link prediction. Unlike existing embedding-based methods, we shift the node representation learning from a node's perspective to a relational subgraph perspective. Our model has a better inductive bias to learn entity-independent relational semantics. We consider two kinds of relational subgraph topology for a given entity pair: relational correlation subgraph and relational path subgraph. Firstly, we capture the structure of neighboring relation-properties of semantic-missing entity by relational correlation subgraph. Secondly, we capture the set of relational paths between given entity pair by relational path subgraph. Finally, we organize the above two modules in a unified framework for relation prediction. Our ablation experiments show that two kinds of relational subgraph topology are important for relation prediction. Experimental results on six benchmark datasets demonstrate that our proposed graph embedding outperforms existing state-of-the-art models for link prediction tasks.
引用
收藏
页码:3799 / 3811
页数:13
相关论文
共 43 条
[31]   A Survey of Heterogeneous Information Network Analysis [J].
Shi, Chuan ;
Li, Yitong ;
Zhang, Jiawei ;
Sun, Yizhou ;
Yu, Philip S. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2017, 29 (01) :17-37
[32]  
Sun Z, 2019, 7 INT C LEARN REPR N, P1
[33]  
Teru KK, 7 INT C MACHINE LEAR, V13, P9390
[34]   Relational Message Passing for Knowledge Graph Completion [J].
Wang, Hongwei ;
Ren, Hongyu ;
Leskovec, Jure .
KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, :1697-1707
[35]   Self-Supervised Learning of Contextual Embeddings for Link Prediction in Heterogeneous Networks [J].
Wang, Ping ;
Agarwal, Khushbu ;
Ham, Colby ;
Choudhury, Sutanay ;
Reddy, Chandan K. .
PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, :2946-2957
[36]   Distributed Pregel-based provenance-aware regular path query processing on RDF knowledge graphs [J].
Wang, Xin ;
Wang, Simiao ;
Xin, Yueqi ;
Yang, Yajun ;
Li, Jianxin ;
Wang, Xiaofei .
WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2020, 23 (03) :1465-1496
[37]   GARG: Anonymous Recommendation of Point-of-Interest in Mobile Networks by Graph Convolution Network [J].
Wu, Shiwen ;
Zhang, Yuanxing ;
Gao, Chengliang ;
Bian, Kaigui ;
Cui, Bin .
DATA SCIENCE AND ENGINEERING, 2020, 5 (04) :433-447
[38]   Topic Discovery for Biomedical Corpus Using MeSH Embeddings [J].
Xun, Guangxu ;
Jha, Kishlay ;
Yuan, Ye ;
Zhang, Aidong .
2019 IEEE EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL & HEALTH INFORMATICS (BHI), 2019,
[39]  
Yang F, 2017, ADV NEURAL INFORM PR, V2017, P2320
[40]   Interpretable and Efficient Heterogeneous Graph Convolutional Network [J].
Yang, Yaming ;
Guan, Ziyu ;
Li, Jianxin ;
Zhao, Wei ;
Cui, Jiangtao ;
Wang, Quan .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (02) :1637-1650