Multi-relational graph attention networks for knowledge graph completion

被引:67
作者
Li, Zhifei [1 ]
Zhao, Yue [1 ]
Zhang, Yan [1 ]
Zhang, Zhaoli [2 ]
机构
[1] Hubei Univ, Sch Comp Sci & Informat Engn, Wuhan 430062, Peoples R China
[2] Cent China Normal Univ, Natl Engn Res Ctr Elearning, Wuhan 430079, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-relational learning; Knowledge graph completion; Graph neural network; Attention mechanism; NEURAL-NETWORKS;
D O I
10.1016/j.knosys.2022.109262
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graphs are multi-relational data that contain massive entities and relations. As an effective graph representation technique based on deep learning, graph neural network has reported outstand-ing performance for modeling knowledge graphs in recent studies. However, previous graph neural network-based models have not fully considered the heterogeneity of knowledge graphs. Furthermore, the attention mechanism has demonstrated its great potential in many areas. In this paper, a novel heterogeneous graph neural network framework based on a hierarchical attention mechanism is proposed, including entity-level, relation-level, and self-level attentions. Thus, the proposed model can selectively aggregate informative features and weights them adequately. Then the learned embeddings of entities and relations can be utilized for the downstream tasks. Extensive experimental results on various heterogeneous graph tasks demonstrate the superior performance of the proposed model compared to several state-of-the-art methods. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 69 条
[1]  
[Anonymous], 2015, ICLR
[2]  
[Anonymous], Proceedings of the 2008 ACM SIGMOD international conference on Management of data, SIGMOD '08
[3]  
[Anonymous], 2015, P 2015 C EMPIRICAL M
[4]  
Bordes A., 2013, NIPS'13, P1
[5]   CAFE: Knowledge graph completion using neighborhood-aware features [J].
Borrego, Agustin ;
Ayala, Daniel ;
Hernandez, Inma ;
Rivero, Carlos R. ;
Ruiz, David .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 103
[6]  
Carlson A, 2010, AAAI CONF ARTIF INTE, P1306
[7]  
Chen J., 2018, PROC 2 INT C LEARN R, P1
[8]   A review: Knowledge reasoning over knowledge graph [J].
Chen, Xiaojun ;
Jia, Shengbin ;
Xiang, Yang .
EXPERT SYSTEMS WITH APPLICATIONS, 2020, 141
[9]  
Defferrard M, 2016, ADV NEUR IN, V29
[10]  
Dettmers T, 2018, AAAI CONF ARTIF INTE, P1811