Knowledge Graph Completion by Jointly Learning Structural Features and Soft Logical Rules

被引:9
作者
Li, Weidong [1 ]
Peng, Rong [1 ]
Li, Zhi [2 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Hubei, Peoples R China
[2] Guangxi Normal Univ, Coll Comp Sci & Informat Technol, Guilin 541004, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Predictive models; Training; Knowledge engineering; Deep learning; Neural networks; Convolutional neural networks; Knowledge graph completion; knowledge graph embedding; graph attention neural networks; link prediction; soft logical rules;
D O I
10.1109/TKDE.2021.3108224
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development and widespread application of Knowledge graphs (KGs) in many artificial intelligence tasks, a large number of efforts have been made to refine them and increase their quality. Knowedge graph embedding (KGE) has become one of the main refinement tasks, which aims to predict missing facts based on existing ones in KGs. However, there are still mainly two difficult unresolved challenges: (i) how to leverage the local structural features of entities and the potential soft logical rules to learn more expressive embedding of entites and relations; and (ii) how to combine these two learning processes into one unified model. To conquer these problems, we propose a novel KGE model named JSSKGE, which can Jointly learn the local Structural features of entities and Soft logical rules. First, we employ graph attention networks which are specially designed for graph-structured data to aggregate the local structural information of nodes. Then, we utilize soft logical rules implicated in KGs as an expert to further rectify the embeddings of entities and relations. By jointly learning, we can obtain more informative embeddings to predict new facts. With experiments on four commonly used datasets, the JSSKGE obtains better performance than state-of-the-art approaches.
引用
收藏
页码:2724 / 2735
页数:12
相关论文
共 43 条
[1]  
[Anonymous], 2018, P NEUR INF PROC SYST
[2]   Hypernetwork Knowledge Graph Embeddings [J].
Balazevic, Ivana ;
Allen, Carl ;
Hospedales, Timothy M. .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: WORKSHOP AND SPECIAL SESSIONS, 2019, 11731 :553-565
[3]   Semantic Search on Text and Knowledge Bases [J].
Bast, Hannah ;
Buchhold, Bjoern ;
Haussmann, Elmar .
FOUNDATIONS AND TRENDS IN INFORMATION RETRIEVAL, 2016, 10 (2-3) :120-+
[4]  
Betteridge Justin., 2009, Association for the Advancement of Artificial Intelligence (AAAI) Spring Symposium: Learning by Reading and Learning to Read, P1
[5]  
Bollacker K. D., 2008, P ACM SIGMOD INT C M, P1247
[6]  
Bordes A, 2013, NIPS 13, P2787, DOI DOI 10.5555/2999792.2999923
[7]   Word sense disambiguation: A complex network approach [J].
Correa, Edilson A., Jr. ;
Lopes, Alneu A. ;
Amancio, Diego R. .
INFORMATION SCIENCES, 2018, 442 :103-113
[8]  
Das R, 2018, Arxiv, DOI arXiv:1711.05851
[9]  
Dettmers T, 2018, AAAI CONF ARTIF INTE, P1811
[10]  
Galárraga L, 2015, VLDB J, V24, P707, DOI 10.1007/s00778-015-0394-1