LineaRE: Simple but Powerful Knowledge Graph Embedding for Link Prediction

被引:26
作者
Peng, Yanhui [1 ]
Zhang, Jing [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, 200 Xiaolingwei St, Nanjing 210094, Peoples R China
来源
20TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2020) | 2020年
基金
中国国家自然科学基金;
关键词
knowledge graph; embedding; link prediction; linear regression;
D O I
10.1109/ICDM50108.2020.00051
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The task of link prediction for knowledge graphs is to predict missing relationships between entities. Knowledge graph embedding, which aims to represent entities and relations of a knowledge graph as low dimensional vectors in a continuous vector space, has achieved promising predictive performance. If an embedding model can cover different types of connectivity patterns and mapping properties of relations as many as possible, it will potentially bring more benefits for link prediction tasks. In this paper, we propose a novel embedding model, namely LineaRE, which is capable of modeling four connectivity patterns (i.e., symmetry, antisymmetry, inversion, and composition) and four mapping properties (i.e., one-to-one, one-to-many, many-to-one, and many-to-many) of relations. Specifically, we regard knowledge graph embedding as a simple linear regression task, where a relation is modeled as a linear function of two low-dimensional vector-presented entities with two weight vectors and a bias vector. Since the vectors are defined in a real number space and the scoring function of the model is linear, our model is simple and scalable to large knowledge graphs. Experimental results on multiple widely used real-world datasets show that the proposed LineaRE model significantly outperforms existing state-of-the-art models for link prediction tasks.
引用
收藏
页码:422 / 431
页数:10
相关论文
共 32 条
[1]  
[Anonymous], 2015, ACS SYM SER
[2]  
[Anonymous], 2018, P 32 AAAI C ART INT
[3]  
[Anonymous], 2015, AAAI SPRING S CIT
[4]  
Bordes A., 2013, P 27 ANN C NEUR INF, P2787
[5]   A semantic matching energy function for learning with multi-relational data Application to word-sense disambiguation [J].
Bordes, Antoine ;
Glorot, Xavier ;
Weston, Jason ;
Bengio, Yoshua .
MACHINE LEARNING, 2014, 94 (02) :233-259
[6]  
Cai Liwei, 2017, ARXIV PREPRINT ARXIV
[7]  
Deng Z.-H., 2019, P 7 INT C LEARN REPR
[8]  
Dettmers T, 2018, AAAI CONF ARTIF INTE, P1811
[9]   Knowledge Vault: A Web-Scale Approach to Probabilistic Knowledge Fusion [J].
Dong, Xin Luna ;
Gabrilovich, Evgeniy ;
Heitz, Geremy ;
Horn, Wilko ;
Lao, Ni ;
Murphy, Kevin ;
Strohmann, Thomas ;
Sun, Shaohua ;
Zhang, Wei .
PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, :601-610
[10]   An End-to-End Model for Question Answering over Knowledge Base with Cross-Attention Combining Global Knowledge [J].
Hao, Yanchao ;
Zhang, Yuanzhe ;
Liu, Kang ;
He, Shizhu ;
Liu, Zhanyi ;
Wu, Hua ;
Zhao, Jun .
PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, :221-231