NePTuNe: Neural Powered Tucker Network for Knowledge Graph Completion

被引:3
作者
Sonkar, Shashank [1 ]
Katiyar, Arzoo [2 ]
Baraniuk, Richard [1 ]
机构
[1] Rice Univ, Houston, TX 77251 USA
[2] Penn State Univ, University Pk, PA 16802 USA
来源
PROCEEDINGS OF THE 10TH INTERNATIONAL JOINT CONFERENCE ON KNOWLEDGE GRAPHS (IJCKG 2021) | 2021年
关键词
knowledge graph completion; tucker decomposition; link prediction;
D O I
10.1145/3502223.3502249
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graphs link entities through relations to provide a structured representation of real world facts. However, they are often incomplete, because they are based on only a small fraction of all plausible facts. The task of knowledge graph completion via link prediction aims to overcome this challenge by inferring missing facts represented as links between entities. Current approaches to link prediction leverage tensor factorization and/or deep learning. Factorization methods train and deploy rapidly thanks to their small number of parameters but have limited expressiveness due to their underlying linear methodology. Deep learning methods are more expressive but also computationally expensive and prone to overfitting due to their large number of trainable parameters. We propose Neural Powered Tucker Network (NePTuNe), a new hybrid link prediction model that couples the expressiveness of deep models with the speed and size of linear models. We demonstrate that NePTuNe provides state-of-the-art performance on the FB15K-237 dataset and near state-of-the-art performance on the WN18RR dataset.
引用
收藏
页码:177 / 180
页数:4
相关论文
共 24 条
[1]  
Balazevic I, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P5185
[2]  
Balazevic Ivana, 2019, GITHUB IBALAZEVIC TU
[3]  
Balazevic Ivana, 2019, Advances in Neural Information Processing Systems, V32
[4]  
Bordes A., 2013, Advances in Neural Information Processing Systems, V26, P2787, DOI DOI 10.5555/2999792.2999923
[5]  
Chami Ines, 2020, ACL, P6901, DOI [10.18653/v1/2020.acl-main.617, DOI 10.18653/V1/2020.ACLMAIN.617]
[6]  
Dettmers T, 2018, AAAI CONF ARTIF INTE, P1811
[7]   Utilizing Knowledge Graphs for Text-Centric Information Retrieval [J].
Dietz, Laura ;
Kotov, Alexander ;
Meij, Edgar .
ACM/SIGIR PROCEEDINGS 2018, 2018, :1387-1390
[8]   An End-to-End Model for Question Answering over Knowledge Base with Cross-Attention Combining Global Knowledge [J].
Hao, Yanchao ;
Zhang, Yuanzhe ;
Liu, Kang ;
He, Shizhu ;
Liu, Zhanyi ;
Wu, Hua ;
Zhao, Jun .
PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, :221-231
[9]  
Ioffe S, 2015, PR MACH LEARN RES, V37, P448
[10]  
Kazemi SM, 2018, ADV NEUR IN, V31