Translation-Based Embeddings with Octonion for Knowledge Graph Completion

被引:11
作者
Yu, Mei [1 ,2 ,3 ]
Bai, Chen [1 ,2 ,3 ]
Yu, Jian [1 ,2 ,3 ]
Zhao, Mankun [1 ,2 ,3 ]
Xu, Tianyi [1 ,2 ,3 ]
Liu, Hongwei [4 ]
Li, Xuewei [1 ,2 ,3 ]
Yu, Ruiguo [1 ,2 ,3 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[2] Tianjin Univ, Tianjin Key Lab Adv Networking TANKLab, Tianjin 300350, Peoples R China
[3] Tianjin Univ, Tianjin Key Lab Cognit Comp & Applicat, Tianjin 300350, Peoples R China
[4] Tianjin Foreign Studies Univ, Foreign Language Literature & Culture Studies Ctr, Tianjin 300204, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 08期
基金
中国国家自然科学基金;
关键词
knowledge graph completion; octonion; hyperbolic geometry; Poincare space; link prediction;
D O I
10.3390/app12083935
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Knowledge representation learning achieves the automatic completion of knowledge graphs (KGs) by embedding entities into continuous low-dimensional vector space. In knowledge graph completion (KGC) tasks, the inter-dependencies and hierarchical information in KGs have gained attention. Existing methods do not well capture the latent dependencies between all components of entities and relations. To address this, we introduce the mathematical theories of octonion, a more expressive generalized form of complex number and quaternion, and propose a translation-based KGC model with octonion (TransO). TransO models entities as octonion coordinate vectors, relations as the combination of octonion component matrices and coordinate vectors, and uses specific grouping calculation rules to interact between entities and relations. In addition, since hyperbolic Poincare space in non-Euclidean mathematics can represent hierarchical data more accurately and effectively than traditional Euclidean space, we propose a Poincare-extended TransO model (PTransO). PTransO transforms octonion coordinate vectors into hyperbolic embeddings by exponential mapping, and integrates the Euclidean-based calculations into hyperbolic space by operations such as Mobius addition and hyperbolic distance. The experimental results of link prediction indicate that TransO outperforms other translation-based models on the WN18 benchmark, and PTransO further achieves state-of-the-art performance in low-dimensional space on the well-established WN18RR and FB15k-237 benchmarks.
引用
收藏
页数:24
相关论文
共 45 条
[1]  
[Anonymous], 2016, NAACL HLT 2016
[2]  
[Anonymous], Proceedings of the 2008 ACM SIGMOD international conference on Management of data, SIGMOD '08
[3]  
Balazevic I, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P5185
[4]  
Balazevic I, 2019, ADV NEUR IN, V32
[5]  
Bordes A., 2013, NIPS'13, P1
[6]   Large-Scale Machine Learning with Stochastic Gradient Descent [J].
Bottou, Leon .
COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, :177-186
[7]   Algorithm for multiplying two octonions [J].
Cariow A. ;
Cariowa G. .
Radioelectronics and Communications Systems, 2012, 55 (10) :464-473
[8]  
Chami I., 2020, P 58 ANN M ASS COMPU, P6901, DOI [10.18653/v1/2020.acl-main.617, DOI 10.18653/V1/2020.ACL-MAIN.617]
[9]   An Approach to Knowledge Base Completion by a Committee-Based Knowledge Graph Embedding [J].
Choi, Su Jeong ;
Song, Hyun-Je ;
Park, Seong-Bae .
APPLIED SCIENCES-BASEL, 2020, 10 (08)
[10]  
Conway J.H., 2004, Math. Intell, V26, P75, DOI DOI 10.1007/BF02985662