A collaborative learning framework for knowledge graph embedding and reasoning

被引:3
作者
Wang, Hao [1 ]
Song, Dandan [1 ]
Wu, Zhijing [1 ]
Li, Jia [1 ]
Zhou, Yanru [1 ]
Xu, Jing [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
关键词
Knowledge graph completion; Knowledge graph embedding; Knowledge graph reasoning; Multi-hop reasoning;
D O I
10.1016/j.knosys.2024.111505
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graph embedding (KGE) and knowledge graph reasoning (KGR) aim to automatic completion of knowledge graph (KG). The difference is that most KGE models learn the embedded representation at a triple level. In contrast, KGR models focus more on optimizing decision -making and enhancing the interpretability of reasoning processes with multi -hop paths. As a result, KGE models are better at learning triplet embeddings, whereas KGR models can capture the multihop information between entity pairs. However, KGE and KGR models only focus on one aspect that affects the completion performance. This paper proposes a plug -and -play collaborative learning framework (CLF) for jointly enhancing knowledge graph embedding and reasoning, which can accommodate existing KGR and KGE models. The two models exchange training experiences in this framework to realize mutual learning through a collaborative learning module. In this module, a new distance function is designed to maintain the independence of candidate entities' probabilities and avoid information loss. Furthermore, a knowledge augmentation module is designed to identify missing key triples to assist in the further iterative training of the framework. Extensive experiments on the benchmark datasets demonstrate that our framework significantly improves the performance of existing models.
引用
收藏
页数:11
相关论文
共 53 条
[11]   Knowledge Vault: A Web-Scale Approach to Probabilistic Knowledge Fusion [J].
Dong, Xin Luna ;
Gabrilovich, Evgeniy ;
Heitz, Geremy ;
Horn, Wilko ;
Lao, Ni ;
Murphy, Kevin ;
Strohmann, Thomas ;
Sun, Shaohua ;
Zhang, Wei .
PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, :601-610
[12]  
Fang U, 2023, IEEE T KNOWL DATA EN
[13]  
Fu C, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P2672
[14]  
Guo J., 2021, P 2021 C EMPIRICAL M
[15]  
Guo LB, 2019, PR MACH LEARN RES, V97
[16]  
Hildebrandt M, 2020, AAAI CONF ARTIF INTE, V34, P4123
[17]  
Hinton G., 2015, NIPS DEEP LEARN REPR
[18]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.8.1735, 10.1007/978-3-642-24797-2, 10.1162/neco.1997.9.1.1]
[19]  
Hou ZN, 2021, FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, P4687
[20]   Persistent graph stream summarization for real-time graph analytics [J].
Jia, Yan ;
Gu, Zhaoquan ;
Jiang, Zhihao ;
Gao, Cuiyun ;
Yang, Jianye .
WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (05) :2647-2667