A collaborative learning framework for knowledge graph embedding and reasoning

被引:3
作者
Wang, Hao [1 ]
Song, Dandan [1 ]
Wu, Zhijing [1 ]
Li, Jia [1 ]
Zhou, Yanru [1 ]
Xu, Jing [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
关键词
Knowledge graph completion; Knowledge graph embedding; Knowledge graph reasoning; Multi-hop reasoning;
D O I
10.1016/j.knosys.2024.111505
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graph embedding (KGE) and knowledge graph reasoning (KGR) aim to automatic completion of knowledge graph (KG). The difference is that most KGE models learn the embedded representation at a triple level. In contrast, KGR models focus more on optimizing decision -making and enhancing the interpretability of reasoning processes with multi -hop paths. As a result, KGE models are better at learning triplet embeddings, whereas KGR models can capture the multihop information between entity pairs. However, KGE and KGR models only focus on one aspect that affects the completion performance. This paper proposes a plug -and -play collaborative learning framework (CLF) for jointly enhancing knowledge graph embedding and reasoning, which can accommodate existing KGR and KGE models. The two models exchange training experiences in this framework to realize mutual learning through a collaborative learning module. In this module, a new distance function is designed to maintain the independence of candidate entities' probabilities and avoid information loss. Furthermore, a knowledge augmentation module is designed to identify missing key triples to assist in the further iterative training of the framework. Extensive experiments on the benchmark datasets demonstrate that our framework significantly improves the performance of existing models.
引用
收藏
页数:11
相关论文
共 53 条
[1]  
[Anonymous], 2019, Advances in Neural Information Processing Systems (NeurIPS)
[2]  
[Anonymous], 2015, P 2015 C EMPIRICAL M
[3]  
Balazevic I, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P5185
[4]   Boosting question answering over knowledge graph with reward integration and policy evaluation under weak supervision [J].
Bi, Xin ;
Nie, Haojie ;
Zhang, Guoliang ;
Hu, Lei ;
Ma, Yuliang ;
Zhao, Xiangguo ;
Yuan, Ye ;
Wang, Guoren .
INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (02)
[5]   Unrestricted multi-hop reasoning network for interpretable question answering over knowledge graph [J].
Bi, Xin ;
Nie, Haojie ;
Zhang, Xiyu ;
Zhao, Xiangguo ;
Yuan, Ye ;
Wang, Guoren .
KNOWLEDGE-BASED SYSTEMS, 2022, 243
[6]  
Bollacker K., 2008, P 2008 ACM SIGMOD IN, P1247, DOI 10.1145/1376616.1376746
[7]  
Bordes A., 2013, Advances in Neural Information Processing Systems, V26
[8]  
Carlson A, 2010, AAAI CONF ARTIF INTE, P1306
[9]  
Das R., 2018, INT C LEARNING REPRE
[10]  
Dettmers T, 2018, AAAI CONF ARTIF INTE, P1811