RLPath: a knowledge graph link prediction method using reinforcement learning based attentive relation path searching and representation learning

被引:32
作者
Chen, Ling [1 ]
Cui, Jun [1 ]
Tang, Xing [1 ]
Qian, Yuntao [1 ]
Li, Yansheng [2 ]
Zhang, Yongjun [2 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[2] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
关键词
Knowledge graph link prediction; Representation learning; Reinforcement learning; Path searching;
D O I
10.1007/s10489-021-02672-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to containing rich patterns between entities, relation paths have been widely used in knowledge graph link prediction. The state-of-the-art link prediction methods considering relation paths obtain relation paths by reinforcement learning with an untrainable reward setting, and realize link prediction by path-ranking algorithm (PRA), which ignores information in entities. In this paper, we propose a new link prediction method RLPath to employ information in both relation paths and entities, which alternately trains a reinforcement learning model with a trainable reward setting to search high-quality relation paths, and a translation-based model to realize link prediction. Simultaneously, we propose a novel reward setting for the reinforcement learning model, which shares the parameters with the attention of the translation-based model, so that these parameters can not only measure the contributions of relation paths, but also guide agents to search relation paths that have high contributions for link prediction, forming mutual promotion. In experiments, we compare RLPath with the state-of-the-art link prediction methods. The results show that RLPath has competitive performance.
引用
收藏
页码:4715 / 4726
页数:12
相关论文
共 36 条
[1]   DBpedia - A crystallization point for the Web of Data [J].
Bizer, Christian ;
Lehmann, Jens ;
Kobilarov, Georgi ;
Auer, Soeren ;
Becker, Christian ;
Cyganiak, Richard ;
Hellmann, Sebastian .
JOURNAL OF WEB SEMANTICS, 2009, 7 (03) :154-165
[2]  
Bollacker K., 2008, SIGMOD, P1247
[3]  
Bordes Antoine, 2013, Advances in neural information processing systems
[4]  
Chen XL, 2019, AAAI CONF ARTIF INTE, P3363
[5]  
Das R., 2018, P 6 INT C LEARN REPR, P1
[6]  
Dettmers T, 2018, AAAI CONF ARTIF INTE, P1811
[7]   Knowledge Vault: A Web-Scale Approach to Probabilistic Knowledge Fusion [J].
Dong, Xin Luna ;
Gabrilovich, Evgeniy ;
Heitz, Geremy ;
Horn, Wilko ;
Lao, Ni ;
Murphy, Kevin ;
Strohmann, Thomas ;
Sun, Shaohua ;
Zhang, Wei .
PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, :601-610
[8]   Dynamic knowledge graph based fake-review detection [J].
Fang, Youli ;
Wang, Hong ;
Zhao, Lili ;
Yu, Fengping ;
Wang, Caiyu .
APPLIED INTELLIGENCE, 2020, 50 (12) :4281-4295
[9]  
Fu C, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P2672
[10]  
Gardner M., 2014, P 2014 C EMP METH NA, P397, DOI [DOI 10.3115/V1/D14-1044, 10.3115/v1/D14-1044]