Modeling relation paths for knowledge base completion via joint adversarial training

被引:5
作者
Li, Chen [1 ,2 ]
Peng, Xutan [1 ,2 ]
Zhang, Shanghang [3 ]
Peng, Hao [1 ,2 ]
Yu, Philip S. [4 ]
He, Min [5 ]
Du, Linfeng [1 ]
Wang, Lihong [5 ]
机构
[1] Beihang Univ, Beijing Adv Innovat Ctr Big Data & Brain Comp, Beijing, Peoples R China
[2] Beihang Univ, State Key Lab Software Dev Environm Lab, Beijing, Peoples R China
[3] Carnegie Mellon Univ, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA
[4] Univ Illinois, Dept Comp Sci, Chicago, IL USA
[5] Natl Comp Network Emergency Response Tech Team Co, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
Joint adversarial training; Hierarchical attention mechanism; Knowledge base completion;
D O I
10.1016/j.knosys.2020.105865
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge Base Completion (KBC), which aims at determining the missing relations between entity pairs, has received increasing attention in recent years. Most existing KBC methods focus on either embedding the Knowledge Base (KB) into a specific semantic space or leveraging the joint probability of Random Walks (RWs) on multi-hop paths. Only a few unified models take both semantic and path-related features into consideration with adequacy. In this paper, we propose a novel method to explore the intrinsic relationship between the single relation (i.e. 1-hop path) and multi-hop paths between paired entities. We use Hierarchical Attention Networks (HANs) to select important relations in multi-hop paths and encode them into low-dimensional vectors. By treating relations and multi-hop paths as two different input sources, we use a feature extractor, which is shared by two downstream components (i.e. relation classifier and source discriminator), to capture shared/similar information between them. By joint adversarial training, we encourage our model to extract features from the multi-hop paths which are representative for relation completion. We apply the trained model (except for the source discriminator) to several large-scale KBs for relation completion. Experimental results show that our method outperforms existing path information-based approaches. Since each sub-module of our model can be well interpreted, our model can be applied to a large number of relation learning tasks. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 47 条
  • [1] [Anonymous], [No title captured]
  • [2] [Anonymous], 2015, ADV NEURAL INFORM PR
  • [3] [Anonymous], 2016, P 2016 C EMP METH NA, DOI DOI 10.18653/V1/D16-1145
  • [4] [Anonymous], 2014, ABS14090473 CORR
  • [5] [Anonymous], 2015, P 3 INT C LEARNING R
  • [6] Arjovsky Martin, 2017, ABS170104862 CORR
  • [7] Easy Access to the Freebase Dataset
    Bast, Hannah
    Baeurle, Florian
    Buchhold, Bjorn
    Haussmann, Elmar
    [J]. WWW'14 COMPANION: PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON WORLD WIDE WEB, 2014, : 95 - 98
  • [8] Bollacker K., 2008, P 2008 ACM SIGMOD IN, P1247, DOI [DOI 10.1145/1376616.1376746, DOI 10.5555/1619797.1619981]
  • [9] Bordes A., 2011, P 25 AAAI C ART INT
  • [10] Bordes A., 2015, P C EMP METH NAT LAN, P286