Multi-Concept Representation Learning for Knowledge Graph Completion

被引:14
作者
Wang, Jiapu [1 ]
Wang, Boyue [1 ]
Gao, Junbin [2 ]
Hu, Yongli [1 ]
Yin, Baocai [1 ]
机构
[1] Beijing Univ Technol, Beijing Artificial Intelligence Inst, Fac Informat Technol, Beijing Municipal Key Lab Multimedia & Intelligen, Beijing 100124, Peoples R China
[2] Univ Sydney, Discipline Business Analyt, Business Sch, Sydney, NSW 2006, Australia
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Knowledge graph completion; attention network; multi-concept representation;
D O I
10.1145/3533017
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Knowledge Graph Completion (KGC) aims at inferring missing entities or relations by embedding them in a low-dimensional space. However, most existing KGC methods generally fail to handle the complex concepts hidden in triplets, so the learned embeddings of entities or relations may deviate from the true situation. In this article, we propose a novel Multi-concept Representation Learning (McRL) method for the KGC task, which mainly consists of a multi-concept representation module, a deep residual attention module, and an interaction embedding module. Specifically, instead of the single-feature representation, the multi-concept representation module projects each entity or relation to multiple vectors to capture the complex conceptual information hidden in them. The deep residual attention module simultaneously explores the inter- and intra-connection between entities and relations to enhance the entity and relation embeddings corresponding to the current contextual situation. Moreover, the interaction embedding module further weakens the noise and ambiguity to obtain the optimal and robust embeddings. We conduct the link prediction experiment to evaluate the proposed method on several standard datasets, and experimental results show that the proposed method outperforms existing state-of-the-art KGC methods.
引用
收藏
页数:19
相关论文
共 52 条
  • [1] [Anonymous], 2015, P INT C LEARN REPR I
  • [2] TPmod: A Tendency-Guided Prediction Model for Temporal Knowledge Graph Completion
    Bai, Luyi
    Ma, Xiangnan
    Zhang, Mingcheng
    Yu, Wenting
    [J]. ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2021, 15 (03)
  • [3] Balazevic I, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P5185
  • [4] Hypernetwork Knowledge Graph Embeddings
    Balazevic, Ivana
    Allen, Carl
    Hospedales, Timothy M.
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: WORKSHOP AND SPECIAL SESSIONS, 2019, 11731 : 553 - 565
  • [5] Bansal T, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P4387
  • [6] Bollacker Kurt, 2008, Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, DOI [DOI 10.1145/1376616.1376746, 10.1145/1376616.1376746]
  • [7] Bordes Antoine, 2014, 2014 C EMPIRICAL MET, P615, DOI DOI 10.3115/V1/D14-1067
  • [8] Bordes Antoine, 2013, PROCADV NEURAL INF P, V26
  • [9] Cao ZS, 2022, AAAI CONF ARTIF INTE, P5521
  • [10] Cao ZS, 2021, AAAI CONF ARTIF INTE, V35, P6894