Multi-Scale Dynamic Convolutional Network for Knowledge Graph Embedding

被引:101
作者
Zhang, Zhaoli [1 ]
Li, Zhifei [1 ]
Liu, Hai [1 ]
Xiong, Neal N. [2 ]
机构
[1] Cent China Normal Univ, Natl Engn Res Ctr E Learning, Wuhan 430079, Hubei, Peoples R China
[2] Cent China Normal Univ, Natl Engn Lab Educ Big Data, Wuhan 430079, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Computational modeling; Convolution; Semantics; Predictive models; Feature extraction; Knowledge engineering; Computer architecture; Knowledge graphs; knowledge graph embedding; complex relations; link prediction; convolutional network;
D O I
10.1109/TKDE.2020.3005952
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graphs are large graph-structured knowledge bases with incomplete or partial information. Numerous studies have focused on knowledge graph embedding to identify the embedded representation of entities and relations, thereby predicting missing relations between entities. Previous embedding models primarily regard (subject entity, relation, and object entity) triplet as translational distance or semantic matching in vector space. However, these models only learn a few expressive features and hard to handle complex relations, i.e., 1-to-N, N-to-1, and N-to-N, in knowledge graphs. To overcome these issues, we introduce a multi-scale dynamic convolutional network (M-DCN) model for knowledge graph embedding. This model features topnotch performance and an ability to generate richer and more expressive feature embeddings than its counterparts. The subject entity and relation embeddings in M-DCN are composed in an alternating pattern in the input layer, which helps extract additional feature interactions and increase the expressiveness. Multi-scale filters are generated in the convolution layer to learn different characteristics among input embeddings. Specifically, the weights of these filters are dynamically related to each relation to model complex relations. The performance of M-DCN on the five benchmark datasets is tested via experiments. Results show that the model can effectively handle complex relations and achieve state-of-the-art link prediction results on most evaluation metrics.
引用
收藏
页码:2335 / 2347
页数:13
相关论文
共 50 条
  • [1] Bollacker K., 2008, SIGMOD C, P1247, DOI [10.1145/1376616.1376746, DOI 10.1145/1376616.1376746]
  • [2] Bordes A., 2013, P 26 INT C NEUR INF, V2, P2787
  • [3] Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences
    Cao, Yixin
    Wang, Xiang
    He, Xiangnan
    Hu, Zikun
    Chua, Tat-Seng
    [J]. WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 151 - 161
  • [4] Dettmers T, 2018, AAAI CONF ARTIF INTE, P1811
  • [5] Generalized Translation-Based Embedding of Knowledge Graph
    Ebisu, Takuma
    Ichise, Ryutaro
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2020, 32 (05) : 941 - 951
  • [6] Ebisu T, 2018, AAAI CONF ARTIF INTE, P1819
  • [7] Glorot X, 2010, P 13 INT C ARTIFICIA, P249
  • [8] Knowledge graph embedding with concepts
    Guan, Niannian
    Song, Dandan
    Liao, Lejian
    [J]. KNOWLEDGE-BASED SYSTEMS, 2019, 164 : 38 - 44
  • [9] Guo S, 2018, AAAI CONF ARTIF INTE, P4816
  • [10] SSE: Semantically Smooth Embedding for Knowledge Graphs
    Guo, Shu
    Wang, Quan
    Wang, Bin
    Wang, Lihong
    Guo, Li
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2017, 29 (04) : 884 - 897