Multi-Scale Dynamic Convolutional Network for Knowledge Graph Embedding

被引:101
作者
Zhang, Zhaoli [1 ]
Li, Zhifei [1 ]
Liu, Hai [1 ]
Xiong, Neal N. [2 ]
机构
[1] Cent China Normal Univ, Natl Engn Res Ctr E Learning, Wuhan 430079, Hubei, Peoples R China
[2] Cent China Normal Univ, Natl Engn Lab Educ Big Data, Wuhan 430079, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Computational modeling; Convolution; Semantics; Predictive models; Feature extraction; Knowledge engineering; Computer architecture; Knowledge graphs; knowledge graph embedding; complex relations; link prediction; convolutional network;
D O I
10.1109/TKDE.2020.3005952
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graphs are large graph-structured knowledge bases with incomplete or partial information. Numerous studies have focused on knowledge graph embedding to identify the embedded representation of entities and relations, thereby predicting missing relations between entities. Previous embedding models primarily regard (subject entity, relation, and object entity) triplet as translational distance or semantic matching in vector space. However, these models only learn a few expressive features and hard to handle complex relations, i.e., 1-to-N, N-to-1, and N-to-N, in knowledge graphs. To overcome these issues, we introduce a multi-scale dynamic convolutional network (M-DCN) model for knowledge graph embedding. This model features topnotch performance and an ability to generate richer and more expressive feature embeddings than its counterparts. The subject entity and relation embeddings in M-DCN are composed in an alternating pattern in the input layer, which helps extract additional feature interactions and increase the expressiveness. Multi-scale filters are generated in the convolution layer to learn different characteristics among input embeddings. Specifically, the weights of these filters are dynamically related to each relation to model complex relations. The performance of M-DCN on the five benchmark datasets is tested via experiments. Results show that the model can effectively handle complex relations and achieve state-of-the-art link prediction results on most evaluation metrics.
引用
收藏
页码:2335 / 2347
页数:13
相关论文
共 50 条
  • [31] Nguyen D. Q., 2018, P 16 C N AM CHAPT AS, P327, DOI DOI 10.18653/V1/N18-2053
  • [32] Nickel M., 2011, P 28 INT C MACH LEAR
  • [33] Nickel M, 2016, AAAI CONF ARTIF INTE, P1955
  • [34] Paszke A., 2017, P NIPS W LONG BEACH, P4
  • [35] Modeling Relational Data with Graph Convolutional Networks
    Schlichtkrull, Michael
    Kipf, Thomas N.
    Bloem, Peter
    van den Berg, Rianne
    Titov, Ivan
    Welling, Max
    [J]. SEMANTIC WEB (ESWC 2018), 2018, 10843 : 593 - 607
  • [36] Srivastava N, 2014, J MACH LEARN RES, V15, P1929
  • [37] Suchanek F. M., 2007, P 16 INT C WORLD WID, P697, DOI 10.1145/1242572.1242667
  • [38] Sun Z., 2019, INT C LEARNING REPRE
  • [39] Rethinking the Inception Architecture for Computer Vision
    Szegedy, Christian
    Vanhoucke, Vincent
    Ioffe, Sergey
    Shlens, Jon
    Wojna, Zbigniew
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2818 - 2826
  • [40] Toutanova K, 2015, P 3 WORKSHOP CONTINU, DOI DOI 10.18653/V1/W15-4007