CDRGN-SDE: Cross-Dimensional Recurrent Graph Network with neural Stochastic Differential Equation for temporal knowledge graph embedding

被引:8
作者
Zhang, Dong [1 ]
Feng, Wenlong [1 ]
Wu, Zonghang [1 ]
Li, Guanyu [1 ]
Ning, Bo [1 ]
机构
[1] Dalian Maritime Univ, Informat Sci & Technol Coll, Dalian 116026, Liaoning, Peoples R China
关键词
Temporal knowledge graph; Temporal reasoning; Representation learning; Stochastic Differential Equation;
D O I
10.1016/j.eswa.2024.123295
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The temporal knowledge graph builds upon the static knowledge graph by introducing the time dimension and finds extensive applications in real artificial intelligence scenarios. However, the temporal knowledge graph's incompleteness restricts the applicability of numerous temporal knowledge graph tasks. Temporal knowledge graph embedding (TKGE) is a representation learning technique that effectively addresses the temporal knowledge graph's incompleteness. These methods aim to map entities and relations in the knowledge graph to a low -dimensional vector space while capturing features over time. However, the current TKGE methods encounter three main challenges: (1) how to resolve the continuity problem of dynamic features in the continuous time domain; (2) how to simultaneously model the dependence of structural knowledge representation on time and dimension; (3) how to address the heterogeneity of time representation in a temporal knowledge graph. We propose the CDRGN-SDE, a Cross -Dimensional Recurrent Graph Network with a neural Stochastic Differential Equation framework, to tackle these challenges. The CDRGN-SDE model effectively addresses the above challenges and establishes a unified framework: (1) we employ a neural ordinary differential equation with stochastic noise to simulate the continuity of dynamic systems in the continuous time domain; (2) we propose a Dimension -Segment -Wise (DSW) embedding method for TKGE, which effectively integrates time and dimensional information; (3) we introduce a simple and effective time representation method that integrates complex time features into the model. Experimental evaluations on benchmark datasets demonstrate that the CDRGN-SDE model outperforms the state-of-the-art temporal knowledge graph reasoning models.
引用
收藏
页数:15
相关论文
共 56 条
  • [31] Oksendal B., 2003, STOCHASTIC DIFFERENT, P65, DOI [DOI 10.1007/978-3-642-14394-6_5, 10.1007/978-3-642-14394-6-5, DOI 10.1007/978-3-642-14394-6-5]
  • [32] Continuous-Time Link Prediction via Temporal Dependent Graph Neural Network
    Qu, Liang
    Zhu, Huaisheng
    Duan, Qiqi
    Shi, Yuhui
    [J]. WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, : 3026 - 3032
  • [33] Modeling Relational Data with Graph Convolutional Networks
    Schlichtkrull, Michael
    Kipf, Thomas N.
    Bloem, Peter
    van den Berg, Rianne
    Titov, Ivan
    Welling, Max
    [J]. SEMANTIC WEB (ESWC 2018), 2018, 10843 : 593 - 607
  • [34] Structured Sequence Modeling with Graph Convolutional Recurrent Networks
    Seo, Youngjoo
    Defferrard, Michael
    Vandergheynst, Pierre
    Bresson, Xavier
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2018), PT I, 2018, 11301 : 362 - 373
  • [35] Shang C, 2019, AAAI CONF ARTIF INTE, P3060
  • [36] Tucker decomposition-based temporal knowledge graph completion
    Shao, Pengpeng
    Zhang, Dawei
    Yang, Guohua
    Tao, Jianhua
    Che, Feihu
    Liu, Tong
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 238
  • [37] Sun H., 2022, P 2022 C EMPIRICAL M, P7481
  • [38] Sun Z., 2019, P 7 INT C LEARN REPR, DOI DOI 10.48550/ARXIV.1902.10197
  • [39] Trivedi R., 2019, ICLR
  • [40] Trivedi R, 2017, PR MACH LEARN RES, V70