Self-Supervised Temporal Graph Learning With Temporal and Structural Intensity Alignment

被引:31
|
作者
Liu, Meng [1 ]
Liang, Ke [1 ]
Zhao, Yawei [2 ]
Tu, Wenxuan [1 ]
Gan, Xinbiao [1 ]
Zhou, Sihang [3 ]
Liu, Xinwang [1 ]
He, Kunlun [2 ]
机构
[1] Natl Univ Def Technol, Sch Comp, Changsha 410073, Peoples R China
[2] Chinese Peoples Liberat Army Gen Hosp, Med Big Data Res Ctr, Beijing 100853, Peoples R China
[3] Natl Univ Def Technol, Coll Intelligence Sci & Technol, Changsha 410073, Peoples R China
关键词
Task analysis; Learning systems; Data mining; Vectors; Feature extraction; Medical diagnostic imaging; Industries; Conditional intensity alignment; self-supervised learning; temporal graph learning; NETWORK;
D O I
10.1109/TNNLS.2024.3386168
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Temporal graph learning aims to generate high-quality representations for graph-based tasks with dynamic information, which has recently garnered increasing attention. In contrast to static graphs, temporal graphs are typically organized as node interaction sequences over continuous time rather than an adjacency matrix. Most temporal graph learning methods model current interactions by incorporating historical neighborhood. However, such methods only consider first-order temporal information while disregarding crucial high-order structural information, resulting in suboptimal performance. To address this issue, we propose a self-supervised method called S2T for temporal graph learning, which extracts both temporal and structural information to learn more informative node representations. Notably, the initial node representations combine first-order temporal and high-order structural information differently to calculate two conditional intensities. An alignment loss is then introduced to optimize the node representations, narrowing the gap between the two intensities and making them more informative. Concretely, in addition to modeling temporal information using historical neighbor sequences, we further consider structural knowledge at both local and global levels. At the local level, we generate structural intensity by aggregating features from high-order neighbor sequences. At the global level, a global representation is generated based on all nodes to adjust the structural intensity according to the active statuses on different nodes. Extensive experiments demonstrate that the proposed model S2T achieves at most 10.13% performance improvement compared with the state-of-the-art competitors on several datasets.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [31] Multilingual Knowledge Graph Completion with Self-Supervised Adaptive Graph Alignment
    Huang, Zijie
    Li, Zheng
    Jiang, Haoming
    Cao, Tianyu
    Lu, Hanqing
    Yin, Bing
    Subbian, Karthik
    Sun, Yizhou
    Wang, Wei
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 474 - 485
  • [32] Hierarchical Dynamic Spatio-Temporal Graph Convolutional Networks with Self-Supervised Learning for Traffic Flow Forecasting
    Wei, Siwei
    Song, Yanan
    Liu, Donghua
    Shen, Sichen
    Gao, Rong
    Wang, Chunzhi
    INVENTIONS, 2024, 9 (05)
  • [33] Graph Self-supervised Learning with Accurate Discrepancy Learning
    Kim, Dongki
    Baek, Jinheon
    Hwang, Sung Ju
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [34] Self-Supervised Bidirectional Learning for Graph Matching
    Guo, Wenqi
    Zhang, Lin
    Tu, Shikui
    Xu, Lei
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 6, 2023, : 7784 - 7792
  • [35] Adaptive Self-Supervised Graph Representation Learning
    Gong, Yunchi
    36TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2022), 2022, : 254 - 259
  • [36] Contrastive Self-supervised Learning for Graph Classification
    Zeng, Jiaqi
    Xie, Pengtao
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10824 - 10832
  • [37] Dynamic Spatio-Temporal Graph Reasoning for VideoQA With Self-Supervised Event Recognition
    Nie, Jie
    Wang, Xin
    Hou, Runze
    Li, Guohao
    Chen, Hong
    Zhu, Wenwu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4145 - 4158
  • [38] Self-supervised Adaptive Aggregator Learning on Graph
    Lin, Bei
    Luo, Binli
    He, Jiaojiao
    Gui, Ning
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2021, PT III, 2021, 12714 : 29 - 41
  • [39] Self-supervised Learning of Visual Graph Matching
    Liu, Chang
    Zhang, Shaofeng
    Yang, Xiaokang
    Yan, Junchi
    COMPUTER VISION, ECCV 2022, PT XXIII, 2022, 13683 : 370 - 388
  • [40] Self-supervised dual graph learning for recommendation
    Li, Anchen
    Yang, Bo
    Huo, Huan
    Hussain, Farookh Khadeer
    Xu, Guandong
    KNOWLEDGE-BASED SYSTEMS, 2025, 310