Self-Supervised Temporal Graph Learning With Temporal and Structural Intensity Alignment

被引:31
|
作者
Liu, Meng [1 ]
Liang, Ke [1 ]
Zhao, Yawei [2 ]
Tu, Wenxuan [1 ]
Gan, Xinbiao [1 ]
Zhou, Sihang [3 ]
Liu, Xinwang [1 ]
He, Kunlun [2 ]
机构
[1] Natl Univ Def Technol, Sch Comp, Changsha 410073, Peoples R China
[2] Chinese Peoples Liberat Army Gen Hosp, Med Big Data Res Ctr, Beijing 100853, Peoples R China
[3] Natl Univ Def Technol, Coll Intelligence Sci & Technol, Changsha 410073, Peoples R China
关键词
Task analysis; Learning systems; Data mining; Vectors; Feature extraction; Medical diagnostic imaging; Industries; Conditional intensity alignment; self-supervised learning; temporal graph learning; NETWORK;
D O I
10.1109/TNNLS.2024.3386168
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Temporal graph learning aims to generate high-quality representations for graph-based tasks with dynamic information, which has recently garnered increasing attention. In contrast to static graphs, temporal graphs are typically organized as node interaction sequences over continuous time rather than an adjacency matrix. Most temporal graph learning methods model current interactions by incorporating historical neighborhood. However, such methods only consider first-order temporal information while disregarding crucial high-order structural information, resulting in suboptimal performance. To address this issue, we propose a self-supervised method called S2T for temporal graph learning, which extracts both temporal and structural information to learn more informative node representations. Notably, the initial node representations combine first-order temporal and high-order structural information differently to calculate two conditional intensities. An alignment loss is then introduced to optimize the node representations, narrowing the gap between the two intensities and making them more informative. Concretely, in addition to modeling temporal information using historical neighbor sequences, we further consider structural knowledge at both local and global levels. At the local level, we generate structural intensity by aggregating features from high-order neighbor sequences. At the global level, a global representation is generated based on all nodes to adjust the structural intensity according to the active statuses on different nodes. Extensive experiments demonstrate that the proposed model S2T achieves at most 10.13% performance improvement compared with the state-of-the-art competitors on several datasets.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [21] Rethinking self-supervised learning for time series forecasting: A temporal perspective
    Zhao, Shubao
    Zhou, Xinxing
    Jin, Ming
    Hou, Zhaoxiang
    Yang, Chengyi
    Li, Zengxiang
    Wen, Qingsong
    Wang, Yi
    Wen, Yanlong
    Yuan, Xiaojie
    KNOWLEDGE-BASED SYSTEMS, 2024, 305
  • [22] Self-Supervised Learning for Rolling Shutter Temporal Super-Resolution
    Fan, Bin
    Guo, Ying
    Dai, Yuchao
    Xu, Chao
    Shi, Boxin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 769 - 782
  • [23] Temporal Self-Supervised Learning for RSSI-based Indoor Localization
    Paulavicius, Jonas
    Jardak, Seifallah
    McConville, Ryan
    Piechocki, Robert
    Santos-Rodriguez, Raul
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 3046 - 3051
  • [24] Spatial and temporal features unified self-supervised representation learning networks
    Choudhary, Rahul
    Walambe, Rahee
    Kotecha, Ketan
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2022, 157
  • [25] Video Cloze Procedure for Self-Supervised Spatio-Temporal Learning
    Luo, Dezhao
    Liu, Chang
    Zhou, Yu
    Yang, Dongbao
    Ma, Can
    Ye, Qixiang
    Wang, Weiping
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11701 - 11708
  • [26] Spatial-Temporal Hypergraph Self-Supervised Learning for Crime Prediction
    Li, Zhonghang
    Huang, Chao
    Xia, Lianghao
    Xu, Yong
    Pei, Jian
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 2984 - 2996
  • [27] Spatio-Temporal Self-Supervised Learning for Traffic Flow Prediction
    Ji, Jiahao
    Wang, Jingyuan
    Huang, Chao
    Wu, Junjie
    Xu, Boren
    Wu, Zhenhe
    Zhang, Junbo
    Zheng, Yu
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 4, 2023, : 4356 - 4364
  • [28] Self-supervised Graph Learning with Segmented Graph Channels
    Gao, Hang
    Li, Jiangmeng
    Zheng, Changwen
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT II, 2023, 13714 : 293 - 308
  • [29] SELF-SUPERVISED TEMPORAL ANALYSIS OF SPATIOTEMPORAL DATA
    Cao, Yi
    Ganguli, Swetava
    Pandey, Vipul
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 4856 - 4859
  • [30] Self-Supervised Learning for Alignment of Objects and Sound
    Liu, Xinzhu
    Liu, Xiaoyu
    Guo, Di
    Liu, Huaping
    Sun, Fuchun
    Min, Haibo
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 1588 - 1594