Dynamic Graph Representation Learning for Spatio-Temporal Neuroimaging Analysis

被引:0
|
作者
Liu, Rui [1 ]
Hu, Yao [1 ]
Wu, Jibin [1 ]
Wong, Ka-Chun [2 ]
Huang, Zhi-An [3 ]
Huang, Yu-An [4 ]
Chen Tan, Kay [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Data Sci & Artificial Intelligence, Hong Kong, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong SAR, Peoples R China
[3] City Univ Hong Kong Dongguan, Dept Comp Sci, Dongguan 523000, Peoples R China
[4] Northwestern Polytech Univ, Sch Comp Sci, Xian 710000, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive learning; electroencephalography (EEG); functional near-infrared spectroscopy (fNIRS); graph neural networks; interpretable visualization; magnetic resonance imaging (MRI); self-attention; spatio-temporal dynamics;
D O I
10.1109/TCYB.2025.3531657
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Neuroimaging analysis aims to reveal the information-processing mechanisms of the human brain in a noninvasive manner. In the past, graph neural networks (GNNs) have shown promise in capturing the non-Euclidean structure of brain networks. However, existing neuroimaging studies focused primarily on spatial functional connectivity, despite temporal dynamics in complex brain networks. To address this gap, we propose a spatio-temporal interactive graph representation framework (STIGR) for dynamic neuroimaging analysis that encompasses different aspects from classification and regression tasks to interpretation tasks. STIGR leverages a dynamic adaptive-neighbor graph convolution network to capture the interrelationships between spatial and temporal dynamics. To address the limited global scope in graph convolutions, a self-attention module based on Transformers is introduced to extract long-term dependencies. Contrastive learning is used to adaptively contrast similarities between adjacent scanning windows, modeling cross-temporal correlations in dynamic graphs. Extensive experiments on six public neuroimaging datasets demonstrate the competitive performance of STIGR across different platforms, achieving state-of-the-art results in classification and regression tasks. The proposed framework enables the detection of remarkable temporal association patterns between regions of interest based on sequential neuroimaging signals, offering medical professionals a versatile and interpretable tool for exploring task-specific neurological patterns. Our codes and models are available at https://github.com/77YQ77/STIGR/.
引用
收藏
页码:1121 / 1134
页数:14
相关论文
共 50 条
  • [21] Continuous-time dynamic graph learning based on spatio-temporal random walks
    Sheng, Jinfang
    Zhang, Yifan
    Wang, Bin
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (02):
  • [22] Multiview Spatio-Temporal Learning With Dual Dynamic Graph Convolutional Networks for Rumor Detection
    Huang, Xuejian
    Ma, Tinghuai
    Jin, Wenwen
    Rong, Huan
    Jia, Li
    Yang, Bin
    Xie, Xintong
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2025,
  • [23] Graph Representation for Weakly-Supervised Spatio-Temporal Action Detection
    Singh, Dinesh
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [24] Dynamic Adaptive Spatio-Temporal Graph Convolution for fMRI Modelling
    El-Gazzar, Ahmed
    Thomas, Rajat Mani
    van Wingen, Guido
    MACHINE LEARNING IN CLINICAL NEUROIMAGING, 2021, 13001 : 125 - 134
  • [25] Spatio-Temporal Knowledge Graph for Meteorological Risk Analysis
    Chen, Jiahui
    Zhong, Shaobo
    Ge, Xingtong
    Li, Weichao
    Zhu, Hanjiang
    Peng, Ling
    2021 21ST INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY COMPANION (QRS-C 2021), 2021, : 440 - 447
  • [26] Spatio-Temporal Latent Graph Structure Learning for Traffic Forecasting
    Tang, Jiabin
    Qian, Tang
    Liu, Shijing
    Du, Shengdong
    Hu, Jie
    Li, Tianrui
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [27] Spatio-Temporal Latent Graph Structure Learning for Traffic Forecasting
    Tang, Jiabin
    Qian, Tang
    Liu, Shijing
    Du, Shengdong
    Hu, Jie
    Li, Tianrui
    Proceedings of the International Joint Conference on Neural Networks, 2022, 2022-July
  • [28] Adaptive Spatio-temporal Graph Learning for Bus Station Profiling
    Hou, Minghang
    Xia, Feng
    Chen, Xin
    Saikrishna, Vidta
    Chen, Hong long
    ACM TRANSACTIONS ON SPATIAL ALGORITHMS AND SYSTEMS, 2024, 10 (03)
  • [29] Graph signal reconstruction based on spatio-temporal features learning
    Yang, Jie
    Shi, Ce
    Chu, Yueyan
    Guo, Wenbin
    DIGITAL SIGNAL PROCESSING, 2024, 148
  • [30] Spatio-Temporal Meta-Graph Learning for Traffic Forecasting
    Jiang, Renhe
    Wang, Zhaonan
    Yong, Jiawei
    Jeph, Puneet
    Chen, Quanjun
    Kobayashi, Yasumasa
    Song, Xuan
    Fukushima, Shintaro
    Suzumura, Toyotaro
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 7, 2023, : 8078 - 8086