Dynamic Graph Representation Learning for Spatio-Temporal Neuroimaging Analysis

被引:0
|
作者
Liu, Rui [1 ]
Hu, Yao [1 ]
Wu, Jibin [1 ]
Wong, Ka-Chun [2 ]
Huang, Zhi-An [3 ]
Huang, Yu-An [4 ]
Chen Tan, Kay [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Data Sci & Artificial Intelligence, Hong Kong, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong SAR, Peoples R China
[3] City Univ Hong Kong Dongguan, Dept Comp Sci, Dongguan 523000, Peoples R China
[4] Northwestern Polytech Univ, Sch Comp Sci, Xian 710000, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive learning; electroencephalography (EEG); functional near-infrared spectroscopy (fNIRS); graph neural networks; interpretable visualization; magnetic resonance imaging (MRI); self-attention; spatio-temporal dynamics;
D O I
10.1109/TCYB.2025.3531657
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Neuroimaging analysis aims to reveal the information-processing mechanisms of the human brain in a noninvasive manner. In the past, graph neural networks (GNNs) have shown promise in capturing the non-Euclidean structure of brain networks. However, existing neuroimaging studies focused primarily on spatial functional connectivity, despite temporal dynamics in complex brain networks. To address this gap, we propose a spatio-temporal interactive graph representation framework (STIGR) for dynamic neuroimaging analysis that encompasses different aspects from classification and regression tasks to interpretation tasks. STIGR leverages a dynamic adaptive-neighbor graph convolution network to capture the interrelationships between spatial and temporal dynamics. To address the limited global scope in graph convolutions, a self-attention module based on Transformers is introduced to extract long-term dependencies. Contrastive learning is used to adaptively contrast similarities between adjacent scanning windows, modeling cross-temporal correlations in dynamic graphs. Extensive experiments on six public neuroimaging datasets demonstrate the competitive performance of STIGR across different platforms, achieving state-of-the-art results in classification and regression tasks. The proposed framework enables the detection of remarkable temporal association patterns between regions of interest based on sequential neuroimaging signals, offering medical professionals a versatile and interpretable tool for exploring task-specific neurological patterns. Our codes and models are available at https://github.com/77YQ77/STIGR/.
引用
收藏
页码:1121 / 1134
页数:14
相关论文
共 50 条
  • [41] A Graph Model for Spatio-temporal Evolution
    Del Mondo, Geraldine
    Stell, John G.
    Claramunt, Christophe
    Thibaud, Remy
    JOURNAL OF UNIVERSAL COMPUTER SCIENCE, 2010, 16 (11) : 1452 - 1477
  • [42] Dynamic graph structure and spatio-temporal representations in wind power forecasting
    Zang, Peng
    Dong, Wenqi
    Wang, Jing
    Fu, Jianglong
    SCIENCE AND TECHNOLOGY FOR ENERGY TRANSITION, 2025, 80
  • [43] Spatio-Temporal Action Graph Networks
    Herzig, Roei
    Levi, Elad
    Xu, Huijuan
    Gao, Hang
    Brosh, Eli
    Wang, Xiaolong
    Globerson, Amir
    Darrell, Trevor
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2347 - 2356
  • [44] Discovering Dynamic Salient Regions for Spatio-Temporal Graph Neural Networks
    Duta, Iulia
    Nicolicioiu, Andrei
    Leordeanu, Marius
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [45] Dynamic Graph Neural Networks Under Spatio-Temporal Distribution Shift
    Zhang, Zeyang
    Wang, Xin
    Zhang, Ziwei
    Li, Haoyang
    Qin, Zhou
    Zhu, Wenwu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [46] Flow prediction via adaptive dynamic graph with spatio-temporal correlations
    Zhang, Hui
    Ding, Kun
    Xie, Jietao
    Xiao, Weidong
    Xie, Yuxiang
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 261
  • [48] Qualitative representation of spatio-temporal knowledge
    Della Penna, Giuseppe
    Orefice, Sergio
    JOURNAL OF VISUAL LANGUAGES AND COMPUTING, 2018, 49 : 1 - 16
  • [49] The Spatio-Temporal Representation of Natural Reading
    Wehbe, Leila
    PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), 2015, : 4407 - 4408
  • [50] Visual representation of spatio-temporal structure
    Schill, K
    Zetzsche, C
    Brauer, W
    Eisenkolb, A
    Musto, A
    HUMAN VISION AND ELECTRONIC IMAGING III, 1998, 3299 : 128 - 138