Dynamic Graph Representation Learning for Spatio-Temporal Neuroimaging Analysis

被引:0
|
作者
Liu, Rui [1 ]
Hu, Yao [1 ]
Wu, Jibin [1 ]
Wong, Ka-Chun [2 ]
Huang, Zhi-An [3 ]
Huang, Yu-An [4 ]
Chen Tan, Kay [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Data Sci & Artificial Intelligence, Hong Kong, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong SAR, Peoples R China
[3] City Univ Hong Kong Dongguan, Dept Comp Sci, Dongguan 523000, Peoples R China
[4] Northwestern Polytech Univ, Sch Comp Sci, Xian 710000, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive learning; electroencephalography (EEG); functional near-infrared spectroscopy (fNIRS); graph neural networks; interpretable visualization; magnetic resonance imaging (MRI); self-attention; spatio-temporal dynamics;
D O I
10.1109/TCYB.2025.3531657
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Neuroimaging analysis aims to reveal the information-processing mechanisms of the human brain in a noninvasive manner. In the past, graph neural networks (GNNs) have shown promise in capturing the non-Euclidean structure of brain networks. However, existing neuroimaging studies focused primarily on spatial functional connectivity, despite temporal dynamics in complex brain networks. To address this gap, we propose a spatio-temporal interactive graph representation framework (STIGR) for dynamic neuroimaging analysis that encompasses different aspects from classification and regression tasks to interpretation tasks. STIGR leverages a dynamic adaptive-neighbor graph convolution network to capture the interrelationships between spatial and temporal dynamics. To address the limited global scope in graph convolutions, a self-attention module based on Transformers is introduced to extract long-term dependencies. Contrastive learning is used to adaptively contrast similarities between adjacent scanning windows, modeling cross-temporal correlations in dynamic graphs. Extensive experiments on six public neuroimaging datasets demonstrate the competitive performance of STIGR across different platforms, achieving state-of-the-art results in classification and regression tasks. The proposed framework enables the detection of remarkable temporal association patterns between regions of interest based on sequential neuroimaging signals, offering medical professionals a versatile and interpretable tool for exploring task-specific neurological patterns. Our codes and models are available at https://github.com/77YQ77/STIGR/.
引用
收藏
页码:1121 / 1134
页数:14
相关论文
共 50 条
  • [31] Theme section on advances in spatio-temporal analysis and representation
    Peuquet, DJ
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2005, 60 (01) : 1 - 2
  • [32] TAP: Traffic Accident Profiling via Multi-Task Spatio-Temporal Graph Representation Learning
    Liu, Zhi
    Chen, Yang
    Xia, Feng
    Bian, Jixin
    Zhu, Bing
    Shen, Guojiang
    Kong, Xiangjie
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2023, 17 (04)
  • [33] Generative Causal Interpretation Model for Spatio-Temporal Representation Learning
    Zhao, Yu
    Deng, Pan
    Liu, Junting
    Jia, Xiaofeng
    Zhang, Jianwei
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 3537 - 3548
  • [34] Learning Spatio-temporal Representation by Channel Aliasing Video Perception
    Lin, Yiqi
    Wang, Jinpeng
    Zhang, Manlin
    Ma, Andy J.
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2317 - 2325
  • [35] Similar Trajectory Search with Spatio-Temporal Deep Representation Learning
    Tedjopurnomo, David Alexander
    Li, Xiucheng
    Bao, Zhifeng
    Cong, Gao
    Choudhury, Farhana
    Qin, A. K.
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2021, 12 (06)
  • [36] A Spatio-Temporal Linked Data Representation for Modeling Spatio-Temporal Dialect Data
    Scholz, Johannes
    Hrastnig, Emanual
    Wandl-Vogt, Eveline
    PROCEEDINGS OF WORKSHOPS AND POSTERS AT THE 13TH INTERNATIONAL CONFERENCE ON SPATIAL INFORMATION THEORY (COSIT 2017), 2018, : 275 - 282
  • [37] A dynamic graph representation learning based on temporal graph transformer
    Zhong, Ying
    Huang, Chenze
    ALEXANDRIA ENGINEERING JOURNAL, 2023, 63 : 359 - 369
  • [38] A dynamic graph representation learning based on temporal graph transformer
    Zhong, Ying
    Huang, Chenze
    ALEXANDRIA ENGINEERING JOURNAL, 2023, 63 : 359 - 369
  • [39] Novel Graph Topology Learning for Spatio-Temporal Analysis of COVID-19 Spread
    Shan, Baoling
    Yuan, Xin
    Ni, Wei
    Wang, Xin
    Liu, Ren Ping
    Dutkiewicz, Eryk
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (06) : 2693 - 2704
  • [40] Spatio-temporal learning and explaining for dynamic functional connectivity analysis: Application to depression
    Hu, Jinlong
    Luo, Jianmiao
    Xu, Ziyun
    Liao, Bin
    Dong, Shoubin
    Peng, Bo
    Hou, Gangqiang
    JOURNAL OF AFFECTIVE DISORDERS, 2024, 364 : 266 - 273