Dynamic Graph Representation Learning for Spatio-Temporal Neuroimaging Analysis

被引:0
|
作者
Liu, Rui [1 ]
Hu, Yao [1 ]
Wu, Jibin [1 ]
Wong, Ka-Chun [2 ]
Huang, Zhi-An [3 ]
Huang, Yu-An [4 ]
Chen Tan, Kay [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Data Sci & Artificial Intelligence, Hong Kong, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong SAR, Peoples R China
[3] City Univ Hong Kong Dongguan, Dept Comp Sci, Dongguan 523000, Peoples R China
[4] Northwestern Polytech Univ, Sch Comp Sci, Xian 710000, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive learning; electroencephalography (EEG); functional near-infrared spectroscopy (fNIRS); graph neural networks; interpretable visualization; magnetic resonance imaging (MRI); self-attention; spatio-temporal dynamics;
D O I
10.1109/TCYB.2025.3531657
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Neuroimaging analysis aims to reveal the information-processing mechanisms of the human brain in a noninvasive manner. In the past, graph neural networks (GNNs) have shown promise in capturing the non-Euclidean structure of brain networks. However, existing neuroimaging studies focused primarily on spatial functional connectivity, despite temporal dynamics in complex brain networks. To address this gap, we propose a spatio-temporal interactive graph representation framework (STIGR) for dynamic neuroimaging analysis that encompasses different aspects from classification and regression tasks to interpretation tasks. STIGR leverages a dynamic adaptive-neighbor graph convolution network to capture the interrelationships between spatial and temporal dynamics. To address the limited global scope in graph convolutions, a self-attention module based on Transformers is introduced to extract long-term dependencies. Contrastive learning is used to adaptively contrast similarities between adjacent scanning windows, modeling cross-temporal correlations in dynamic graphs. Extensive experiments on six public neuroimaging datasets demonstrate the competitive performance of STIGR across different platforms, achieving state-of-the-art results in classification and regression tasks. The proposed framework enables the detection of remarkable temporal association patterns between regions of interest based on sequential neuroimaging signals, offering medical professionals a versatile and interpretable tool for exploring task-specific neurological patterns. Our codes and models are available at https://github.com/77YQ77/STIGR/.
引用
收藏
页码:1121 / 1134
页数:14
相关论文
共 50 条
  • [1] Learning Dynamic Graph Representation of Brain Connectome with Spatio-Temporal Attention
    Kim, Byung-Hoon
    Ye, Jong Chul
    Kim, Jae-Jin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [2] Spatio-Temporal Graph Representation Learning for Fraudster Group Detection
    Shehnepoor, Saeedreza
    Togneri, Roberto
    Liu, Wei
    Bennamoun, Mohammed
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (05) : 6628 - 6642
  • [3] A hierarchical spatio-temporal object knowledge graph model for dynamic scene representation
    Zhao, Xinke
    Cao, Yibing
    Wang, Jiahe
    Fan, Xinhua
    Chen, Minjie
    TRANSACTIONS IN GIS, 2023, 27 (07) : 1992 - 2016
  • [4] A Spatio-Temporal Graph Model for Marine Dune Dynamics Analysis and Representation
    Thibaud, Remy
    Del Mondo, Geraldine
    Garlan, Thierry
    Mascret, Ariane
    Carpentier, Christophe
    TRANSACTIONS IN GIS, 2013, 17 (05) : 742 - 762
  • [5] Contextual spatio-temporal graph representation learning for reinforced human mobility mining
    Gao, Qiang
    Zhou, Fan
    Zhong, Ting
    Trajcevski, Goce
    Yang, Xin
    Li, Tianrui
    INFORMATION SCIENCES, 2022, 606 : 230 - 249
  • [6] Spatio-temporal Graph Learning for Epidemic Prediction
    Yu, Shuo
    Xia, Feng
    Li, Shihao
    Hou, Mingliang
    Sheng, Quan Z.
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2023, 14 (02)
  • [7] Dual Contrastive Learning for Spatio-temporal Representation
    Ding, Shuangrui
    Qian, Rui
    Xiong, Hongkai
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 5649 - 5658
  • [8] DYNAMIC SPATIO-TEMPORAL GRAPH CONVOLUTIONAL NETWORKS FOR CARDIAC MOTION ANALYSIS
    Lu, Ping
    Bai, Wenjia
    Rueckert, Daniel
    Noble, J. Alison
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 122 - 125
  • [9] Spatio-Temporal Dynamic Graph Relation Learning for Urban Metro Flow Prediction
    Xie, Peng
    Ma, Minbo
    Li, Tianrui
    Ji, Shenggong
    Du, Shengdong
    Yu, Zeng
    Zhang, Junbo
    arXiv, 2022,
  • [10] Spatio-Temporal Dynamic Graph Relation Learning for Urban Metro Flow Prediction
    Xie, Peng
    Ma, Minbo
    Li, Tianrui
    Ji, Shenggong
    Du, Shengdong
    Yu, Zeng
    Zhang, Junbo
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (10) : 9973 - 9984