Fuse-Former: An interpretability analysis model for rs-fMRI based on multi-scale information fusion interaction

被引:1
|
作者
Ye, Jiayu [1 ]
Li, Yanting [1 ]
Zeng, An [1 ]
Pan, Dan [2 ]
机构
[1] Guangdong Univ Technol, Sch Comp Sci, Guangzhou 510006, Peoples R China
[2] Guangdong Polytech Normal Univ, Sch Elect & Informat, Guangzhou 510665, Peoples R China
基金
加拿大健康研究院; 美国国家卫生研究院;
关键词
Multi-scale information; rs-fMRI; Interpretability; Attention; MILD COGNITIVE IMPAIRMENT; ALZHEIMERS-DISEASE; BRAIN NETWORKS; CLASSIFICATION; IDENTIFICATION;
D O I
10.1016/j.bspc.2024.107471
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Resting-state functional magnetic resonance imaging (rs-fMRI), as a non-invasive neuroimaging technique, is widely used in the auxiliary diagnosis of brain diseases. However, existing deep learning-based methods are often not sensitive to the exploration of multi-scale temporal features, especially lacking effective utilization of information regarding blood oxygen level dependent (BOLD) level changes over short periods of time. Hence, we propose a brain disease recognition and analysis model for rs-fMRI based on multi-scale information fusion interaction (Fuse-Former). The design of Fuse-Former adopts a global-local model architecture. The model divides the brain into different regions of interest (ROI) using an external atlas and extracts regional BOLD response information as feature inputs. The global feature extraction module extracts features from the entire sequence through window information interaction and token fusion. The local feature extraction module proposes a KL distribution attention mechanism, which effectively selects key window time series features. It closely focuses on the subtle changes in BOLD response information during rest state. Moreover, Fuse-Former designs an interpretable module based on clustering, which unsupervisedly aggregates ROI in rs-fMRI that have similar effects on disease recognition and analyzes the correlation between ROI in each cluster. Fuse- Former model attains an accuracy of 0.738 and an AUC of 0.798 on the ADNI, and an accuracy of 0.743 and an AUC of 0.808 on the ABIDE I. When compared to advanced benchmark models, it exhibits substantial performance enhancements. Through the utilization of an interpretability module, we identify that the Dorsal Attention Network, Limbic Network, and Salience/Ventral Attention Network are particularly influential in the ADNI, whereas the Visual Network and Somatomotor Network are more significant in the ABIDE I. The experimental results demonstrate that brain network connectivity patterns exhibit significant differences across various pathologies. In terms of clustering structure, the ROIs for autism spectrum disorder (ASD) exhibit a more complex feature space distribution. Code is available at https://github.com/yjy-97/Fuse-Former.
引用
收藏
页数:11
相关论文
共 24 条
  • [21] An intelligent fault diagnosis model for rotating machinery based on multi-scale higher order singular spectrum analysis and GA-VPMCD
    Luo, Songrong
    Cheng, Junsheng
    Zeng, Ming
    Yang, Yu
    MEASUREMENT, 2016, 87 : 38 - 50
  • [22] Multi-scale spatio-temporal analysis of soil conservation service based on MGWR model: A case of Beijing-Tianjin-Hebei, China
    Rong, Yuejing
    Li, Kai
    Guo, Jiawei
    Zheng, Lifu
    Luo, Yue
    Yan, Yan
    Wang, Chenxing
    Zhao, Chunli
    Shang, Xu
    Wang, Zetong
    ECOLOGICAL INDICATORS, 2022, 139
  • [23] 6mAPred-MSFF: A Deep Learning Model for Predicting DNA N6-Methyladenine Sites across Species Based on a Multi-Scale Feature Fusion Mechanism
    Zeng, Rao
    Liao, Minghong
    APPLIED SCIENCES-BASEL, 2021, 11 (16):
  • [24] EMD-based analysis of complexity with dissociated EEG amplitude and frequency information: a data-driven robust tool-for Autism diagnosis- to multi-scale
    Abdulhay, Enas
    Alafeef, Maha
    Hadoush, Hikmat
    Venkataraman, V.
    Arunkumar, N.
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2022, 19 (05) : 5031 - 5054