Deep Multi-modal Latent Representation Learning for Automated Dementia Diagnosis

被引:19
作者
Zhou, Tao [1 ]
Liu, Mingxia [2 ,3 ]
Fu, Huazhu [1 ]
Wang, Jun [4 ]
Shen, Jianbing [1 ]
Shao, Ling [1 ]
Shen, Dinggang [2 ,3 ]
机构
[1] Incept Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates
[2] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27515 USA
[3] Univ N Carolina, BRIC, Chapel Hill, NC 27515 USA
[4] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Sch Commun & Informat Engn, Shanghai, Peoples R China
来源
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT IV | 2019年 / 11767卷
关键词
MILD COGNITIVE IMPAIRMENT;
D O I
10.1007/978-3-030-32251-9_69
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Effective fusion of multi-modality neuroimaging data, such as structural magnetic resonance imaging (MRI) and fluorodeoxyglucose positron emission tomography (PET), has attracted increasing interest in computer-aided brain disease diagnosis, by providing complementary structural and functional information of the brain to improve diagnostic performance. Although considerable progress has been made, there remain several significant challenges in traditional methods for fusing multi-modality data. First, the fusion of multi-modality data is usually independent of the training of diagnostic models, leading to suboptimal performance. Second, it is challenging to effectively exploit the complementary information among multiple modalities based on low-level imaging features (e.g., image intensity or tissue volume). To this end, in this paper, we propose a novel Deep Latent Multi-modality Dementia Diagnosis (DLMD2) framework based on a deep non-negative matrix factorization (NMF) model. Specifically, we integrate the feature fusion/learning process into the classifier construction step for eliminating the gap between neuroimaging features and disease labels. To exploit the correlations among multi-modality data, we learn latent representations for multi-modality data by sharing the common high-level representations in the last layer of each modality in the deep NMF model. Extensive experimental results on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset validate that our proposed method outperforms several state-of-the-art methods.
引用
收藏
页码:629 / 638
页数:10
相关论文
共 36 条
  • [21] Joint detection and clinical score prediction in Parkinson's disease via multi-modal sparse learning
    Lei, Haijun
    Huang, Zhongwei
    Zhang, Jian
    Yang, Zhang
    Tan, Ee-Leng
    Zhou, Feng
    Lei, Baiying
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2017, 80 : 284 - 296
  • [22] Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis
    Suk, Heung-Il
    Lee, Seong-Whan
    Shen, Dinggang
    [J]. NEUROIMAGE, 2014, 101 : 569 - 582
  • [23] Multi-modal sequence learning for Alzheimer's disease progression prediction with incomplete variable-length longitudinal data
    Xu, Lei
    Wu, Hui
    He, Chunming
    Wang, Jun
    Zhang, Changqing
    Nie, Feiping
    Chen, Lei
    [J]. MEDICAL IMAGE ANALYSIS, 2022, 82
  • [24] Multi-modal global- and local- feature interaction with attention-based mechanism for diagnosis of Alzheimer's disease
    Jia, Nana
    Jia, Tong
    Zhao, Li
    Ma, Bowen
    Zhu, Zheyi
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 95
  • [25] Integrated Multi-Modal 3D-CNN and RNN Approach with Transfer Learning for Early Detection of Alzheimer's Disease
    Ramani, R.
    Ganesh, S. Sankar
    Rao, S. P. V. Subba
    Aggarwal, Nitisha
    [J]. IRANIAN JOURNAL OF SCIENCE AND TECHNOLOGY-TRANSACTIONS OF ELECTRICAL ENGINEERING, 2024, : 383 - 407
  • [26] A Comprehensive Report on Machine Learning-based Early Detection of Alzheimer's Disease using Multi-modal Neuroimaging Data
    Sharma, Shallu
    Mandal, Pravat Kumar
    [J]. ACM COMPUTING SURVEYS, 2023, 55 (02)
  • [27] Multi-view ensemble learning for dementia diagnosis from neuroimaging: An artificial neural network approach
    Liu, Jiajun
    Shang, Shuo
    Zheng, Kai
    Wen, Ji-Rong
    [J]. NEUROCOMPUTING, 2016, 195 : 112 - 116
  • [28] Deep sparse multi-task learning for feature selection in Alzheimer's disease diagnosis
    Suk, Heung-Il
    Lee, Seong-Whan
    Shen, Dinggang
    [J]. BRAIN STRUCTURE & FUNCTION, 2016, 221 (05) : 2569 - 2587
  • [29] Effective feature learning and fusion of multimodality data using stage-wise deep neural network for dementia diagnosis
    Zhou, Tao
    Thung, Kim-Han
    Zhu, Xiaofeng
    Shen, Dinggang
    [J]. HUMAN BRAIN MAPPING, 2019, 40 (03) : 1001 - 1016
  • [30] Dual Attention Multi-Instance Deep Learning for Alzheimer's Disease Diagnosis With Structural MRI
    Zhu, Wenyong
    Sun, Liang
    Huang, Jiashuang
    Han, Liangxiu
    Zhang, Daoqiang
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (09) : 2354 - 2366