Multi-view imputation and cross-attention network based on incomplete longitudinal and multimodal data for conversion prediction of mild cognitive impairment

被引:10
作者
Wang, Tao [1 ]
Chen, Xiumei [1 ]
Zhang, Xiaoling [1 ]
Zhou, Shuoling [1 ]
Feng, Qianjin [1 ,2 ,3 ]
Huang, Meiyan [1 ,2 ,3 ]
机构
[1] Southern Med Univ, Sch Biomed Engn, Guangzhou 510515, Peoples R China
[2] Southern Med Univ, Guangdong Prov Key Lab Med Image Proc, Guangzhou 510515, Peoples R China
[3] Southern Med Univ, Guangdong Prov Engn Lab Med Imaging & Diagnost Tec, Guangzhou 510515, Peoples R China
基金
中国国家自然科学基金;
关键词
Adversarial learning; Cross-attention; Conversion prediction; Longitudinal and multimodal data; Mild cognitive impairment; Multi-view imputation; ALZHEIMERS-DISEASE; REPRESENTATION; CLASSIFICATION; REGRESSION; DIAGNOSIS; MODEL;
D O I
10.1016/j.eswa.2023.120761
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Predicting whether subjects with mild cognitive impairment (MCI) can convert to Alzheimer's disease is significant for personalized treatment development and disease progression delay. Longitudinal and multimodal data have been recognized for their ability to capture longitudinal variations and provide complementary information for MCI conversion prediction. However, incomplete or missing data pose a persistent challenge in effectively utilizing such valuable information. Additionally, early-stage conversion prediction, particularly at baseline visit (BL), is crucial in clinical practice. Therefore, longitudinal data must only be incorporated during training to capture disease progression information. To address these challenges, we propose a multi-view imputation and cross-attention network (MCNet) to integrate data imputation and MCI conversion prediction in a unified framework. First, a multi-view imputation method combined with adversarial learning is presented to handle various missing data scenarios and reduce imputation errors. Second, two cross-attention blocks are introduced to exploit the potential associations in longitudinal and multimodal data. Finally, a multi-task learning model is established for data imputation, longitudinal classification, and conversion prediction. By appropriately training the model, disease progression information learned from longitudinal data improves the MCI conversion prediction that only uses BL data. To verify its effectiveness and flexibility in such MCI conversion prediction, we test MCNet on independent testing sets and single-modal BL data. Results show that MCNet outperforms competitive methods with an area under the receiver operating characteristic curve value of 86.0%. Furthermore, the interpretability of MCNet is demonstrated, indicating its potential as a valuable tool for incomplete data analysis in MCI conversion prediction.
引用
收藏
页数:14
相关论文
共 57 条
[21]   The temporal pole: From anatomy to function-A literature appraisal [J].
Herlin, Bastien ;
Navarro, Vincent ;
Dupont, Sophie .
JOURNAL OF CHEMICAL NEUROANATOMY, 2021, 113
[22]   Using AUC and accuracy in evaluating learning algorithms [J].
Huang, J ;
Ling, CX .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (03) :299-310
[23]   Deep-gated recurrent unit and diet network-based genome-wide association analysis for detecting the biomarkers of Alzheimer's disease [J].
Huang, Meiyan ;
Lai, Haoran ;
Yu, Yuwei ;
Chen, Xiumei ;
Wang, Tao ;
Feng, Qianjin .
MEDICAL IMAGE ANALYSIS, 2021, 73 (73)
[24]   Imaging Genetics Study Based on a Temporal Group Sparse Regression and Additive Model for Biomarker Detection of Alzheimer's Disease [J].
Huang, Meiyan ;
Chen, Xiumei ;
Yu, Yuwei ;
Lai, Haoran ;
Feng, Qianjin .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (05) :1461-1473
[25]   Longitudinal measurement and hierarchical classification framework for the prediction of Alzheimer's disease [J].
Huang, Meiyan ;
Yang, Wei ;
Feng, Qianjin ;
Chen, Wufan .
SCIENTIFIC REPORTS, 2017, 7
[26]   Automated brain extraction of multisequence MRI using artificial neural networks [J].
Isensee, Fabian ;
Schell, Marianne ;
Pflueger, Irada ;
Brugnara, Gianluca ;
Bonekamp, David ;
Neuberger, Ulf ;
Wick, Antje ;
Schlemmer, Heinz-Peter ;
Heiland, Sabine ;
Wick, Wolfgang ;
Bendszus, Martin ;
Maier-Hein, Klaus H. ;
Kickingereder, Philipp .
HUMAN BRAIN MAPPING, 2019, 40 (17) :4952-4964
[27]   The Alzheimer's Disease Neuroimaging Initiative 2 PET Core: 2015 [J].
Jagust, William J. ;
Landau, Susan M. ;
Koeppe, Robert A. ;
Reiman, Eric M. ;
Chen, Kewei ;
Mathis, Chester A. ;
Price, Julie C. ;
Foster, Norman L. ;
Wang, Angela Y. .
ALZHEIMERS & DEMENTIA, 2015, 11 (07) :757-771
[28]   Deep recurrent model for individualized prediction of Alzheimer's disease progression [J].
Jung, Wonsik ;
Jun, Eunji ;
Suk, Heung-Il .
NEUROIMAGE, 2021, 237
[29]   An Improved Multi-Modal based Machine Learning Approach for the Prognosis of Alzheimer?s disease [J].
Khan, Afreen ;
Zubair, Swaleha .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (06) :2688-2706
[30]   Identification of mild cognitive impairment subtypes predicting conversion to Alzheimer?s disease using multimodal data [J].
Kikuchi, Masataka ;
Kobayashi, Kaori ;
Itoh, Sakiko ;
Kasuga, Kensaku ;
Miyashita, Akinori ;
Ikeuchi, Takeshi ;
Yumoto, Eiji ;
Kosaka, Yuki ;
Fushimi, Yasuto ;
Takeda, Toshihiro ;
Manabe, Shirou ;
Hattori, Satoshi ;
Nakaya, Akihiro ;
Kamijo, Kenichi ;
Matsumura, Yasushi .
COMPUTATIONAL AND STRUCTURAL BIOTECHNOLOGY JOURNAL, 2022, 20 :5296-5308