Multi-view imputation and cross-attention network based on incomplete longitudinal and multimodal data for conversion prediction of mild cognitive impairment

被引:10
作者
Wang, Tao [1 ]
Chen, Xiumei [1 ]
Zhang, Xiaoling [1 ]
Zhou, Shuoling [1 ]
Feng, Qianjin [1 ,2 ,3 ]
Huang, Meiyan [1 ,2 ,3 ]
机构
[1] Southern Med Univ, Sch Biomed Engn, Guangzhou 510515, Peoples R China
[2] Southern Med Univ, Guangdong Prov Key Lab Med Image Proc, Guangzhou 510515, Peoples R China
[3] Southern Med Univ, Guangdong Prov Engn Lab Med Imaging & Diagnost Tec, Guangzhou 510515, Peoples R China
基金
中国国家自然科学基金;
关键词
Adversarial learning; Cross-attention; Conversion prediction; Longitudinal and multimodal data; Mild cognitive impairment; Multi-view imputation; ALZHEIMERS-DISEASE; REPRESENTATION; CLASSIFICATION; REGRESSION; DIAGNOSIS; MODEL;
D O I
10.1016/j.eswa.2023.120761
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Predicting whether subjects with mild cognitive impairment (MCI) can convert to Alzheimer's disease is significant for personalized treatment development and disease progression delay. Longitudinal and multimodal data have been recognized for their ability to capture longitudinal variations and provide complementary information for MCI conversion prediction. However, incomplete or missing data pose a persistent challenge in effectively utilizing such valuable information. Additionally, early-stage conversion prediction, particularly at baseline visit (BL), is crucial in clinical practice. Therefore, longitudinal data must only be incorporated during training to capture disease progression information. To address these challenges, we propose a multi-view imputation and cross-attention network (MCNet) to integrate data imputation and MCI conversion prediction in a unified framework. First, a multi-view imputation method combined with adversarial learning is presented to handle various missing data scenarios and reduce imputation errors. Second, two cross-attention blocks are introduced to exploit the potential associations in longitudinal and multimodal data. Finally, a multi-task learning model is established for data imputation, longitudinal classification, and conversion prediction. By appropriately training the model, disease progression information learned from longitudinal data improves the MCI conversion prediction that only uses BL data. To verify its effectiveness and flexibility in such MCI conversion prediction, we test MCNet on independent testing sets and single-modal BL data. Results show that MCNet outperforms competitive methods with an area under the receiver operating characteristic curve value of 86.0%. Furthermore, the interpretability of MCNet is demonstrated, indicating its potential as a valuable tool for incomplete data analysis in MCI conversion prediction.
引用
收藏
页数:14
相关论文
共 57 条
[1]   Alzheimer's disease diagnosis framework from incomplete multimodal data using convolutional neural networks [J].
Abdelaziz, Mohammed ;
Wang, Tianfu ;
Elazab, Ahmed .
JOURNAL OF BIOMEDICAL INFORMATICS, 2021, 121
[2]   Parsing heterogeneity within dementia with Lewy bodies using clustering of biological, clinical, and demographic data [J].
Abdelnour, Carla ;
Ferreira, Daniel ;
van de Beek, Marleen ;
Cedres, Nira ;
Oppedal, Ketil ;
Cavallin, Lena ;
Blanc, Frederic ;
Bousiges, Olivier ;
Wahlund, Lars-Olof ;
Pilotto, Andrea ;
Padovani, Alessandro ;
Boada, Merce ;
Pagonabarraga, Javier ;
Kulisevsky, Jaime ;
Aarsland, Dag ;
Lemstra, Afina W. ;
Westman, Eric .
ALZHEIMERS RESEARCH & THERAPY, 2022, 14 (01)
[3]   The diagnosis of mild cognitive impairment due to Alzheimer's disease: Recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease [J].
Albert, Marilyn S. ;
DeKosky, Steven T. ;
Dickson, Dennis ;
Dubois, Bruno ;
Feldman, Howard H. ;
Fox, Nick C. ;
Gamst, Anthony ;
Holtzman, David M. ;
Jagust, William J. ;
Petersen, Ronald C. ;
Snyder, Peter J. ;
Carrillo, Maria C. ;
Thies, Bill ;
Phelps, Creighton H. .
ALZHEIMERS & DEMENTIA, 2011, 7 (03) :270-279
[4]  
Anandkumar A, 2014, J MACH LEARN RES, V15, P2773
[5]   Data fusion based on Searchlight analysis for the prediction of Alzheimer's disease [J].
Arco, Juan E. ;
Ramirez, Javier ;
Gorriz, Juan M. ;
Ruz, Maria .
EXPERT SYSTEMS WITH APPLICATIONS, 2021, 185
[6]   An overview of deep learning methods for multimodal medical data mining [J].
Behrad, Fatemeh ;
Abadeh, Mohammad Saniee .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 200
[7]  
Bengio S., 2015, 2015 ADV NEURAL INFO, V28, P1171
[8]   Joint Multi-Modal Longitudinal Regression and Classification for Alzheimer's Disease Prediction [J].
Brand, Lodewijk ;
Nichols, Kai ;
Wang, Hua ;
Shen, Li ;
Huang, Heng .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (06) :1845-1855
[9]  
Brodersen Kay H., 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P3121, DOI 10.1109/ICPR.2010.764
[10]   A hybrid machine learning approach for prediction of conversion from mild cognitive impairment to dementia [J].
Bucholc, Magda ;
Titarenko, Sofya ;
Ding, Xuemei ;
Canavan, Callum ;
Chen, Tianhua .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 217