An efficient vision transformer for Alzheimer's disease classification using magnetic resonance images

被引:7
作者
Lu, Si-Yuan [1 ]
Zhang, Yu-Dong [2 ,3 ]
Yao, Yu-Dong [4 ]
机构
[1] Nanjing Univ Posts & Telecommun, Sch Commun & Informat Engn, Nanjing 210003, Peoples R China
[2] Univ Leicester, Sch Comp & Math Sci, Leicester LE1 7RH, England
[3] King Abdulaziz Univ, Fac Comp & Informat Technol, Dept Informat Technol, Jeddah 21589, Saudi Arabia
[4] Stevens Inst Technol, Dept Elect & Comp Engn, Hoboken, NJ 07030 USA
基金
英国生物技术与生命科学研究理事会; 英国医学研究理事会;
关键词
Computer-aided diagnosis; Alzheimer's disease; Magnetic resonance imaging; Vision transformer; Token compression;
D O I
10.1016/j.bspc.2024.107263
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Alzheimer's disease (AD) is the most common dementia that is often seen among the elderly. AD can cause the loss of cognitive ability and memory, which can result in death as AD is progressive. The exact cause of AD is still in research, but it is believed to be related to genes, diet, and environment. One observation of AD is the shrinkage of the hippocampus and frontal lobe cortex. Magnetic resonance imaging (MRI) is often employed in the diagnosis of AD as it can produce clear images of the soft tissues. In this study, a new computer-aided diagnosis (CAD) method named RanCom-ViT, is proposed to interpret the brain MRI slices automatically and precisely for AD diagnosis with better global representation learning and efficiency. A pre-trained vision transformer (ViT) is chosen as the backbone because ViTs with attention modules can achieve better performance than convolutional neural networks on larger datasets. Then, a novel token compression block is proposed to improve the efficiency of the RanCom-ViT by removing the less important tokens. Further, the classification head of the RanCom-ViT is enhanced by a random vector functional-link structure to obtain better classification performance in AD diagnosis. A large public brain MRI dataset is utilized in the evaluation experiments of the proposed RanCom-ViT, and it achieved an overall accuracy of 99.54% with a double throughput than the benchmark model. The results reveal that the RanCom-ViT outperforms several existing state-of-the-art AD diagnosis methods in terms of accuracy, and the token compression method contributes to higher efficiency.
引用
收藏
页数:11
相关论文
共 26 条
[1]   Transformed domain convolutional neural network for Alzheimer?s disease diagnosis using structural MRI [J].
Abbas, S. Qasim ;
Chi, Lianhua ;
Chen, Yi-Ping Phoebe .
PATTERN RECOGNITION, 2023, 133
[2]   Multi-label classification of Alzheimer's disease stages from resting-state fMRI-based correlation connectivity data and deep learning [J].
Alorf, Abdulaziz ;
Khan, Muhammad Usman Ghani .
COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 151
[3]   Face detection in untrained deep neural networks [J].
Baek, Seungdae ;
Song, Min ;
Jang, Jaeson ;
Kim, Gwangsu ;
Paik, Se-Bum .
NATURE COMMUNICATIONS, 2021, 12 (01)
[4]   Functional Brain Network Classification for Alzheimer's Disease Detection with Deep Features and Extreme Learning Machine [J].
Bi, Xin ;
Zhao, Xiangguo ;
Huang, Hong ;
Chen, Deyang ;
Ma, Yuliang .
COGNITIVE COMPUTATION, 2020, 12 (03) :513-527
[5]   End-to-end automatic pathology localization for Alzheimer's disease diagnosis using structural MRI [J].
Cao, Gongpeng ;
Zhang, Manli ;
Wang, Yiping ;
Zhang, Jing ;
Han, Ying ;
Xu, Xin ;
Huang, Jinguo ;
Kang, Guixia .
COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 163
[6]   MRI-based deep learning can discriminate between temporal lobe epilepsy, Alzheimer's disease, and healthy controls [J].
Chang, Allen J. ;
Roth, Rebecca ;
Bougioukli, Eleni ;
Ruber, Theodor ;
Keller, Simon S. ;
Drane, Daniel L. ;
Gross, Robert E. ;
Welsh, James ;
Abrol, Anees ;
Calhoun, Vince ;
Karakis, Ioannis ;
Kaestner, Erik ;
Weber, Bernd ;
McDonald, Carrie ;
Gleichgerrcht, Ezequiel ;
Bonilha, Leonardo .
COMMUNICATIONS MEDICINE, 2023, 3 (01)
[7]  
Dosovitskiy Alexey., 2021, PROC INT C LEARN REP, P2021, DOI DOI 10.48550/ARXIV.2010.11929
[8]   Two-stage deep learning model for Alzheimer's disease detection and prediction of the mild cognitive impairment time [J].
El-Sappagh, Shaker ;
Saleh, Hager ;
Ali, Farman ;
Amer, Eslam ;
Abuhmed, Tamer .
NEURAL COMPUTING & APPLICATIONS, 2022, 34 (17) :14487-14509
[9]   Diagnostic performance of magnetic resonance imaging-based machine learning in Alzheimer's disease detection: a meta-analysis [J].
Hu, Jiayi ;
Wang, Yashan ;
Guo, Dingjie ;
Qu, Zihan ;
Sui, Chuanying ;
He, Guangliang ;
Wang, Song ;
Chen, Xiaofei ;
Wang, Chunpeng ;
Liu, Xin .
NEURORADIOLOGY, 2023, 65 (03) :513-527
[10]   Explainable Identification of Dementia From Transcripts Using Transformer Networks [J].
Ilias, Loukas ;
Askounis, Dimitris .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (08) :4153-4164