Improving Alzheimer's Diagnosis using Vision Transformers and Transfer Learning

被引:0
作者
Zaabi, Marwa [1 ]
Ibn Khedher, Mohamed [2 ]
El-Yacoubi, Mounim A. [3 ]
机构
[1] Sfax Univ, CEM Lab, ENIS, Sfax, Tunisia
[2] IRT SystemX, 2 Bd Thomas Gobert, F-91120 Palaiseau, France
[3] Telecom SudParis, Inst Polytech Paris, Samovar, 19 Pl Marguerite Perey, F-91120 Palaiseau, France
来源
2024 16TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTION, HSI 2024 | 2024年
关键词
Alzheimer's disease; Vision Transformer; Transfer Learning; NEURAL-NETWORK; MRI;
D O I
10.1109/HSI61632.2024.10613527
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Alzheimer's disease is a neurodegenerative disorder defined by memory loss and primarily affects older individuals. Currently, there is no definitive cure available. Although medications are accessible, they only serve to slow the progression of the disease. In this paper, we propose the use of Vision Transformers and Transfer Learning for Alzheimer's classification. Our approach leverages the temporal aspect of the transformer to model the correlation between different image patches. Transfer learning enables us to mitigate the issue of insufficient available data. Our method has been validated on the OASIS dataset, which consists of 250 brain scans. The results demonstrate that transfer learning with Transformer models surpasses the performance of transfer learning with CNN models by 4% and exceeds traditional CNN models without transfer learning by 8%. Two types of Transformers were tested: ViT-B16 and ViT-B32. The results are comparable, with ViT-B32 outperforming ViT-B16 by 1%.
引用
收藏
页数:6
相关论文
共 41 条
[1]   A Multi-Stream Convolutional Neural Network for Classification of Progressive MCI in Alzheimer's Disease Using Structural MRI Images [J].
Ashtari-Majlan, Mona ;
Seifi, Abbas ;
Dehshibi, Mohammad Mahdi .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (08) :3918-3926
[2]   Advancing Brain Tumor Classification through Fine-Tuned Vision Transformers: A Comparative Study of Pre-Trained Models [J].
Asiri, Abdullah A. ;
Shaf, Ahmad ;
Ali, Tariq ;
Pasha, Muhammad Ahmad ;
Aamir, Muhammad ;
Irfan, Muhammad ;
Alqahtani, Saeed ;
Alghamdi, Ahmad Joman ;
Alghamdi, Ali H. ;
Alshamrani, Abdullah Fahad A. ;
Alelyani, Magbool ;
Alamri, Sultan .
SENSORS, 2023, 23 (18)
[3]  
Ben Rabeh Amira, 2023, 2023 INT C CONTR AUT, P1
[4]   Early-Stage Alzheimer's Disease Categorization Using PET Neuroimaging Modality and Convolutional Neural Networks in the 2D and 3D Domains [J].
Bin Tufail, Ahsan ;
Anwar, Nazish ;
Ben Othman, Mohamed Tahar ;
Ullah, Inam ;
Khan, Rehan Ali ;
Ma, Yong-Kui ;
Adhikari, Deepak ;
Rehman, Ateeq Ur ;
Shafiq, Muhammad ;
Hamam, Habib .
SENSORS, 2022, 22 (12)
[5]   LongFormer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIs [J].
Chen, Qiuhui ;
Fu, Qiang ;
Bai, Hao ;
Hong, Yi .
2024 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION, WACV 2024, 2024, :3563-3572
[6]   Detection of Alzheimer Disease on Online Handwriting Using 1D Convolutional Neural Network [J].
Dao, Quang ;
El-Yacoubi, Mounim A. ;
Rigaud, Anne-Sophie .
IEEE ACCESS, 2023, 11 :2148-2155
[7]   Abstract Layer for LeakyReLU for Neural Network Verification Based on Abstract Interpretation [J].
El Mellouki, Omar ;
Khedher, Mohamed Ibn ;
El-Yacoubi, Mounim A. .
IEEE ACCESS, 2023, 11 :33401-33413
[8]   From aging to early-stage Alzheimer's: Uncovering handwriting multimodal behaviors by semi-supervised learning and sequential representation learning [J].
El-Yacoubi, Mounim A. ;
Garcia-Salicetti, Sonia ;
Kahindo, Christian ;
Rigaud, Anne-Sophie ;
Cristancho-Lacroix, Victoria .
PATTERN RECOGNITION, 2019, 86 :112-133
[9]   The promise of convolutional neural networks for the early diagnosis of the Alzheimer?s disease [J].
Erdogmus, Pakize ;
Kabakus, Abdullah Talha .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
[10]  
Haddada Karim, 2023, 2023 International Conference on Cyberworlds (CW), P185, DOI 10.1109/CW58918.2023.00035