Vision Transformer for Parkinson's Disease Classification using Multilingual Sustained Vowel Recordings

被引:5
|
作者
Hemmerling, Daria [1 ]
Wodzinski, Marek [1 ,2 ]
Orozco-Arroyave, Juan Rafael [3 ,4 ]
Sztaho, David [5 ]
Daniol, Mateusz [1 ]
Jemiolo, Pawel [1 ]
Wojcik-Pedziwiatr, Magdalena [6 ]
机构
[1] AGH Univ Sci & Technol, Fac Elect Engn Automat Comp Sci & Biomed Engn, Krakow, Poland
[2] Univ Appl Sci Western Switzerland, Inst Informat Syst, HES SO Valais, Sierre, Switzerland
[3] Univ Antioquia, Medellin, Colombia
[4] Univ Erlangen Nurnberg, Pattern Recognit Lab, Erlangen, Germany
[5] Budapest Univ Technol & Econ, Dept Telecommun & Media Informat, Budapest, Hungary
[6] Krakow Univ, Dept Neurol, Krakow, Poland
来源
2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC | 2023年
关键词
Deep Learning; Vision Transformer; Voice Processing; Neurodegenerative Diseases; Hypokinetic Dysarthria;
D O I
10.1109/EMBC40787.2023.10340478
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parkinson's disease (PD) is the 2(nd) most prevalent neurodegenerative disease in the world. Thus, the early detection of PD has recently been the subject of several scientific and commercial studies. In this paper, we propose a pipeline using Vision Transformer applied to mel-spectrograms for PD classification using multilingual sustained vowel recordings. Furthermore, our proposed transformed-based model shows a great potential to use voice as a single modality biomarker for automatic PD detection without language restrictions, a wide range of vowels, with an F1-score equal to 0.78. The results of our study fall within the range of the estimated prevalence of voice and speech disorders in Parkinson's disease, which ranges from 70-90%. Our study demonstrates a high potential for adaptation in clinical decision-making, allowing for increasingly systematic and fast diagnosis of PD with the potential for use in telemedicine.
引用
收藏
页数:4
相关论文
共 50 条
  • [31] Melanoma Skin Classification Using the Hybrid Approach Residual Network-Vision Transformer for Cancer Diagnosis
    Toure, Alousseyni
    Haman, Ismael Adji
    Benbakreti, Samir
    Roumane, Ahmed
    Benbakreti, Soumia
    Benouis, Mohamed
    JOURNAL OF CLINICAL ULTRASOUND, 2025,
  • [32] A Deep Features Extraction Model Based on the Transfer Learning Model and Vision Transformer "TLMViT" for Plant Disease Classification
    Tabbakh, Amer
    Barpanda, Soubhagya Sankar
    IEEE ACCESS, 2023, 11 : 45377 - 45392
  • [33] Detection and Classification of Mental Stress Using In-Ear Plethysmography and a Vision Transformer
    Barki, Hika
    Nkenyereye, Lionel
    Chung, Wan-Young
    IEEE SENSORS JOURNAL, 2025, 25 (02) : 4015 - 4027
  • [34] Enhancing Cervical Pre-Cancerous Classification Using Advanced Vision Transformer
    Darwish, Manal
    Altabel, Mohamad Ziad
    Abiyev, Rahib H.
    DIAGNOSTICS, 2023, 13 (18)
  • [35] Music-evoked emotions classification using vision transformer in EEG signals
    Wang, Dong
    Lian, Jian
    Cheng, Hebin
    Zhou, Yanan
    FRONTIERS IN PSYCHOLOGY, 2024, 15
  • [36] Multi-label classification of retinal disease via a novel vision transformer model
    Wang, Dong
    Lian, Jian
    Jiao, Wanzhen
    FRONTIERS IN NEUROSCIENCE, 2024, 17
  • [37] Improving Chicken Disease Classification Based on Vision Transformer and Combine with Integrated Gradients Explanation
    Huong Hoang Luong
    Triet Minh Nguyen
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (04) : 1236 - 1249
  • [38] Using Deep Learning for Task and Tremor Type Classification in People with Parkinson's Disease
    Farhani, Ghazal
    Zhou, Yue
    Jenkins, Mary E.
    Naish, Michael D.
    Trejos, Ana Luisa
    SENSORS, 2022, 22 (19)
  • [39] Identification of Cotton Leaf Curl Disease Using CNN and Vision Transformer
    Biju, Goel
    Khan, Asiya
    Walker, David
    Qadri, Salman
    Hssan, Qaim
    Mahmood, Khalid
    Hanan, Abdul
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 2, INTELLISYS 2023, 2024, 823 : 670 - 688
  • [40] ResNet-Based Parkinson's Disease Classification
    El Ariss O.
    Hu K.
    IEEE Transactions on Artificial Intelligence, 2023, 4 (05): : 1258 - 1268