Vision Transformer for Parkinson's Disease Classification using Multilingual Sustained Vowel Recordings

被引:3
|
作者
Hemmerling, Daria [1 ]
Wodzinski, Marek [1 ,2 ]
Orozco-Arroyave, Juan Rafael [3 ,4 ]
Sztaho, David [5 ]
Daniol, Mateusz [1 ]
Jemiolo, Pawel [1 ]
Wojcik-Pedziwiatr, Magdalena [6 ]
机构
[1] AGH Univ Sci & Technol, Fac Elect Engn Automat Comp Sci & Biomed Engn, Krakow, Poland
[2] Univ Appl Sci Western Switzerland, Inst Informat Syst, HES SO Valais, Sierre, Switzerland
[3] Univ Antioquia, Medellin, Colombia
[4] Univ Erlangen Nurnberg, Pattern Recognit Lab, Erlangen, Germany
[5] Budapest Univ Technol & Econ, Dept Telecommun & Media Informat, Budapest, Hungary
[6] Krakow Univ, Dept Neurol, Krakow, Poland
来源
2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC | 2023年
关键词
Deep Learning; Vision Transformer; Voice Processing; Neurodegenerative Diseases; Hypokinetic Dysarthria;
D O I
10.1109/EMBC40787.2023.10340478
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parkinson's disease (PD) is the 2(nd) most prevalent neurodegenerative disease in the world. Thus, the early detection of PD has recently been the subject of several scientific and commercial studies. In this paper, we propose a pipeline using Vision Transformer applied to mel-spectrograms for PD classification using multilingual sustained vowel recordings. Furthermore, our proposed transformed-based model shows a great potential to use voice as a single modality biomarker for automatic PD detection without language restrictions, a wide range of vowels, with an F1-score equal to 0.78. The results of our study fall within the range of the estimated prevalence of voice and speech disorders in Parkinson's disease, which ranges from 70-90%. Our study demonstrates a high potential for adaptation in clinical decision-making, allowing for increasingly systematic and fast diagnosis of PD with the potential for use in telemedicine.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Durian Disease Classification using Vision Transformer for Cutting-Edge Disease Control
    Daud, Marizuana Mat
    Abualqumssan, Abdelrahman
    Rashid, Fadilla 'Atyka Nor
    Saad, Mohamad Hanif Md
    Zaki, Wan Mimi Diyana Wan
    Satar, Nurhizam Safie Mohd
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (12) : 446 - 452
  • [2] Diabetic Retinopathy Classification using Vision Transformer
    Mutawa, A. M.
    Sruthi, Sai
    2022 6TH EUROPEAN CONFERENCE ON ELECTRICAL ENGINEERING & COMPUTER SCIENCE, ELECS, 2022, : 25 - 30
  • [3] An efficient vision transformer for Alzheimer's disease classification using magnetic resonance images
    Lu, Si-Yuan
    Zhang, Yu-Dong
    Yao, Yu-Dong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 101
  • [4] Vowel Articulation in Parkinson's Disease
    Skodda, Sabine
    Visser, Wenke
    Schlegel, Uwe
    JOURNAL OF VOICE, 2011, 25 (04) : 467 - 472
  • [5] An effective human monkeypox classification using vision transformer
    Aloraini, Mohammed
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (01)
  • [6] Ensemble of vision transformer architectures for efficient Alzheimer's Disease classification
    Shaffi, Noushath
    Viswan, Vimbi
    Mahmud, Mufti
    BRAIN INFORMATICS, 2024, 11 (01)
  • [7] Vowel Articulation Distortion in Parkinson's Disease
    Gomez-Vilda, P.
    Ferrandez-Vicente, J. M.
    Palacios-Alonso, D.
    Gomez-Rodellar, A.
    Rodellar-Biarge, V.
    Mekyska, J.
    Smekal, Z.
    Rektorova, I.
    Eliasova, I.
    Kostalova, M.
    BIOMEDICAL APPLICATIONS BASED ON NATURAL AND ARTIFICIAL COMPUTING, PT II, 2017, 10338 : 21 - 31
  • [8] Transforming Alzheimer's Disease Diagnosis: Implementing Vision Transformer (ViT) for MRI Images Classification
    Kurniasari, Dian
    Pratama, Muhammad Dwi
    Junaidi, Akmal
    Faisol, Ahmad
    JOURNAL OF INFORMATION AND COMMUNICATION TECHNOLOGY-MALAYSIA, 2025, 24 (01): : 130 - 152
  • [9] Vision transformer meets convolutional neural network for plant disease classification
    Thakur, Poornima Singh
    Chaturvedi, Shubhangi
    Khanna, Pritee
    Sheorey, Tanuja
    Ojha, Aparajita
    ECOLOGICAL INFORMATICS, 2023, 77
  • [10] InViTMixup: plant disease classification using convolutional vision transformer with Mixup augmentation
    Devi, R. S. Sandhya
    Kumar, V. R. Vijay
    Sivakumar, P.
    JOURNAL OF THE CHINESE INSTITUTE OF ENGINEERS, 2024, 47 (05) : 520 - 527