Vision Transformer for Parkinson's Disease Classification using Multilingual Sustained Vowel Recordings

被引:5
|
作者
Hemmerling, Daria [1 ]
Wodzinski, Marek [1 ,2 ]
Orozco-Arroyave, Juan Rafael [3 ,4 ]
Sztaho, David [5 ]
Daniol, Mateusz [1 ]
Jemiolo, Pawel [1 ]
Wojcik-Pedziwiatr, Magdalena [6 ]
机构
[1] AGH Univ Sci & Technol, Fac Elect Engn Automat Comp Sci & Biomed Engn, Krakow, Poland
[2] Univ Appl Sci Western Switzerland, Inst Informat Syst, HES SO Valais, Sierre, Switzerland
[3] Univ Antioquia, Medellin, Colombia
[4] Univ Erlangen Nurnberg, Pattern Recognit Lab, Erlangen, Germany
[5] Budapest Univ Technol & Econ, Dept Telecommun & Media Informat, Budapest, Hungary
[6] Krakow Univ, Dept Neurol, Krakow, Poland
来源
2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC | 2023年
关键词
Deep Learning; Vision Transformer; Voice Processing; Neurodegenerative Diseases; Hypokinetic Dysarthria;
D O I
10.1109/EMBC40787.2023.10340478
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parkinson's disease (PD) is the 2(nd) most prevalent neurodegenerative disease in the world. Thus, the early detection of PD has recently been the subject of several scientific and commercial studies. In this paper, we propose a pipeline using Vision Transformer applied to mel-spectrograms for PD classification using multilingual sustained vowel recordings. Furthermore, our proposed transformed-based model shows a great potential to use voice as a single modality biomarker for automatic PD detection without language restrictions, a wide range of vowels, with an F1-score equal to 0.78. The results of our study fall within the range of the estimated prevalence of voice and speech disorders in Parkinson's disease, which ranges from 70-90%. Our study demonstrates a high potential for adaptation in clinical decision-making, allowing for increasingly systematic and fast diagnosis of PD with the potential for use in telemedicine.
引用
收藏
页数:4
相关论文
共 50 条
  • [41] Efficient identification and classification of apple leaf diseases using lightweight vision transformer (ViT)
    Ullah, Wasi
    Javed, Kashif
    Khan, Muhammad Attique
    Alghayadh, Faisal Yousef
    Bhatt, Mohammed Wasim
    Al Naimi, Imad Saud
    Ofori, Isaac
    DISCOVER SUSTAINABILITY, 2024, 5 (01):
  • [42] Efficient agricultural pest classification using vision transformer with hybrid pooled multihead attention
    Saranya T.
    Deisy C.
    Sridevi S.
    Computers in Biology and Medicine, 2024, 177
  • [43] ViTAD: Leveraging modified vision transformer for Alzheimer's disease multi-stage classification from brain MRI scans
    Joy, Md. Ashif Mahmud
    Nasrin, Shamima
    Siddiqua, Ayesha
    Farid, Dewan Md.
    BRAIN RESEARCH, 2025, 1847
  • [44] Performance Analysis of Breast Cancer Classification from Mammogram Images Using Vision Transformer
    Borah, Naiwrita
    Varma, Sai Pratyush P.
    Datta, Ashis
    Kumar, Amish
    Baruah, Udayan
    Ghosal, Palash
    2022 IEEE CALCUTTA CONFERENCE, CALCON, 2022, : 238 - 243
  • [45] Vowel Articulation Dynamic Stability Related to Parkinson's Disease Rating Features: Male Dataset
    Gomez-Vilda, Pedro
    Galaz, Zoltan
    Mekyska, Jiri
    Ferrandez Vicente, Jose M.
    Gomez-Rodellar, Andres
    Palacios-Alonso, Daniel
    Smekal, Zdenek
    Eliasova, Ilona
    Kostalova, Milena
    Rektorova, Irena
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2019, 29 (02)
  • [46] SwinSight: a hierarchical vision transformer using shifted windows to leverage aerial image classification
    Pradhan P.K.
    Das A.
    Kumar A.
    Baruah U.
    Sen B.
    Ghosal P.
    Multimedia Tools and Applications, 2024, 83 (39) : 86457 - 86478
  • [47] Diagnosis and classification of Parkinson's disease using ensemble learning and 1D-PDCovNN
    Nour, Majid
    Senturk, Umit
    Polat, Kemal
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 161
  • [48] Classification, Prediction, and Monitoring of Parkinson's disease using Computer Assisted Technologies: A Comparative Analysis
    Goyal, Jinee
    Khandnor, Padmavati
    Aseri, Trilok Chand
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 96
  • [49] Deep Learning-Based Parkinson's Disease Classification Using Vocal Feature Sets
    Gunduz, Hakan
    IEEE ACCESS, 2019, 7 : 115540 - 115551
  • [50] A deep learning approach for classification and diagnosis of Parkinson's disease
    Jyotiyana, Monika
    Kesswani, Nishtha
    Kumar, Munish
    SOFT COMPUTING, 2022, 26 (18) : 9155 - 9165