A mobile application using automatic speech analysis for classifying Alzheimer?s disease and mild cognitive impairment

被引:6
|
作者
Yamada, Yasunori [1 ]
Shinkawa, Kaoru [1 ]
Nemoto, Miyuki [2 ]
Nemoto, Kiyotaka [2 ]
Arai, Tetsuaki [2 ]
机构
[1] IBM Res, Digital Hlth, 19-21 Nihonbashi Hakozaki Cho,Chuo, Tokyo 1038510, Japan
[2] Univ Tsukuba, Fac Med, Dept Psychiat, Div Clin Med, 1-1-1 Tennodai, Tsukuba, Ibaraki 3058575, Japan
来源
COMPUTER SPEECH AND LANGUAGE | 2023年 / 81卷
基金
日本学术振兴会;
关键词
Screening; Natural language processing; Machine learning; Self-administered; Automatic speech recognition; CONNECTED SPEECH; DEMENTIA; LANGUAGE; FLUENCY; RECOGNITION; PARAMETERS; DIAGNOSIS; VOICES; ADULTS; CARE;
D O I
10.1016/j.csl.2023.101514
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Speech and language disturbances have been observed from the early stages of Alzheimer's disease (AD), including mild cognitive impairment (MCI), and speech analysis has been expected to help as a screening tool for early detection of AD and MCI. However, the questions of whether and how automatic speech analysis, including speech recognition by a self-administered tool, can be used for such detection remain largely unexplored. In this study, we performed automatic analysis of speech data collected via a mobile application from 114 older participants during cognitive tasks. The goal was to classify AD, MCI, and cognitively normal (CN) groups by using speech features characterizing acoustic, prosodic, and linguistic aspects. First, we evaluated how accurately linguistic features could be automatically extracted from transcriptions generated by automatic speech recognition (ASR), and we found that the features were highly correlated (r = 0.92) with those extracted from manual transcriptions. Then, a machine-learning speech classifier using these features achieved 78.6% accuracy for classifying AD, MCI, and CN through nested cross-validation (AD versus CN: 91.2% accuracy; MCI versus CN: 87.6% accuracy). Our results suggest the utility and validity of using a mobile application with automatic speech analysis as a self-administered screening tool for early detection of AD and MCI.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Identifying Mild Cognitive Impairment and mild Alzheimer's disease based on spontaneous speech using ASR and linguistic features
    Gosztolya, Gabor
    Vincze, Veronika
    Toth, Laszlo
    Pakaski, Magdolna
    Kalman, Janos
    Hoffmann, Ildiko
    COMPUTER SPEECH AND LANGUAGE, 2019, 53 : 181 - 197
  • [2] Advanced AI techniques for classifying Alzheimer's disease and mild cognitive impairment
    Tascedda, Sophie
    Sarti, Pierfrancesco
    Rivi, Veronica
    Guerrera, Claudia Savia
    Platania, Giuseppe Alessio
    Santagati, Mario
    Caraci, Filippo
    Blom, Johanna M. C.
    FRONTIERS IN AGING NEUROSCIENCE, 2024, 16
  • [3] Ten Years of Research on Automatic Voice and Speech Analysis of People With Alzheimer's Disease and Mild Cognitive Impairment: A Systematic Review Article
    Martinez-Nicolas, Israel
    Llorente, Thide E.
    Martinez-Sanchez, Francisco
    Meilan, Juan Jose G.
    FRONTIERS IN PSYCHOLOGY, 2021, 12
  • [4] Computer-Assisted Speech Analysis in Mild Cognitive Impairment and Alzheimer's Disease: A Pilot Study from Shanghai, China
    Qiao, Yuan
    Xie, Xin-Yi
    Lin, Guo-Zhen
    Zou, Yang
    Chen, Sheng-Di
    Ren, Ru-Jing
    Wang, Gang
    JOURNAL OF ALZHEIMERS DISEASE, 2020, 75 (01) : 211 - 221
  • [5] Easy Screening for Mild Alzheimer's Disease and Mild Cognitive Impairment from Elderly Speech
    Kato, Shohei
    Homma, Akira
    Sakuma, Takuto
    CURRENT ALZHEIMER RESEARCH, 2018, 15 (02) : 104 - 110
  • [6] Linguistic Parameters of Spontaneous Speech for Identifying Mild Cognitive Impairment and Alzheimer Disease
    Vincze, Veronika
    Szabo, Martina Katalin
    Hoffmann, Ildiko
    Toth, Laszlo
    Pakaski, Magdolna
    Kalman, Janos
    Gosztolya, Gabor
    COMPUTATIONAL LINGUISTICS, 2022, 48 (01) : 43 - 75
  • [7] Voice Markers of Lexical Access in Mild Cognitive Impairment and Alzheimer's Disease
    Meilan, Juan J. G.
    Martinez-Sanchez, Francisco
    Carro, Juan
    Carcavilla, Nuria
    Ivanova, Olga
    CURRENT ALZHEIMER RESEARCH, 2018, 15 (02) : 111 - 119
  • [8] Connected speech and language in mild cognitive impairment and Alzheimer's disease: A review of picture description tasks
    Mueller, Kimberly D.
    Hermann, Bruce
    Mecollari, Jonilda
    Turkstra, Lyn S.
    JOURNAL OF CLINICAL AND EXPERIMENTAL NEUROPSYCHOLOGY, 2018, 40 (09) : 917 - 939
  • [9] A Comparison of Connected Speech Tasks for Detecting Early Alzheimer's Disease and Mild Cognitive Impairment Using Natural Language Processing and Machine Learning
    Clarke, Natasha
    Barrick, Thomas R.
    Garrard, Peter
    FRONTIERS IN COMPUTER SCIENCE, 2021, 3
  • [10] Combining Multimodal Behavioral Data of Gait, Speech, and Drawing for Classification of Alzheimer's Disease and Mild Cognitive Impairment
    Yamada, Yasunori
    Shinkawa, Kaoru
    Kobayashi, Masatomo
    Caggiano, Vittorio
    Nemoto, Miyuki
    Nemoto, Kiyotaka
    Arai, Tetsuaki
    Konig, Alexandra
    JOURNAL OF ALZHEIMERS DISEASE, 2021, 84 (01) : 315 - 327