Evaluation of Machine Learning Algorithms and Explainability Techniques to Detect Hearing Loss From a Speech-in-Noise Screening Test

被引:17
作者
Lenatti, Marta [1 ]
Moreno-Sanchez, Pedro A. [2 ,3 ]
Polo, Edoardo M. [4 ]
Mollura, Maximiliano [5 ]
Barbieri, Riccardo [5 ]
Paglialonga, Alessia [1 ]
机构
[1] Natl Res Council Italy, Inst Elect Informat Engn & Telecommun, Milan, Italy
[2] Seinajoki Univ Appl Sci, Sch Hlth Care & Social Work, Seinajoki, Finland
[3] Tampere Univ, Fac Med & Hlth Technol, Seinajoki, Finland
[4] Sapienza Univ Rome, Dept Comp Control & Management Engn, Rome, Italy
[5] Politecn Milan, Dipartimento Elettron Informaz & Bioingn, Milan, Italy
关键词
CLASSIFICATION; IMPAIRMENT; PREVALENCE; PERCEPTION;
D O I
10.1044/2022_AJA-21-00194
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Purpose: The aim of this study was to analyze the performance of multivariate machine learning (ML) models applied to a speech-in-noise hearing screening test and investigate the contribution of the measured features toward hearing loss detection using explainability techniques. Method: Seven different ML techniques, including transparent (i.e., decision tree and logistic regression) and opaque (e.g., random forest) models, were trained and evaluated on a data set including 215 tested ears (99 with hearing loss of mild degree or higher and 116 with no hearing loss). Post hoc explainability techniques were applied to highlight the role of each feature in predicting hearing loss. Results: Random forest (accuracy =.85, sensitivity =.86, specificity =.85, precision =.84) performed, on average, better than decision tree (accuracy =.82, sensitivity =.84, specificity =.80, precision =.79). Support vector machine, logistic regression, and gradient boosting had similar performance as random forest. According to post hoc explainability analysis on models generated using random forest, the features with the highest relevance in predicting hearing loss were age, number and percentage of correct responses, and average reaction time, whereas the total test time had the lowest relevance. Conclusions: This study demonstrates that a multivariate approach can help detect hearing loss with satisfactory performance. Further research on a bigger sample and using more complex ML algorithms and explainability techniques is needed to fully investigate the role of input features (including additional features such as risk factors and individual responses to low-/high-frequency stimuli) in predicting hearing loss.
引用
收藏
页码:961 / 979
页数:19
相关论文
共 61 条
[1]  
[Anonymous], 1991, REPORT INFORMAL WORK
[2]  
[Anonymous], B WORLD HEALTH ORGAN
[3]   Principles and Practice of Explainable Machine Learning [J].
Belle, Vaishak ;
Papantonis, Ioannis .
FRONTIERS IN BIG DATA, 2021, 4
[4]   Effectiveness of a teleaudiology approach to hearing aid fitting [J].
Blamey, Peter J. ;
Blamey, Jeremy K. ;
Saunders, Elaine .
JOURNAL OF TELEMEDICINE AND TELECARE, 2015, 21 (08) :474-478
[5]  
Bosman AJ, 1995, AUDIOLOGY, V34, P260
[6]   Machine Learning Interpretability: A Survey on Methods and Metrics [J].
Carvalho, Diogo, V ;
Pereira, Eduardo M. ;
Cardoso, Jaime S. .
ELECTRONICS, 2019, 8 (08)
[7]   Language-independent processing in speech perception: Identification of English intervocalic consonants by speakers of eight European languages [J].
Cooke, Martin ;
Garcia Lecumberri, Maria Luisa ;
Scharenborg, Odette ;
van Dommelen, Wim A. .
SPEECH COMMUNICATION, 2010, 52 (11-12) :954-967
[8]   The impact of hearing loss on quality of life in older adults [J].
Dalton, DS ;
Cruickshanks, KJ ;
Klein, BEK ;
Klein, R ;
Wiley, TL ;
Nondahl, DM .
GERONTOLOGIST, 2003, 43 (05) :661-668
[9]   Hearing Impairment and Incident Dementia: Findings from the English Longitudinal Study of Ageing [J].
Davies, Hilary R. ;
Cadar, Dorina ;
Herbert, Annie ;
Orrell, Martin ;
Steptoe, Andrew .
JOURNAL OF THE AMERICAN GERIATRICS SOCIETY, 2017, 65 (09) :2074-2081
[10]   Acceptability, benefit and costs of early screening for hearing disability: a study of potential screening tests and models [J].
Davis, A. ;
Smith, P. ;
Ferguson, M. ;
Stephens, D. ;
Gianopoulos, I. .
HEALTH TECHNOLOGY ASSESSMENT, 2007, 11 (42) :1-+