Project Achoo: A Practical Model and Application for COVID-19 Detection From Recordings of Breath, Voice, and Cough

被引:33
作者
Ponomarchuk, Alexander [1 ]
Burenko, Ilya [1 ]
Malkin, Elian [1 ]
Nazarov, Ivan [1 ]
Kokh, Vladimir [1 ]
Avetisian, Manvel [1 ]
Zhukov, Leonid [1 ]
机构
[1] Sberbank Russia, AI Lab, Moscow 228827, Russia
关键词
COVID-19; Feature extraction; Acoustics; Mel frequency cepstral coefficient; Hidden Markov models; Pandemics; Task analysis; Acoustic signal processing; signal detection; biomedical informatics; public heathcare; machine learning; Big Data applications; AUDIO; SOUND;
D O I
10.1109/JSTSP.2022.3142514
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The COVID-19 pandemic created significant interest and demand for infection detection and monitoring solutions. In this paper, we propose a machine learning method to quickly detect COVID-19 using audio recordings made on consumer devices. The approach combines signal processing and noise removal methods with an ensemble of fine-tuned deep learning networks and enables COVID detection on coughs. We have also developed and deployed a mobile application that uses a symptoms checker together with voice, breath, and cough signals to detect COVID-19 infection. The application showed robust performance on both openly sourced datasets and the noisy data collected during beta testing by the end users.
引用
收藏
页码:175 / 187
页数:13
相关论文
共 58 条
[1]   FluSense: A contactless syndromic surveillance platform for influenza-like illness in hospital waiting areas [J].
Hossain F.A. ;
Lover A.A. ;
Corey G.A. ;
Reich N.G. ;
Rahman T. .
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2020, 4 (01)
[2]   Deep Neural Networks for Identifying Cough Sounds [J].
Amoh, Justice ;
Odame, Kofi .
IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2016, 10 (05) :1003-1011
[3]   Cough Sound Analysis for Pneumonia and Asthma Classification in Pediatric Population [J].
Amrulloh, Yusuf ;
Abeyratne, Udantha ;
Swarnkar, Vinayak ;
Triasih, Rina .
PROCEEDINGS SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS, MODELLING AND SIMULATION, 2015, :127-131
[4]   A Generic Deep Learning Based Cough Analysis System From Clinically Validated Samples for Point-of-Need Covid-19 Test and Severity Levels [J].
Andreu-Perez, Javier ;
Perez-Espinosa, Humberto ;
Timonet, Eva ;
Kiani, Mehrin ;
Giron-Perez, Manuel, I ;
Benitez-Trinidad, Alma B. ;
Jarchi, Delaram ;
Rosales-Perez, Alejandro ;
Gkatzoulis, Nick ;
Reyes-Galaviz, Orion F. ;
Torres-Garcia, Alejandro ;
Reyes-Garcia, Carlos A. ;
Ali, Zulfiqar ;
Rivas, Francisco .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2022, 15 (03) :1220-1232
[5]  
[Anonymous], VIRUFY COVID 19 OPEN
[6]  
[Anonymous], 2021, DAT REC IND COUGH
[7]  
[Anonymous], REsp
[8]   Deep Learning Applications to Combat Novel Coronavirus (COVID-19) Pandemic [J].
Asraf A. ;
Islam M.Z. ;
Haque M.R. ;
Islam M.M. .
SN Computer Science, 2020, 1 (6)
[9]   CoRSAI: A System for Robust Interpretation of CT Scans of COVID-19 Patients Using Deep Learning [J].
Avetisian, Manvel ;
Burenko, Ilya ;
Egorov, Konstantin ;
Kokh, Vladimir ;
Nesterov, Aleksandr ;
Nikolaev, Aleksandr ;
Ponomarchuk, Alexander ;
Sokolova, Elena ;
Tuzhilin, Alex ;
Umerenkov, Dmitry .
ACM TRANSACTIONS ON MANAGEMENT INFORMATION SYSTEMS, 2021, 12 (04)
[10]  
Bagad P., 2020, Cough against COVID: evidence of COVID-19 signature in cough sounds