Breeze: Smartphone-based acoustic real-time detection of breathing phases for a gamified biofeedback breathing training

被引:48
作者
Shih C.-H. [1 ]
Tomita N. [2 ]
Lukic Y.X. [1 ]
Reguera Á.H. [3 ]
Fleisch E. [4 ]
Kowatsch T. [4 ]
机构
[1] ETH Zürich, Zürich
[2] Geisel School of Medicine at Dartmouth, Lebanon, PA
[3] Universidad de Sevilla, Sevilla
[4] ETH Zürich, University of St. Gallen, Zürich, St. Gallen
关键词
Acoustic signal processing; Breathing detection; Breathing training; Deep learning; Gamified biofeedback; Real-time; Smartphone microphone;
D O I
10.1145/3369835
中图分类号
学科分类号
摘要
Slow-paced biofeedback-guided breathing training has been shown to improve cardiac functioning and psychological wellbeing. Current training options, however, attract only a fraction of individuals and are limited in their scalability as they require dedicated biofeedback hardware. In this work, we present Breeze, a mobile application that uses a smartphone's microphone to continuously detect breathing phases, which then trigger a gamified biofeedback-guided breathing training. Circa 2.76 million breathing sounds from 43 subjects and control sounds were collected and labeled to train and test our breathing detection algorithm. We model breathing as inhalation-pause-exhalation-pause sequences and implement a phase-detection system with an attention-based LSTM model in conjunction with a CNN-based breath extraction module. A biofeedback-guided breathing training with Breeze takes place in real-time and achieves 75.5% accuracy in breathing phases detection. Breeze was also evaluated in a pilot study with 16 new subjects, which demonstrated that the majority of subjects prefer Breeze over a validated active control condition in its usefulness, enjoyment, control, and usage intentions. Breeze is also effective for strengthening users' cardiac functioning by increasing high-frequency heart rate variability. The results of our study suggest that Breeze could potentially be utilized in clinical and self-care activities. Copyright © 2019 held by the owner/author(s).
引用
收藏
相关论文
共 84 条
[1]  
Amiriparian S., Gerczuk M., Ottl S., Cummins N., Freitag M., Pugachevskiy S., Baird A., Schuller B.W., Snore sound classification using image-based deep spectrum features, Proc. Interspeech 2017, pp. 3512-3516, (2017)
[2]  
Azam M.A., Shahzadi A., Khalid A., Anwar S.M., Naeem U., Smartphone based human breath analysis from respiratory sounds, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 445-448, (2018)
[3]  
Bahdanau D., Cho K., Bengio Y., Neural Machine Translation by Jointly Learning to Align and Translate, (2014)
[4]  
Bahoura M., Pattern recognition methods applied to respiratory sounds classification into normal and wheeze classes, Computers in Biology and Medicine, 39, 9, pp. 824-843, (2009)
[5]  
Barata F., Kipfer K., Weber M., Tinschert P., Fleisch E., Kowatsch T., Towards device-agnostic mobile cough detection with convolutional neural networks, 7th IEEE International Conference on Healthcare Informatics (ICHI 2019), (2019)
[6]  
Behar J., Roebuck A., Shahid M., Daly J., Hallack A., Palmius N., Stradling J., Clifford G.D., SleepAp: An automated obstructive sleep apnoea screening application for smartphones, IEEE Journal of Biomedical and Health Informatics, 19, 1, pp. 325-331, (2015)
[7]  
Benichou T., Pereira B., Mermillod M., Tauveron I., Pfabigan D., Maqdasy S., Dutheil F., Heart rate variability in type 2 diabetes mellitus: A systematic review and meta-analysis, Plos One, 13, 4, pp. 1-19, (2018)
[8]  
Bickmore T.W., Mitchell S.E., Jack B.W., Paasche-Orlow M.K., Pfeifer L.M., O'Donnell J., Response to a relational agent by hospital patients with depressive symptoms, Interacting with Computers, 22, 4, pp. 289-298, (2010)
[9]  
Bokov P., Mahut B., Flaud P., Delclaux C., Wheezing recognition algorithm using recordings of respiratory sounds at the mouth in a pediatric population, Computers in Biology and Medicine, 70, pp. 40-50, (2016)
[10]  
Brennan P., Perola M., Van-Ommen G.-J., Riboli E., Chronic disease research in Europe and the need for integrated population cohorts, European Journal of Epidemiology, 32, 9, pp. 741-749, (2017)