Non-Contact Respiration Monitoring and Body Movements Detection for Sleep Using Thermal Imaging

被引:49
作者
Jakkaew, Prasara [1 ,2 ]
Onoye, Takao [1 ]
机构
[1] Osaka Univ, Grad Sch Informat Sci & Technol, Dept Informat Syst Engn, Informat Syst Synth Lab, 1-5 Yamadaoka, Suita, Osaka 5650871, Japan
[2] Mae Fah Luang Univ, Sch Informat Technol, 333-1 Thasud, Muang 57100, Chiang Rai, Thailand
关键词
respiration monitoring; non-contact monitoring; body movements detection; thermal imaging; natural sleep environments; APNEA;
D O I
10.3390/s20216307
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Monitoring of respiration and body movements during sleep is a part of screening sleep disorders related to health status. Nowadays, thermal-based methods are presented to monitor the sleeping person without any sensors attached to the body to protect privacy. A non-contact respiration monitoring based on thermal videos requires visible facial landmarks like nostril and mouth. The limitation of these techniques is the failure of face detection while sleeping with a fixed camera position. This study presents the non-contact respiration monitoring approach that does not require facial landmark visibility under the natural sleep environment, which implies an uncontrolled sleep posture, darkness, and subjects covered with a blanket. The automatic region of interest (ROI) extraction by temperature detection and breathing motion detection is based on image processing integrated to obtain the respiration signals. A signal processing technique was used to estimate respiration and body movements information from a sequence of thermal video. The proposed approach has been tested on 16 volunteers, for which video recordings were carried out by themselves. The participants were also asked to wear the Go Direct respiratory belt for capturing reference data. The result revealed that our proposed measuring respiratory rate obtains root mean square error (RMSE) of 1.82 +/- 0.75 bpm. The advantage of this approach lies in its simplicity and accessibility to serve users who require monitoring the respiration during sleep without direct contact by themselves.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 44 条
[1]   Neonatal non-contact respiratory monitoring based on real-time infrared thermography [J].
Abbas, Abbas K. ;
Heimann, Konrad ;
Jergus, Katrin ;
Orlikowsky, Thorsten ;
Leonhardt, Steffen .
BIOMEDICAL ENGINEERING ONLINE, 2011, 10
[2]  
Al-Kalidi F., 2015, International Journal of Scientifc and Engineering Research, V6, P1748
[3]   Remote respiratory monitoring system based on developing motion magnification technique [J].
Al-Naji, Ali ;
Chahl, Javaan .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2016, 29 :1-10
[4]   Thermal image processing for real-time non-contact respiration rate monitoring [J].
Alkali A.H. ;
Saatchi R. ;
Elphick H. ;
Burke D. .
IET Circuits, Devices and Systems, 2017, 11 (02) :142-148
[5]   Facial Tracking in Thermal Images for Real-Time Noncontact Respiration Rate Monitoring [J].
Alkali, Abdulkadir Hamidu ;
Saatchi, Reza ;
Elphick, Heather ;
Burke, Derek .
UKSIM-AMSS SEVENTH EUROPEAN MODELLING SYMPOSIUM ON COMPUTER MODELLING AND SIMULATION (EMS 2013), 2013, :265-270
[6]  
[Anonymous], 2010, P ACSIEEE INT C COMP, DOI 10.1109/AICCSA.2010.5586994.
[7]  
[Anonymous], 2015, INT J COMPUT APPL, DOI DOI 10.5120/21059-3716
[8]  
Bennett SL, 2015, IEEE ENG MED BIO, P7474, DOI 10.1109/EMBC.2015.7320120
[9]   Sleep Monitoring using an Infrared Thermal Array Sensor [J].
Chen, Zhangjie ;
Wang, Ya .
SENSORS AND SMART STRUCTURES TECHNOLOGIES FOR CIVIL, MECHANICAL, AND AEROSPACE SYSTEMS 2019, 2019, 10970
[10]   The objective medical emergency team activation criteria: A case-control study [J].
Cretikos, Michelle ;
Chen, Jack ;
Hillman, Ken ;
Bellomo, Rinaldo ;
Finfer, Simon ;
Flabouris, Arthas .
RESUSCITATION, 2007, 73 (01) :62-72