Enhanced Drowsiness Detection Using Deep Learning: An fNIRS Study

被引:51
作者
Tanveer, M. Asjid [1 ]
Khan, M. Jawad [1 ]
Qureshi, M. Jahangir [2 ]
Naseer, Noman [2 ]
Hong, Keum-Shik [3 ]
机构
[1] Natl Univ Sci & Technol, Sch Mech & Mfg Engn, Islamabad 441, Pakistan
[2] Air Univ, Dept Mech Engn, Islamabad 44000, Pakistan
[3] Pusan Natl Univ, Sch Mech Engn, Busan 46241, South Korea
基金
新加坡国家研究基金会;
关键词
Drowsiness detection; functional near-infrared spectroscopy; deep neural network; convolutional neural network; brain-computer interface; NEAR-INFRARED SPECTROSCOPY; BRAIN-COMPUTER INTERFACES; EEG; CLASSIFICATION; SLEEPINESS; SYSTEM; BCI;
D O I
10.1109/ACCESS.2019.2942838
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, a deep-learning-based driver-drowsiness detection for brain-computer interface (BCI) using functional near-infrared spectroscopy (fNIRS) is investigated. The passive brain signals from drowsiness were acquired from 13 healthy subjects while driving a car simulator. The brain activities were measured with a continuous-wave fNIRS system, in which the prefrontal and dorsolateral prefrontal cortices were focused. Deep neural networks (DNN) were pursued to classify the drowsy and alert states. For training and testing the models, the convolutional neural networks (CNN) were used on color map images to determine the best suitable channels for brain activity detection in 0 similar to 1, 0 similar to 3, 0 similar to 5, and 0 similar to 10 second time windows. The average accuracies (i.e., 82.7, 89.4, 93.7, and 97.2% in the 0 similar to 1, 0 similar to 3, 0 similar to 5, and 0 similar to 10 sec time windows, respectively) using DNNs from the right dorsolateral prefrontal cortex were obtained. The CNN architecture resulted in an average accuracy of 99.3%, showing the model to be capable of differentiating the images of drowsy/non-drowsy states. The proposed approach is promising for detecting drowsiness and in accessing the brain location for a passive BCI.
引用
收藏
页码:137920 / 137929
页数:10
相关论文
共 67 条
[1]   Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data [J].
Ahn, Sangtae ;
Nguyen, Thien ;
Jang, Hyojung ;
Kim, Jae G. ;
Jun, Sung C. .
FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10
[2]   Deep Visual Saliency on Stereoscopic Images [J].
Anh-Duc Nguyen ;
Kim, Jongyoo ;
Oh, Heeseok ;
Kim, Haksub ;
Lin, Weisi ;
Lee, Sanghoon .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (04) :1939-1953
[3]   Modified Beer-Lambert law for blood flow [J].
Baker, Wesley B. ;
Parthasarathy, Ashwin B. ;
Busch, David R. ;
Mesquita, Rickson C. ;
Greenberg, Joel H. ;
Yodh, A. G. .
BIOMEDICAL OPTICS EXPRESS, 2014, 5 (11) :4053-4075
[4]   Autoregressive model based algorithm for correcting motion and serially correlated errors in fNIRS [J].
Barker, Jeffrey W. ;
Aarabi, Ardalan ;
Huppert, Theodore J. .
BIOMEDICAL OPTICS EXPRESS, 2013, 4 (08) :1366-1379
[5]   Automatic driver sleepiness detection using EEG, EOG and contextual information [J].
Barua, Shaibal ;
Ahmed, Mobyen Uddin ;
Ahlstrom, Christer ;
Begum, Shahina .
EXPERT SYSTEMS WITH APPLICATIONS, 2019, 115 :121-135
[6]   Current State and Future Prospects of EEG and fNIRS in Robot-Assisted Gait Rehabilitation: A Brief Review [J].
Berger, Alisa ;
Horst, Fabian ;
Mueller, Sophia ;
Steinberg, Fabian ;
Doppelmayr, Michael .
FRONTIERS IN HUMAN NEUROSCIENCE, 2019, 13
[7]   Single-trial lie detection using a combined fNIRS-polygraph system [J].
Bhutta, M. Raheel ;
Hong, Melissa J. ;
Kim, Yun-Hee ;
Hong, Keum-Shik .
FRONTIERS IN PSYCHOLOGY, 2015, 6
[8]   Note: Three wavelengths near-infrared spectroscopy system for compensating the light absorbance by water [J].
Bhutta, M. Raheel ;
Hong, Keum-Shik ;
Kim, Beop-Min ;
Hong, Melissa Jiyoun ;
Kim, Yun-Hee ;
Lee, Se-Ho .
REVIEW OF SCIENTIFIC INSTRUMENTS, 2014, 85 (02)
[9]   Twenty years of functional near-infrared spectroscopy: introduction for the special issue [J].
Boas, David A. ;
Elwell, Clare E. ;
Ferrari, Marco ;
Taga, Gentaro .
NEUROIMAGE, 2014, 85 :1-5
[10]   Decoding Vigilance with NIRS [J].
Bogler, Carsten ;
Mehnert, Jan ;
Steinbrink, Jens ;
Haynes, John-Dylan .
PLOS ONE, 2014, 9 (07)