Driver Stress State Evaluation by Means of Thermal Imaging: A Supervised Machine Learning Approach Based on ECG Signal

被引:43
作者
Cardone, Daniela [1 ]
Perpetuini, David [1 ]
Filippini, Chiara [1 ]
Spadolini, Edoardo [2 ]
Mancini, Lorenza [2 ]
Chiarelli, Antonio Maria [1 ]
Merla, Arcangelo [1 ,2 ]
机构
[1] Univ G dAnnunzio, Dept Neurosci Imaging & Clin Sci DNISC, I-66100 Chieti, Italy
[2] Next2U Srl, I-65127 Pescara, Italy
来源
APPLIED SCIENCES-BASEL | 2020年 / 10卷 / 16期
基金
欧盟地平线“2020”;
关键词
driver stress state; IR imaging; machine learning; support vector machine (SVR); advanced driver-assistance systems (ADAS); VARIABILITY; EMOTIONS;
D O I
10.3390/app10165673
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Traffic accidents determine a large number of injuries, sometimes fatal, every year. Among other factors affecting a driver's performance, an important role is played by stress which can decrease decision-making capabilities and situational awareness. In this perspective, it would be beneficial to develop a non-invasive driver stress monitoring system able to recognize the driver's altered state. In this study, a contactless procedure for drivers' stress state assessment by means of thermal infrared imaging was investigated. Thermal imaging was acquired during an experiment on a driving simulator, and thermal features of stress were investigated with comparison to a gold-standard metric (i.e., the stress index, SI) extracted from contact electrocardiography (ECG). A data-driven multivariate machine learning approach based on a non-linear support vector regression (SVR) was employed to estimate the SI through thermal features extracted from facial regions of interest (i.e., nose tip, nostrils, glabella). The predicted SI showed a good correlation with the real SI (r = 0.61, p = similar to 0). A two-level classification of the stress state (STRESS, SI >= 150, versus NO STRESS, SI < 150) was then performed based on the predicted SI. The ROC analysis showed a good classification performance with an AUC of 0.80, a sensitivity of 77%, and a specificity of 78%.
引用
收藏
页数:17
相关论文
共 58 条
[1]  
Amos B, 2016, CMU Sch. Comput. Sci., V16, P1
[2]  
[Anonymous], 2000, JAMA, V284, P3043
[3]  
[Anonymous], 2005, CHI 05 EXTENDED ABST
[4]  
Baevsky RM, 2017, CARDIOMETRY, P66, DOI 10.12710/cardiometry.2017.10.6676
[5]  
Baltruaitis T., 2014, THESIS
[6]  
Baltrusaitis T, 2016, IEEE WINT CONF APPL
[7]   Constrained Local Neural Fields for robust facial landmark detection in the wild [J].
Baltrusaitis, Tadas ;
Robinson, Peter ;
Morency, Louis-Philippe .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2013, :354-361
[8]   Automatic driver sleepiness detection using EEG, EOG and contextual information [J].
Barua, Shaibal ;
Ahmed, Mobyen Uddin ;
Ahlstrom, Christer ;
Begum, Shahina .
EXPERT SYSTEMS WITH APPLICATIONS, 2019, 115 :121-135
[9]   Three Decades of Driver Assistance Systems Review and Future Perspectives [J].
Bengler, Klaus ;
Dietmayer, Klaus ;
Faerber, Berthold ;
Maurer, Markus ;
Stiller, Christoph ;
Winner, Hermann .
IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2014, 6 (04) :6-22
[10]  
Bradski G., 2008, Learning OpenCV