A Deep-Learning Model for Subject-Independent Human Emotion Recognition Using Electrodermal Activity Sensors

被引:74
作者
Al Machot, Fadi [1 ]
Elmachot, Ali [2 ]
Ali, Mouhannad [3 ]
Al Machot, Elyan [4 ]
Kyamakya, Kyandoghere [3 ]
机构
[1] Res Ctr Borstel, Leibniz Lung Ctr, D-23845 Borstel, Germany
[2] Univ Damascus, Fac Mech & Elect Engn, Damascus, Syria
[3] Alpen Adira Univ, Inst Smart Syst Technol, A-9020 Klagenfurt, Austria
[4] Tech Univ Dresden, Carl Gustav Carus Fac Med, D-01069 Dresden, Germany
关键词
subject-dependent emotion recognition; subject-independent emotion recognition; electrodermal activity (EDA); deep learning; convolutional neural networks; ACCURACY;
D O I
10.3390/s19071659
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
One of the main objectives of Active and Assisted Living (AAL) environments is to ensure that elderly and/or disabled people perform/live well in their immediate environments; this can be monitored by among others the recognition of emotions based on non-highly intrusive sensors such as Electrodermal Activity (EDA) sensors. However, designing a learning system or building a machine-learning model to recognize human emotions while training the system on a specific group of persons and testing the system on a totally a new group of persons is still a serious challenge in the field, as it is possible that the second testing group of persons may have different emotion patterns. Accordingly, the purpose of this paper is to contribute to the field of human emotion recognition by proposing a Convolutional Neural Network (CNN) architecture which ensures promising robustness-related results for both subject-dependent and subject-independent human emotion recognition. The CNN model has been trained using a grid search technique which is a model hyperparameter optimization technique to fine-tune the parameters of the proposed CNN architecture. The overall concept's performance is validated and stress-tested by using MAHNOB and DEAP datasets. The results demonstrate a promising robustness improvement regarding various evaluation metrics. We could increase the accuracy for subject-independent classification to 78% and 82% for MAHNOB and DEAP respectively and to 81% and 85% subject-dependent classification for MAHNOB and DEAP respectively (4 classes/labels). The work shows clearly that while using solely the non-intrusive EDA sensors a robust classification of human emotion is possible even without involving additional/other physiological signals.
引用
收藏
页数:14
相关论文
共 47 条
[1]  
Al Machot F., 2011, 16th International Symposium on Theoretical Electrical Engineering Nonlinear Dynamics and Synchronization (INDS), P1
[2]   Improving Subject-independent Human Emotion Recognition Using Electrodermal Activity Sensors for Active and Assisted Living [J].
Al Machot, Fadi ;
Ali, Mouhannad ;
Ranasinghe, Suneth ;
Mosa, Ahmad Haj ;
Kyandoghere, Kyamakya .
11TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS (PETRA 2018), 2018, :222-228
[3]   CNN Based Subject-Independent Driver Emotion Recognition System Involving Physiological Signals for ADAS [J].
Ali, Mouhannad ;
Al Machot, Fadi ;
Mosa, Ahmad Haj ;
Kyamakya, Kyandoghere .
ADVANCED MICROSYSTEMS FOR AUTOMOTIVE APPLICATIONS 2016: SMART SYSTEMS FOR THE AUTOMOBILE OF THE FUTURE, 2016, :125-138
[4]  
Ali M, 2016, INT CONF UBIQ FUTUR, P946, DOI 10.1109/ICUFN.2016.7536936
[5]   AN INTRODUCTION TO KERNEL AND NEAREST-NEIGHBOR NONPARAMETRIC REGRESSION [J].
ALTMAN, NS .
AMERICAN STATISTICIAN, 1992, 46 (03) :175-185
[6]  
[Anonymous], AMSTER658
[7]  
[Anonymous], 2017, ENCY MACHINE LEARNIN
[8]  
[Anonymous], END TO END LEARNING
[9]  
[Anonymous], 2011, J. Mach. Learn. Res.
[10]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32