A Deep-Learning Model for Subject-Independent Human Emotion Recognition Using Electrodermal Activity Sensors

被引:79
作者
Al Machot, Fadi [1 ]
Elmachot, Ali [2 ]
Ali, Mouhannad [3 ]
Al Machot, Elyan [4 ]
Kyamakya, Kyandoghere [3 ]
机构
[1] Res Ctr Borstel, Leibniz Lung Ctr, D-23845 Borstel, Germany
[2] Univ Damascus, Fac Mech & Elect Engn, Damascus, Syria
[3] Alpen Adira Univ, Inst Smart Syst Technol, A-9020 Klagenfurt, Austria
[4] Tech Univ Dresden, Carl Gustav Carus Fac Med, D-01069 Dresden, Germany
关键词
subject-dependent emotion recognition; subject-independent emotion recognition; electrodermal activity (EDA); deep learning; convolutional neural networks; ACCURACY;
D O I
10.3390/s19071659
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
One of the main objectives of Active and Assisted Living (AAL) environments is to ensure that elderly and/or disabled people perform/live well in their immediate environments; this can be monitored by among others the recognition of emotions based on non-highly intrusive sensors such as Electrodermal Activity (EDA) sensors. However, designing a learning system or building a machine-learning model to recognize human emotions while training the system on a specific group of persons and testing the system on a totally a new group of persons is still a serious challenge in the field, as it is possible that the second testing group of persons may have different emotion patterns. Accordingly, the purpose of this paper is to contribute to the field of human emotion recognition by proposing a Convolutional Neural Network (CNN) architecture which ensures promising robustness-related results for both subject-dependent and subject-independent human emotion recognition. The CNN model has been trained using a grid search technique which is a model hyperparameter optimization technique to fine-tune the parameters of the proposed CNN architecture. The overall concept's performance is validated and stress-tested by using MAHNOB and DEAP datasets. The results demonstrate a promising robustness improvement regarding various evaluation metrics. We could increase the accuracy for subject-independent classification to 78% and 82% for MAHNOB and DEAP respectively and to 81% and 85% subject-dependent classification for MAHNOB and DEAP respectively (4 classes/labels). The work shows clearly that while using solely the non-intrusive EDA sensors a robust classification of human emotion is possible even without involving additional/other physiological signals.
引用
收藏
页数:14
相关论文
共 50 条
[21]   Exploring the Effect of Age and Sex on Subject-Independent EEG-Based Emotion Recognition Methods [J].
Valderrama, Camilo E. ;
Sheoran, Anshul ;
Liu, Qian .
2024 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, CCECE 2024, 2024, :319-323
[22]   Subject-Independent Emotion Recognition of EEG Signals Based on Dynamic Empirical Convolutional Neural Network [J].
Liu, Shuaiqi ;
Wang, Xu ;
Zhao, Ling ;
Zhao, Jie ;
Xin, Qi ;
Wang, Shui-Hua .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2021, 18 (05) :1710-1721
[23]   Human Activity Recognition by Using Different Deep Learning Approaches for Wearable Sensors [J].
Çağatay Berke Erdaş ;
Selda Güney .
Neural Processing Letters, 2021, 53 :1795-1809
[24]   Human Activity Recognition by Using Different Deep Learning Approaches for Wearable Sensors [J].
Erdas, Cagatay Berke ;
Guney, Selda .
NEURAL PROCESSING LETTERS, 2021, 53 (03) :1795-1809
[25]   Deep-Learning-Based Human Activity Recognition Using Wearable Sensors [J].
Nouriani, A. ;
McGovern, R. A. ;
Rajamani, R. .
IFAC PAPERSONLINE, 2022, 55 (37) :1-6
[26]   Human activity recognition with smartphone sensors using deep learning neural networks [J].
Ronao, Charissa Ann ;
Cho, Sung-Bae .
EXPERT SYSTEMS WITH APPLICATIONS, 2016, 59 :235-244
[27]   Human Brain Waves Study Using EEG and Deep Learning for Emotion Recognition [J].
Priyadarshani, Muskan ;
Kumar, Pushpendra ;
Babulal, Kanojia Sindhuben ;
Rajput, Dharmendra Singh ;
Patel, Harshita .
IEEE ACCESS, 2024, 12 :101842-101850
[28]   Analysis of Deep Transfer Learning Using DeepConvLSTM for Human Activity Recognition fromWearable Sensors [J].
Kalabakov, Stefan ;
Gjoreski, Martin ;
Gjoreski, Hristijan ;
Gams, Matjaz .
INFORMATICA-AN INTERNATIONAL JOURNAL OF COMPUTING AND INFORMATICS, 2021, 45 (02) :289-296
[29]   Suspicious Human Activity Recognition From Surveillance Videos Using Deep Learning [J].
Mohamed Zaidi, Monji ;
Avelino Sampedro, Gabriel ;
Almadhor, Ahmad ;
Alsubai, Shtwai ;
Al Hejaili, Abdullah ;
Gregus, Michal ;
Abbas, Sidra .
IEEE ACCESS, 2024, 12 :105497-105510
[30]   Human Activity Recognition using Deep Learning [J].
Moola, Ramu ;
Hossain, Ashraf .
2022 URSI REGIONAL CONFERENCE ON RADIO SCIENCE, USRI-RCRS, 2022, :165-168