A Deep-Learning Model for Subject-Independent Human Emotion Recognition Using Electrodermal Activity Sensors

被引:74
作者
Al Machot, Fadi [1 ]
Elmachot, Ali [2 ]
Ali, Mouhannad [3 ]
Al Machot, Elyan [4 ]
Kyamakya, Kyandoghere [3 ]
机构
[1] Res Ctr Borstel, Leibniz Lung Ctr, D-23845 Borstel, Germany
[2] Univ Damascus, Fac Mech & Elect Engn, Damascus, Syria
[3] Alpen Adira Univ, Inst Smart Syst Technol, A-9020 Klagenfurt, Austria
[4] Tech Univ Dresden, Carl Gustav Carus Fac Med, D-01069 Dresden, Germany
关键词
subject-dependent emotion recognition; subject-independent emotion recognition; electrodermal activity (EDA); deep learning; convolutional neural networks; ACCURACY;
D O I
10.3390/s19071659
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
One of the main objectives of Active and Assisted Living (AAL) environments is to ensure that elderly and/or disabled people perform/live well in their immediate environments; this can be monitored by among others the recognition of emotions based on non-highly intrusive sensors such as Electrodermal Activity (EDA) sensors. However, designing a learning system or building a machine-learning model to recognize human emotions while training the system on a specific group of persons and testing the system on a totally a new group of persons is still a serious challenge in the field, as it is possible that the second testing group of persons may have different emotion patterns. Accordingly, the purpose of this paper is to contribute to the field of human emotion recognition by proposing a Convolutional Neural Network (CNN) architecture which ensures promising robustness-related results for both subject-dependent and subject-independent human emotion recognition. The CNN model has been trained using a grid search technique which is a model hyperparameter optimization technique to fine-tune the parameters of the proposed CNN architecture. The overall concept's performance is validated and stress-tested by using MAHNOB and DEAP datasets. The results demonstrate a promising robustness improvement regarding various evaluation metrics. We could increase the accuracy for subject-independent classification to 78% and 82% for MAHNOB and DEAP respectively and to 81% and 85% subject-dependent classification for MAHNOB and DEAP respectively (4 classes/labels). The work shows clearly that while using solely the non-intrusive EDA sensors a robust classification of human emotion is possible even without involving additional/other physiological signals.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Human Activity Recognition by Using Different Deep Learning Approaches for Wearable Sensors
    Çağatay Berke Erdaş
    Selda Güney
    Neural Processing Letters, 2021, 53 : 1795 - 1809
  • [22] Human Activity Recognition by Using Different Deep Learning Approaches for Wearable Sensors
    Erdas, Cagatay Berke
    Guney, Selda
    NEURAL PROCESSING LETTERS, 2021, 53 (03) : 1795 - 1809
  • [23] Deep-Learning-Based Human Activity Recognition Using Wearable Sensors
    Nouriani, A.
    McGovern, R. A.
    Rajamani, R.
    IFAC PAPERSONLINE, 2022, 55 (37): : 1 - 6
  • [24] Human activity recognition with smartphone sensors using deep learning neural networks
    Ronao, Charissa Ann
    Cho, Sung-Bae
    EXPERT SYSTEMS WITH APPLICATIONS, 2016, 59 : 235 - 244
  • [25] Human Brain Waves Study Using EEG and Deep Learning for Emotion Recognition
    Priyadarshani, Muskan
    Kumar, Pushpendra
    Babulal, Kanojia Sindhuben
    Rajput, Dharmendra Singh
    Patel, Harshita
    IEEE ACCESS, 2024, 12 : 101842 - 101850
  • [26] Analysis of Deep Transfer Learning Using DeepConvLSTM for Human Activity Recognition fromWearable Sensors
    Kalabakov, Stefan
    Gjoreski, Martin
    Gjoreski, Hristijan
    Gams, Matjaz
    INFORMATICA-AN INTERNATIONAL JOURNAL OF COMPUTING AND INFORMATICS, 2021, 45 (02): : 289 - 296
  • [27] Suspicious Human Activity Recognition From Surveillance Videos Using Deep Learning
    Mohamed Zaidi, Monji
    Avelino Sampedro, Gabriel
    Almadhor, Ahmad
    Alsubai, Shtwai
    Al Hejaili, Abdullah
    Gregus, Michal
    Abbas, Sidra
    IEEE ACCESS, 2024, 12 : 105497 - 105510
  • [28] Human Activity Recognition using Deep Learning
    Moola, Ramu
    Hossain, Ashraf
    2022 URSI REGIONAL CONFERENCE ON RADIO SCIENCE, USRI-RCRS, 2022, : 165 - 168
  • [29] EMOTION RECOGNITION USING DEEP LEARNING
    Priya, R. N. Beena
    Hanmandlu, M.
    Vasikarla, Shantaram
    2021 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2021,