A Deep-Learning Model for Subject-Independent Human Emotion Recognition Using Electrodermal Activity Sensors

被引:74
|
作者
Al Machot, Fadi [1 ]
Elmachot, Ali [2 ]
Ali, Mouhannad [3 ]
Al Machot, Elyan [4 ]
Kyamakya, Kyandoghere [3 ]
机构
[1] Res Ctr Borstel, Leibniz Lung Ctr, D-23845 Borstel, Germany
[2] Univ Damascus, Fac Mech & Elect Engn, Damascus, Syria
[3] Alpen Adira Univ, Inst Smart Syst Technol, A-9020 Klagenfurt, Austria
[4] Tech Univ Dresden, Carl Gustav Carus Fac Med, D-01069 Dresden, Germany
关键词
subject-dependent emotion recognition; subject-independent emotion recognition; electrodermal activity (EDA); deep learning; convolutional neural networks; ACCURACY;
D O I
10.3390/s19071659
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
One of the main objectives of Active and Assisted Living (AAL) environments is to ensure that elderly and/or disabled people perform/live well in their immediate environments; this can be monitored by among others the recognition of emotions based on non-highly intrusive sensors such as Electrodermal Activity (EDA) sensors. However, designing a learning system or building a machine-learning model to recognize human emotions while training the system on a specific group of persons and testing the system on a totally a new group of persons is still a serious challenge in the field, as it is possible that the second testing group of persons may have different emotion patterns. Accordingly, the purpose of this paper is to contribute to the field of human emotion recognition by proposing a Convolutional Neural Network (CNN) architecture which ensures promising robustness-related results for both subject-dependent and subject-independent human emotion recognition. The CNN model has been trained using a grid search technique which is a model hyperparameter optimization technique to fine-tune the parameters of the proposed CNN architecture. The overall concept's performance is validated and stress-tested by using MAHNOB and DEAP datasets. The results demonstrate a promising robustness improvement regarding various evaluation metrics. We could increase the accuracy for subject-independent classification to 78% and 82% for MAHNOB and DEAP respectively and to 81% and 85% subject-dependent classification for MAHNOB and DEAP respectively (4 classes/labels). The work shows clearly that while using solely the non-intrusive EDA sensors a robust classification of human emotion is possible even without involving additional/other physiological signals.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Improving Subject-independent Human Emotion Recognition Using Electrodermal Activity Sensors for Active and Assisted Living
    Al Machot, Fadi
    Ali, Mouhannad
    Ranasinghe, Suneth
    Mosa, Ahmad Haj
    Kyandoghere, Kyamakya
    11TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS (PETRA 2018), 2018, : 222 - 228
  • [2] A deep learning approach for subject-dependent & subject-independent emotion recognition using brain signals with dimensional emotion model
    Ruchilekha
    Singh, Manoj Kumar
    Singh, Mona
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 84
  • [3] Multimodal Deep Learning Model for Subject-Independent EEG-based Emotion Recognition
    Dharia, Shyamal Y.
    Valderrama, Camilo E.
    Camorlinga, Sergio G.
    2023 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, CCECE, 2023,
  • [4] Deep learning framework for subject-independent emotion detection using wireless signals
    Khan, Ahsan Noor
    Ihalage, Achintha Avin
    Ma, Yihan
    Liu, Baiyang
    Liu, Yujie
    Hao, Yang
    PLOS ONE, 2021, 16 (02):
  • [5] Subject-Independent EEG-based Emotion Recognition using Adversarial Learning
    Hwang, Sunhee
    Ki, Minsong
    Hong, Kibeom
    Byun, Hyeran
    2020 8TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2020, : 99 - 102
  • [6] Comprehensive Study of Features for Subject-independent Emotion Recognition
    Ashutosh, A.
    Savitha, R.
    Suresh, S.
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 3114 - 3121
  • [7] Subject-independent human activity recognition using Smartphone accelerometer with cloud support
    Awan, Muhammad Arshad
    Zheng Guangbin
    Kim, Hie-Cheol
    Kim, Shin-Dug
    INTERNATIONAL JOURNAL OF AD HOC AND UBIQUITOUS COMPUTING, 2015, 20 (03) : 172 - 185
  • [8] Subject-Independent Slow Fall Detection with Wearable Sensors via Deep Learning
    Chen, Xiaoshuai
    Jiang, Shuo
    Lo, Benny
    2020 IEEE SENSORS, 2020,
  • [9] Subject-independent Emotion recognition based on Entropy of EEG Signals
    Yang, Haihui
    Rong, Panxiang
    Sun, Guobing
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 1513 - 1518
  • [10] Subject independent emotion recognition from EEG using VMD and deep learning
    Pandey, Pallavi
    Seeja, K. R.
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (05) : 1730 - 1738