ELECTROENCEPHALOGRAM-BASED EMOTION RECOGNITION USING A CONVOLUTIONAL NEURAL NETWORK

被引:0
作者
Savinov, V. B. [1 ]
Botman, S. A. [1 ]
Sapunov, V. V. [1 ]
Petrov, V. A. [1 ]
Samusev, I. G. [1 ]
Shusharina, N. N. [1 ]
机构
[1] Immanuel Kant Baltic Fed Univ, Kaliningrad, Russia
来源
BULLETIN OF RUSSIAN STATE MEDICAL UNIVERSITY | 2019年 / 03期
关键词
machine learning; artificial neural network; electroencephalogram; emotional state; valence; deep learning; convolutional networks; SELECTION;
D O I
10.24075/vrgmu.2019.037
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
The existing emotion recognition techniques based on the analysis of the tone of voice or facial expressions do not possess sufficient specificity and accuracy. These parameters can be significantly improved by employing physiological signals that escape the filters of human consciousness. The aim of this work was to carry out an EEG-based binary classification of emotional valence using a convolutional neural network and to compare its performance to that of a random forest algorithm. A healthy 30-year old male was recruited for the experiment. The experiment included 10 two-hour-long sessions of watching videos that the participant had selected according to his personal preferences. During the sessions, an electroencephalogram was recorded. Then, the signal was cleared of artifacts, segmented and fed to the model. Using a neural network, we were able to achieve a F1 score of 87%, which is significantly higher than the F1 score for a random forest model (67%). The results of our experiment suggest that convolutional neural networks in general and the proposed architecture in particular hold great promise for emotion recognition based on electrophysiological signals. Further refinement of the proposed approach may involve optimization of the network architecture to include more classes of emotions and improvement of the network's generalization capacity when working with a large number of participants.
引用
收藏
页码:34 / 38
页数:5
相关论文
共 21 条
  • [1] Ackermann P, 2016, 2016 IEEE 18TH INTERNATIONAL CONFERENCE ON E-HEALTH NETWORKING, APPLICATIONS AND SERVICES (HEALTHCOM), P159
  • [2] Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
    Calvo, Rafael A.
    D'Mello, Sidney
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2010, 1 (01) : 18 - 37
  • [3] Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces
    Cecotti, Hubert
    Graeser, Axel
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (03) : 433 - 445
  • [4] Gao Y, 2015, 2015 IEEE INT C MULT, P1, DOI DOI 10.1109/ICMEW.2015.7169796
  • [5] Feature Extraction and Selection for Emotion Recognition from EEG
    Jenke, Robert
    Peer, Angelika
    Buss, Martin
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2014, 5 (03) : 327 - 339
  • [6] Jerritta S., 2011, 2011 Proceedings of IEEE 7th International Colloquium on Signal Processing & its Applications (CSPA 2011), P410, DOI 10.1109/CSPA.2011.5759912
  • [7] Kingma DP, 2014, ARXIV
  • [8] DEAP: A Database for Emotion Analysis Using Physiological Signals
    Koelstra, Sander
    Muhl, Christian
    Soleymani, Mohammad
    Lee, Jong-Seok
    Yazdani, Ashkan
    Ebrahimi, Touradj
    Pun, Thierry
    Nijholt, Anton
    Patras, Ioannis
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) : 18 - 31
  • [9] Electroencephalography Based Fusion Two-Dimensional (2D)-Convolution Neural Networks (CNN) Model for Emotion Recognition System
    Kwon, Yea-Hoon
    Shin, Sae-Byuk
    Kim, Shin-Dug
    [J]. SENSORS, 2018, 18 (05)
  • [10] Hierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition
    Li, Jinpeng
    Zhang, Zhaoxiang
    He, Huiguang
    [J]. COGNITIVE COMPUTATION, 2018, 10 (02) : 368 - 380