A 3D Convolutional Neural Network for Emotion Recognition based on EEG Signals

被引:15
作者
Zhao, Yuxuan [1 ,2 ]
Yang, Jin [1 ]
Lin, Jinlong [1 ]
Yu, Dunshan [1 ]
Cao, Xixin [1 ]
机构
[1] Peking Univ, Sch Software & Microelect, Beijing, Peoples R China
[2] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
来源
2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2020年
关键词
Emotion Recognition; Electroencephalography (EEG); 3D Convolutional Neural Network (3D CNN); Spatiotemporal Features; Deep Learning; CLASSIFICATION; TIME;
D O I
10.1109/ijcnn48605.2020.9207420
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As an important field of research in Human-Machine Interactions, emotion recognition based on the electroencephalography (EEG) signals has become common research. The traditional machine learning approaches use well-designed classifiers with hand-crafted features which may be limited to domain knowledge. Motivated by the outstanding performance of deep learning approaches in recognition tasks, we proposed a 3D convolutional neural network model to extract the spatial-temporal features automatically in the EEG signals. By the preprocessing method with baseline signals and the electrode topological structure relocated, the proposed model achieves a high accuracy rate of 96.61%, 96.43% in the Two class classification task (low/high arousal, low/high valence) and 93.53% in the Four class classification task (low arousal and low valence/high arousal and low valence/low arousal and high valence/high arousal and high valence) in the DEAP dataset, and 97.52%, 96.96% in the Two class classification task and 95.86% in the Four class classification task in the AMIGOS dataset.
引用
收藏
页数:6
相关论文
共 27 条
[1]  
Abadi M., C P, V16, P265
[2]  
Alarcao SM, 2017, IEEE T AFFECT COMPUT, V10, P374, DOI [10.1109/TAFFC.2017, DOI 10.1109/TAFFC.2017, 10.1109/TAFFC.2017.2714671, DOI 10.1109/TAFFC.2017.2714671]
[3]   Toward Emotion Aware Computing: An Integrated Approach Using Multichannel Neurophysiological Recordings and Affective Visual Stimuli [J].
Frantzidis, Christos A. ;
Bratsas, Charalampos ;
Papadelis, Christos L. ;
Konstantinidis, Evdokimos ;
Pappas, Costas ;
Bamidis, Panagiotis D. .
IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, 2010, 14 (03) :589-597
[4]   Cross-Subject Emotion Recognition Using Flexible Analytic Wavelet Transform From EEG Signals [J].
Gupta, Vipin ;
Chopda, Mayur Dahyabhai ;
Pachori, Ram Bilas .
IEEE SENSORS JOURNAL, 2019, 19 (06) :2266-2274
[5]  
Han HR, 2017, INT CONF SOFTW ENG, P130, DOI 10.1109/ICSESS.2017.8342880
[6]   A Convolutional Neural Network approach for classification of dementia stages based on 2D-spectral representation of EEG recordings [J].
Ieracitano, Cosimo ;
Mammone, Nadia ;
Bramanti, Alessia ;
Hussain, Amir ;
Morabito, Francesco C. .
NEUROCOMPUTING, 2019, 323 :96-107
[7]   Feature Extraction and Selection for Emotion Recognition from EEG [J].
Jenke, Robert ;
Peer, Angelika ;
Buss, Martin .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2014, 5 (03) :327-339
[8]   DEAP: A Database for Emotion Analysis Using Physiological Signals [J].
Koelstra, Sander ;
Muhl, Christian ;
Soleymani, Mohammad ;
Lee, Jong-Seok ;
Yazdani, Ashkan ;
Ebrahimi, Touradj ;
Pun, Thierry ;
Nijholt, Anton ;
Patras, Ioannis .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) :18-31
[9]   Electroencephalography Based Fusion Two-Dimensional (2D)-Convolution Neural Networks (CNN) Model for Emotion Recognition System [J].
Kwon, Yea-Hoon ;
Shin, Sae-Byuk ;
Kim, Shin-Dug .
SENSORS, 2018, 18 (05)
[10]   Exploring temporal representations by leveraging attention-based bidirectional LSTM-RNNs for multi-modal emotion recognition [J].
Li, Chao ;
Bao, Zhongtian ;
Li, Linhao ;
Zhao, Ziping .
INFORMATION PROCESSING & MANAGEMENT, 2020, 57 (03)