Continuous Convolutional Neural Network with 3D Input for EEG-Based Emotion Recognition

被引:137
作者
Yang, Yilong [1 ]
Wu, Qingfeng [1 ]
Fu, Yazhen [1 ]
Chen, Xiaowei [1 ]
机构
[1] Xiamen Univ, Sch Software, Xiamen, Peoples R China
来源
NEURAL INFORMATION PROCESSING (ICONIP 2018), PT VII | 2018年 / 11307卷
关键词
EEG; Emotion recognition; CNN; Brain-Computer interface;
D O I
10.1007/978-3-030-04239-4_39
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic emotion recognition based on EEG is an important issue in Brain-Computer Interface (BCI) applications. In this paper, baseline signals were taken into account to improve recognition accuracy. Multi-Layer Perceptron (MLP), Decision Tree (DT) and our proposed approach were adopted to verify the effectiveness of baseline signals on classification results. Besides, a 3D representation of EEG segment was proposed to combine features of signals from different frequency bands while preserving spatial information among channels. The continuous convolutional neural network takes the constructed 3D EEG cube as input and makes prediction. Extensive experiments on public DEAP dataset indicate that the proposed method is well suited for emotion recognition tasks after considering the baseline signals. Our comparative experiments also confirmed that higher frequency bands of EEG signals can better characterize emotional states, and that the combination of features of multiple bands can complement each other and further improve the recognition accuracy.
引用
收藏
页码:433 / 443
页数:11
相关论文
共 18 条
[1]   A real-time automated system for the recognition of human facial expressions [J].
Anderson, K ;
McOwan, PW .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2006, 36 (01) :96-105
[2]  
[Anonymous], 2017, COGN COMPUT
[3]  
[Anonymous], 2017, IEEE T AFFECT COMPUT
[4]  
Basar E., 1980, COMPUT PROGRAMS BIOM, V14, P227
[5]  
Borrelli Francesco, 2017, ARXIV PREPRINT ARXIV
[6]  
Duan RN, 2013, I IEEE EMBS C NEUR E, P81, DOI 10.1109/NER.2013.6695876
[7]   DEAP: A Database for Emotion Analysis Using Physiological Signals [J].
Koelstra, Sander ;
Muhl, Christian ;
Soleymani, Mohammad ;
Lee, Jong-Seok ;
Yazdani, Ashkan ;
Ebrahimi, Touradj ;
Pun, Thierry ;
Nijholt, Anton ;
Patras, Ioannis .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) :18-31
[8]  
Li X., 2016, SIGNAL PROCESSING NE, P288, DOI [10.1007/978-981-10-1822-0, DOI 10.1007/978-981-10-1822-0]
[9]  
Li X, 2016, IEEE INT C BIOINFORM, P352, DOI 10.1109/BIBM.2016.7822545
[10]   Human Emotion Recognition with Electroencephalographic Multidimensional Features by Hybrid Deep Neural Networks [J].
Li, Youjun ;
Huang, Jiajin ;
Zhou, Haiyan ;
Zhong, Ning .
APPLIED SCIENCES-BASEL, 2017, 7 (10)