Electroencephalogram Emotion Recognition Based on 3D Feature Fusion and Convolutional Autoencoder

被引:22
作者
An, Yanling [1 ]
Hu, Shaohai [1 ]
Duan, Xiaoying [2 ]
Zhao, Ling [3 ]
Xie, Caiyun [4 ,5 ]
Zhao, Yingying [4 ,5 ]
机构
[1] Beijing Jiaotong Univ, Inst Informat Sci, Beijing, Peoples R China
[2] Northwest Univ, Sch Econom & Management, Xian, Shaanxi, Peoples R China
[3] Hebei Univ, Coll Qual & Syst Supervis, Baoding, Peoples R China
[4] Hebei Univ, Coll Elect & Informat Engn, Baoding, Peoples R China
[5] Machine Vis Technol Creat Ctr Hebei Prov, Baoding, Peoples R China
基金
中国国家自然科学基金;
关键词
emotion recognition; differential entropy; feature fusion; convolution neural network; stacked autoencoder; EEG; CLASSIFICATION; MODEL;
D O I
10.3389/fncom.2021.743426
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
As one of the key technologies of emotion computing, emotion recognition has received great attention. Electroencephalogram (EEG) signals are spontaneous and difficult to camouflage, so they are used for emotion recognition in academic and industrial circles. In order to overcome the disadvantage that traditional machine learning based emotion recognition technology relies too much on a manual feature extraction, we propose an EEG emotion recognition algorithm based on 3D feature fusion and convolutional autoencoder (CAE). First, the differential entropy (DE) features of different frequency bands of EEG signals are fused to construct the 3D features of EEG signals, which retain the spatial information between channels. Then, the constructed 3D features are input into the CAE constructed in this paper for emotion recognition. In this paper, many experiments are carried out on the open DEAP dataset, and the recognition accuracy of valence and arousal dimensions are 89.49 and 90.76%, respectively. Therefore, the proposed method is suitable for emotion recognition tasks.</p>
引用
收藏
页数:13
相关论文
共 26 条
[1]   Emotion recognition using empirical mode decomposition and approximation entropy [J].
Chen, Tian ;
Ju, Sihang ;
Yuan, Xiaohui ;
Elhoseny, Mohamed ;
Ren, Fuji ;
Fan, Mingyan ;
Chen, Zhangang .
COMPUTERS & ELECTRICAL ENGINEERING, 2018, 72 :383-392
[2]  
García HF, 2016, IEEE ENG MED BIO, P850, DOI 10.1109/EMBC.2016.7590834
[3]  
Guo KR, 2017, IEEE ENG MED BIO, P489, DOI 10.1109/EMBC.2017.8036868
[4]  
Joy Emily, 2021, 2021 7th International Conference on Advanced Computing and Communication Systems (ICACCS), P1858, DOI 10.1109/ICACCS51430.2021.9441999
[5]   Deep Spatio-Temporal Representation and Ensemble Classification for Attention Deficit/Hyperactivity Disorder [J].
Liu, Shuaiqi ;
Zhao, Ling ;
Wang, Xu ;
Xin, Qi ;
Zhao, Jie ;
Guttery, David S. ;
Zhang, Yu-Dong .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 :1-10
[6]   Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network [J].
Liu, Yu ;
Ding, Yufeng ;
Li, Chang ;
Cheng, Juan ;
Song, Rencheng ;
Wan, Feng ;
Chen, Xun .
COMPUTERS IN BIOLOGY AND MEDICINE, 2020, 123
[7]   Dynamic entropy-based pattern learning to identify emotions from EEG signals across individuals [J].
Lu, Yun ;
Wang, Mingjiang ;
Wu, Wanqing ;
Han, Yufei ;
Zhang, Qiquan ;
Chen, Shixiong .
MEASUREMENT, 2020, 150
[8]   EEG-Based Emotion Classification Using Spiking Neural Networks [J].
Luo, Yuling ;
Fu, Qiang ;
Xie, Juntao ;
Qin, Yunbai ;
Wu, Guopei ;
Liu, Junxiu ;
Jiang, Frank ;
Cao, Yi ;
Ding, Xuemei .
IEEE ACCESS, 2020, 8 :46007-46016
[9]   A CIRCUMPLEX MODEL OF AFFECT [J].
RUSSELL, JA .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 1980, 39 (06) :1161-1178
[10]   Multi-Scale Frequency Bands Ensemble Learning for EEG-Based Emotion Recognition [J].
Shen, Fangyao ;
Peng, Yong ;
Kong, Wanzeng ;
Dai, Guojun .
SENSORS, 2021, 21 (04) :1-20