A Novel DE-CNN-BiLSTM Multi-Fusion Model for EEG Emotion Recognition

被引:44
作者
Cui, Fachang [1 ,2 ]
Wang, Ruqing [1 ,2 ]
Ding, Weiwei [1 ,2 ]
Chen, Yao [1 ,2 ]
Huang, Liya [1 ,2 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Elect & Opt Engn, Nanjing 210023, Peoples R China
[2] Natl & Local Joint Engn Lab RF Integrat & Microas, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
emotion recognition; DE; temporal and spatial feature; DE-CNN-BiLSTM; NEURAL-NETWORKS; CLASSIFICATION;
D O I
10.3390/math10040582
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
As a long-standing research topic in the field of brain-computer interface, emotion recognition still suffers from low recognition accuracy. In this research, we present a novel model named DE-CNN-BiLSTM deeply integrating the complexity of EEG signals, the spatial structure of brain and temporal contexts of emotion formation. Firstly, we extract the complexity properties of the EEG signal by calculating Differential Entropy in different time slices of different frequency bands to obtain 4D feature tensors according to brain location. Subsequently, the 4D tensors are input into the Convolutional Neural Network to learn brain structure and output time sequences; after that Bidirectional Long-Short Term Memory is used to learn past and future information of the time sequences. Compared with the existing emotion recognition models, the new model can decode the EEG signal deeply and extract key emotional features to improve accuracy. The simulation results show the algorithm achieves an average accuracy of 94% for DEAP dataset and 94.82% for SEED dataset, confirming its high accuracy and strong robustness.
引用
收藏
页数:11
相关论文
共 36 条
[1]   Emotions Recognition Using EEG Signals: A Survey [J].
Alarcao, Soraia M. ;
Fonseca, Manuel J. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2019, 10 (03) :374-393
[2]   A Novel Multivariate-Multiscale Approach for Computing EEG Spectral and Temporal Complexity for Human Emotion Recognition [J].
Bhattacharyya, Abhijit ;
Tripathy, Rajesh Kumar ;
Garg, Lalit ;
Pachori, Ram Bilas .
IEEE SENSORS JOURNAL, 2021, 21 (03) :3579-3591
[3]   Fourier-Bessel series expansion based empirical wavelet transform for analysis of non-stationary signals [J].
Bhattacharyya, Abhijit ;
Singh, Lokesh ;
Pachori, Ram Bilas .
DIGITAL SIGNAL PROCESSING, 2018, 78 :185-196
[4]   The Correlation between EEG Signals as Measured in Different Positions on Scalp Varying with Distance [J].
Bhavsar, Ronakben ;
Sun, Yi ;
Na Helian ;
Davey, Neil ;
Mayor, David ;
Steffert, Tony .
8TH ANNUAL INTERNATIONAL CONFERENCE ON BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES, BICA 2017 (EIGHTH ANNUAL MEETING OF THE BICA SOCIETY), 2018, 123 :92-97
[5]   Classification of First-Episode Schizophrenia, Chronic Schizophrenia and Healthy Control Based on Brain Network of Mismatch Negativity by Graph Neural Network [J].
Chang, Qi ;
Li, Cancheng ;
Tian, Qing ;
Bo, Qijing ;
Zhang, Jicong ;
Xiong, Yanbing ;
Wang, Chuanyue .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 :1784-1794
[6]   Sleep staging by bidirectional long short-term memory convolution neural network [J].
Chen, Xueyan ;
He, Jie ;
Wu, Xiaoqiang ;
Yan, Wei ;
Wei, Wei .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 109 :188-196
[7]   Compiled by the Vaccination Guidelines Group (VGG) of the World Small Animal Veterinary Association (WSAVA) [J].
Day, M. J. ;
Horzinek, M. C. ;
Schultz, R. D. .
JOURNAL OF SMALL ANIMAL PRACTICE, 2007, 48 (09) :528-541
[8]   Depression Prevalence in Postgraduate Students and Its Association With Gait Abnormality [J].
Fang, Jing ;
Wang, Tao ;
Li, Cancheng ;
Hu, Xiping ;
Ngai, Edith ;
Seet, Boon-Chong ;
Cheng, Jun ;
Guo, Yi ;
Jiang, Xin .
IEEE ACCESS, 2019, 7 :174425-174437
[9]   EEG based emotion recognition using fusion feature extraction method [J].
Gao, Qiang ;
Wang, Chu-han ;
Wang, Zhe ;
Song, Xiao-lin ;
Dong, En-zeng ;
Song, Yu .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (37-38) :27057-27074
[10]  
Graves A, 2013, INT CONF ACOUST SPEE, P6645, DOI 10.1109/ICASSP.2013.6638947