A Channel-Fused Dense Convolutional Network for EEG-Based Emotion Recognition

被引:114
作者
Gao, Zhongke [1 ]
Wang, Xinmin [1 ]
Yang, Yuxuan [1 ]
Li, Yanli [1 ]
Ma, Kai [2 ]
Chen, Guanrong [3 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Tencent Jarvis Lab, Shenzhen 518057, Peoples R China
[3] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Electroencephalography; Feature extraction; Emotion recognition; Task analysis; Correlation; Brain modeling; Convolution; Brain-computer interface (BCI); convolutional neural network (CNN); deep learning (DL); electroencephalogram (EEG); emotion recognition; DIFFERENTIAL ENTROPY FEATURE; FEATURE-SELECTION; NEURAL-NETWORKS; CLASSIFICATION; BRAIN; FUSION;
D O I
10.1109/TCDS.2020.2976112
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human emotion recognition could greatly contribute to human-computer interaction with promising applications in artificial intelligence. One of the challenges in recognition tasks is learning effective representations with stable performances from electroencephalogram (EEG) signals. In this article, we propose a novel deep-learning framework, named channel-fused dense convolutional network, for EEG-based emotion recognition. First, we use a 1-D convolution layer to receive weighted combinations of contextual features along the temporal dimension from EEG signals. Next, inspired by state-of-the-art object classification techniques, we employ 1-D dense structures to capture electrode correlations along the spatial dimension. The developed algorithm is capable of handling temporal dependencies and electrode correlations with the effective feature extraction from noisy EEG signals. Finally, we perform extensive experiments based on two popular EEG emotion datasets. Results indicate that our framework achieves prominent average accuracies of 90.63% and 92.58% on the SEED and DEAP datasets, respectively, which both receive better performances than most of the compared studies. The novel model provides an interpretable solution with excellent generalization capacity for broader EEG-based classification tasks.
引用
收藏
页码:945 / 954
页数:10
相关论文
共 80 条
[1]   Convolutional Neural Networks for Speech Recognition [J].
Abdel-Hamid, Ossama ;
Mohamed, Abdel-Rahman ;
Jiang, Hui ;
Deng, Li ;
Penn, Gerald ;
Yu, Dong .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2014, 22 (10) :1533-1545
[2]   ECG Pattern Analysis for Emotion Detection [J].
Agrafioti, Foteini ;
Hatzinakos, Dimitrios ;
Anderson, Adam K. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) :102-115
[3]   DIFFERENTIAL LATERALIZATION FOR POSITIVE AND NEGATIVE EMOTION IN THE HUMAN-BRAIN - EEG SPECTRAL-ANALYSIS [J].
AHERN, GL ;
SCHWARTZ, GE .
NEUROPSYCHOLOGIA, 1985, 23 (06) :745-755
[4]   Social LSTM: Human Trajectory Prediction in Crowded Spaces [J].
Alahi, Alexandre ;
Goel, Kratarth ;
Ramanathan, Vignesh ;
Robicquet, Alexandre ;
Li Fei-Fei ;
Savarese, Silvio .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :961-971
[5]   Emotions Recognition Using EEG Signals: A Survey [J].
Alarcao, Soraia M. ;
Fonseca, Manuel J. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2019, 10 (03) :374-393
[6]  
Ali M, 2016, INT CONF UBIQ FUTUR, P946, DOI 10.1109/ICUFN.2016.7536936
[7]  
[Anonymous], 2018, Journal of neural engineering, DOI [10.1088/1741-2552/aace8c, DOI 10.1088/1741-2552/AACE8C]
[8]  
Ansari-Asl Karim, 2007, 2007 15th European Signal Processing Conference (EUSIPCO), P1241
[9]   Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers [J].
Atkinson, John ;
Campos, Daniel .
EXPERT SYSTEMS WITH APPLICATIONS, 2016, 47 :35-41
[10]  
Bashivan P., 2016, 4 INT C LEARN REPRES