Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks

被引:164
作者
Chen, J. X. [1 ,2 ]
Zhang, P. W. [2 ]
Mao, Z. J. [3 ]
Huang, Y. F. [3 ,4 ]
Jiang, D. M. [1 ]
Zhang, Andy N. [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci & Engn, Xian 710072, Shaanxi, Peoples R China
[2] Shaanxi Univ Sci & Technol, Dept Elect & Informat Engn, Xian 710021, Shaanxi, Peoples R China
[3] Univ Texas San Antonio, Dept Elect & Comp Engn, San Antonio, TX 78249 USA
[4] Univ Texas Hlth Sci Ctr San Antonio, Dept Epidemiol & Biostat, San Antonio, TX 78284 USA
基金
中国国家自然科学基金;
关键词
EEG; emotion recognition; convolution neural network; combined features; deep learning;
D O I
10.1109/ACCESS.2019.2908285
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In order to improve the accuracy of emotional recognition by end-to-end automatic learning of emotional features in spatial and temporal dimensions of electroencephalogram (EEG), an EEG emotional feature learning and classification method using deep convolution neural network (CNN) was proposed based on temporal features, frequential features, and their combinations of EEG signals in DEAP dataset. The shallow machine learning models including bagging tree (BT), support vector machine (SVM), linear discriminant analysis (LDA), and Bayesian linear discriminant analysis (BLDA) models and deep CNN models were used to make emotional binary classification experiments on DEAP datasets in valence and arousal dimensions. The experimental results showed that the deep CNN models which require no feature engineering achieved the best recognition performance on temporal and frequency combined features in both valence and arousal dimensions, which is 3.58% higher than the performance of the best traditional BT classifier in valence dimension and 3.29% higher than that of BT classifier in arousal dimension.
引用
收藏
页码:44317 / 44328
页数:12
相关论文
共 32 条
  • [1] Ahmed S, 2013, IEEE GLOB CONF SIG, P33, DOI 10.1109/GlobalSIP.2013.6736804
  • [2] Alhagry S, 2017, INT J ADV COMPUT SC, V8, P355, DOI 10.14569/IJACSA.2017.081046
  • [3] [Anonymous], 2013 IEEE BRAIN COMP
  • [4] Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers
    Atkinson, John
    Campos, Daniel
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2016, 47 : 35 - 41
  • [5] Brain oscillations and BIS/BAS (behavioral inhibition/activation system) effects on processing masked emotional cues. ERS/ERD and coherence measures of alpha band
    Balconi, Michela
    Mazza, Guido
    [J]. INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2009, 74 (02) : 158 - 165
  • [6] Chen J.X., COMPUT ENG, DOI [10.19678/j.issn.1000-3428, DOI 10.19678/J.ISSN.1000-3428]
  • [7] Chen Y.F., 2017, Syst Simul Technol, V13, P1
  • [8] FAN S, 2017, PROC 8TH INT IEEE EM, P17
  • [9] Graves A, 2012, STUD COMPUT INTELL, V385, P1, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
  • [10] A fast learning algorithm for deep belief nets
    Hinton, Geoffrey E.
    Osindero, Simon
    Teh, Yee-Whye
    [J]. NEURAL COMPUTATION, 2006, 18 (07) : 1527 - 1554