Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks

被引:1564
作者
Zheng, Wei-Long [1 ,2 ]
Lu, Bao-Liang [1 ,2 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Ctr Brain Like Comp & Machine Intelligence, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Key Lab Shanghai Educ Commiss Intelligent Interac, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Affective computing; deep belief networks; EEG; emotion recognition; DIFFERENTIAL ENTROPY FEATURE; DRY ELECTRODE; MUSIC; ASYMMETRY; RESPONSES; MODELS; BRAIN; CLASSIFICATION; DYNAMICS; STIMULI;
D O I
10.1109/TAMD.2015.2431497
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To investigate critical frequency bands and channels, this paper introduces deep belief networks (DBNs) to constructing EEG-based emotion recognition models for three emotions: positive, neutral and negative. We develop an EEG dataset acquired from 15 subjects. Each subject performs the experiments twice at the interval of a few days. DBNs are trained with differential entropy features extracted from multichannel EEG data. We examine the weights of the trained DBNs and investigate the critical frequency bands and channels. Four different profiles of 4, 6, 9, and 12 channels are selected. The recognition accuracies of these four profiles are relatively stable with the best accuracy of 86.65%, which is even better than that of the original 62 channels. The critical frequency bands and channels determined by using the weights of trained DBNs are consistent with the existing observations. In addition, our experiment results show that neural signatures associated with different emotions do exist and they share commonality across sessions and individuals. We compare the performance of deep models with shallow models. The average accuracies of DBN, SVM, LR, and KNN are 86.08%, 83.99%, 82.70%, and 72.60%, respectively.
引用
收藏
页码:162 / 175
页数:14
相关论文
共 61 条
[51]   EEG-based vigilance estimation using extreme learning machines [J].
Shi, Li-Chen ;
Lu, Bao-Liang .
NEUROCOMPUTING, 2013, 102 :135-143
[52]   Off-Line and On-Line Vigilance Estimation Based on Linear Dynamical System and Manifold Learning [J].
Shi, Li-Chen ;
Lu, Bao-Liang .
2010 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2010, :6587-6590
[53]  
Soleymani M, 2014, IEEE INT CON MULTI
[54]   Multimodal Emotion Recognition in Response to Videos [J].
Soleymani, Mohammad ;
Pantic, Maja ;
Pun, Thierry .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (02) :211-223
[55]  
Valenzi S., 2014, Journal of Biomedical Science and Engineering, P604, DOI DOI 10.4236/JBISE.2014
[56]   Brain-Computer Interfaces: Beyond Medical Applications [J].
van Erp, Jan B. F. ;
Lotte, Fabien ;
Tangermann, Michael .
COMPUTER, 2012, 45 (04) :26-34
[57]   PDMS-Based Low Cost Flexible Dry Electrode for Long-Term EEG Measurement [J].
Wang, Long-Fei ;
Liu, Jing-Quan ;
Yang, Bin ;
Yang, Chun-Sheng .
IEEE SENSORS JOURNAL, 2012, 12 (09) :2898-2904
[58]   Emotional state classification from EEG data using machine learning approach [J].
Wang, Xiao-Wei ;
Nie, Dan ;
Lu, Bao-Liang .
NEUROCOMPUTING, 2014, 129 :94-106
[59]   Optimal Arousal Identification and Classification for Affective Computing Using Physiological Signals: Virtual Reality Stroop Task [J].
Wu, Dongrui ;
Courtney, Christopher G. ;
Lance, Brent J. ;
Narayanan, Shrikanth S. ;
Dawson, Michael E. ;
Oie, Kelvin S. ;
Parsons, Thomas D. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2010, 1 (02) :109-118
[60]   Modeling electroencephalography waveforms with semi-supervised deep belief nets: fast classification and anomaly measurement [J].
Wulsin, D. F. ;
Gupta, J. R. ;
Mani, R. ;
Blanco, J. A. ;
Litt, B. .
JOURNAL OF NEURAL ENGINEERING, 2011, 8 (03)