The Effect of Time Window Length on EEG-Based Emotion Recognition

被引:25
作者
Ouyang, Delin [1 ]
Yuan, Yufei [1 ]
Li, Guofa [1 ]
Guo, Zizheng [2 ,3 ]
机构
[1] Shenzhen Univ, Coll Mechatron & Control Engn, Inst Human Factors & Ergon, Shenzhen 518060, Peoples R China
[2] Southwest Jiaotong Univ, Sch Transportat & Logist, Natl United Engn Lab Integrated & Intelligent Tra, Natl Engn Lab Integrated Transportat Big Data App, Chengdu 611756, Peoples R China
[3] Southwest Jiaotong Univ, Sch Transportat & Logist, Comprehens Transportat Key Lab Sichuan Prov, Chengdu 611756, Peoples R China
基金
中国国家自然科学基金;
关键词
brain-computer interaction; emotion recognition; time window length; electroencephalogram (EEG); experiment-level batch normalization; INDIVIDUAL-DIFFERENCES; FEATURE-SELECTION; MUSIC;
D O I
10.3390/s22134939
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Various lengths of time window have been used in feature extraction for electroencephalogram (EEG) signal processing in previous studies. However, the effect of time window length on feature extraction for the downstream tasks such as emotion recognition has not been well examined. To this end, we investigate the effect of different time window (TW) lengths on human emotion recognition to find the optimal TW length for extracting electroencephalogram (EEG) emotion signals. Both power spectral density (PSD) features and differential entropy (DE) features are used to evaluate the effectiveness of different TW lengths based on the SJTU emotion EEG dataset (SEED). Different lengths of TW are then processed with an EEG feature-processing approach, namely experiment-level batch normalization (ELBN). The processed features are used to perform emotion recognition tasks in the six classifiers, the results of which are then compared with the results without ELBN. The recognition accuracies indicate that a 2-s TW length has the best performance on emotion recognition and is the most suitable to be used in EEG feature extraction for emotion recognition. The deployment of ELBN in the 2-s TW can further improve the emotion recognition performances by 21.63% and 5.04% when using an SVM based on PSD and DE features, respectively. These results provide a solid reference for the selection of TW length in analyzing EEG signals for applications in intelligent systems.
引用
收藏
页数:14
相关论文
共 51 条
[1]   Emotion Analysis Using Audio/Video, EMG and EEG: A Dataset and Comparison Study [J].
Abtahi, Farnaz ;
Ro, Tony ;
Li, Wei ;
Zhu, Zhigang .
2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, :10-19
[2]   Synthetic vs Human Emotional Faces: What Changes in Humans' Decoding Accuracy [J].
Amorese, Terry ;
Cuciniello, Marialucia ;
Vinciarelli, Alessandro ;
Cordasco, Gennaro ;
Esposito, Anna .
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2022, 52 (03) :390-399
[3]   EEG-Based Multi-Modal Emotion Recognition using Bag of Deep Features: An Optimal Feature Selection Approach [J].
Asghar, Muhammad Adeel ;
Khan, Muhammad Jamil ;
Fawad ;
Amin, Yasar ;
Rizwan, Muhammad ;
Rahman, MuhibUr ;
Badnava, Salman ;
Mirjavadi, Seyed Sajad .
SENSORS, 2019, 19 (23)
[4]   Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers [J].
Atkinson, John ;
Campos, Daniel .
EXPERT SYSTEMS WITH APPLICATIONS, 2016, 47 :35-41
[5]   Single-channel-based automatic drowsiness detection architecture with a reduced number of EEG features [J].
Belakhdar, Ibtissem ;
Kaaniche, Walid ;
Djemal, Ridha ;
Ouni, Bouraoui .
MICROPROCESSORS AND MICROSYSTEMS, 2018, 58 :13-23
[6]   Soft Computing-Based EEG Classification by Optimal Feature Selection and Neural Networks [J].
Bhatti, Muhammad Hamza ;
Khan, Javeria ;
Khan, Muhammad Usman Ghani ;
Iqbal, Razi ;
Aloqaily, Moayad ;
Jararweh, Yaser ;
Gupta, Brij .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (10) :5747-5754
[7]   Short duration power changes in the EEG during recognition memory for words and faces [J].
Burgess, AP ;
Gruzelier, JH .
PSYCHOPHYSIOLOGY, 2000, 37 (05) :596-606
[8]   Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks [J].
Chen, J. X. ;
Zhang, P. W. ;
Mao, Z. J. ;
Huang, Y. F. ;
Jiang, D. M. ;
Zhang, Andy N. .
IEEE ACCESS, 2019, 7 :44317-44328
[9]   Emotion Classification Using EEG Signals [J].
Dabas, Harsh ;
Sethi, Chaitanya ;
Dua, Chirag ;
Dalawat, Mohit ;
Sethia, Divyashikha .
PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, :380-384
[10]   Neural correlates of emotional responses to music: An EEG study [J].
Daly, Ian ;
Malik, Asad ;
Hwang, Faustina ;
Roesch, Etienne ;
Weaver, James ;
Kirke, Alexis ;
Williams, Duncan ;
Miranda, Eduardo ;
Nasuto, Slawomir J. .
NEUROSCIENCE LETTERS, 2014, 573 :52-57