Comprehensive Analysis of Feature Extraction Methods for Emotion Recognition from Multichannel EEG Recordings

被引:32
作者
Yuvaraj, Rajamanickam [1 ]
Thagavel, Prasanth [2 ]
Thomas, John [3 ]
Fogarty, Jack [1 ]
Ali, Farhan [1 ]
机构
[1] Natl Inst Educ, Nanyang Technol Univ, Singapore 637616, Singapore
[2] Nanyang Technol Univ, Interdisciplinary Grad Sch, Singapore 639798, Singapore
[3] McGill Univ, Montreal Neurol Inst, Montreal, PQ H3A 2B4, Canada
关键词
EEG; emotion recognition; EEG feature extraction; valence; arousal; pattern recognition; STATE CLASSIFICATION; SIGNALS; SELECTION;
D O I
10.3390/s23020915
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Advances in signal processing and machine learning have expedited electroencephalogram (EEG)-based emotion recognition research, and numerous EEG signal features have been investigated to detect or characterize human emotions. However, most studies in this area have used relatively small monocentric data and focused on a limited range of EEG features, making it difficult to compare the utility of different sets of EEG features for emotion recognition. This study addressed that by comparing the classification accuracy (performance) of a comprehensive range of EEG feature sets for identifying emotional states, in terms of valence and arousal. The classification accuracy of five EEG feature sets were investigated, including statistical features, fractal dimension (FD), Hjorth parameters, higher order spectra (HOS), and those derived using wavelet analysis. Performance was evaluated using two classifier methods, support vector machine (SVM) and classification and regression tree (CART), across five independent and publicly available datasets linking EEG to emotional states: MAHNOB-HCI, DEAP, SEED, AMIGOS, and DREAMER. The FD-CART feature-classification method attained the best mean classification accuracy for valence (85.06%) and arousal (84.55%) across the five datasets. The stability of these findings across the five different datasets also indicate that FD features derived from EEG data are reliable for emotion recognition. The results may lead to the possible development of an online feature extraction framework, thereby enabling the development of an EEG-based emotion recognition system in real time.
引用
收藏
页数:19
相关论文
共 55 条
[1]  
Avramidis K., ARXIV
[2]   Human Emotion Classification from EEG Signals using Multiwavelet Transform [J].
Bajaj, Varun ;
Pachori, Ram Bilas .
2014 INTERNATIONAL CONFERENCE ON MEDICAL BIOMETRICS (ICMB 2014), 2014, :125-130
[3]   EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network [J].
Cui, Heng ;
Liu, Aiping ;
Zhang, Xu ;
Chen, Xiang ;
Wang, Kongqiao ;
Chen, Xun .
KNOWLEDGE-BASED SYSTEMS, 2020, 205
[4]   Toward Emotion Aware Computing: An Integrated Approach Using Multichannel Neurophysiological Recordings and Affective Visual Stimuli [J].
Frantzidis, Christos A. ;
Bratsas, Charalampos ;
Papadelis, Christos L. ;
Konstantinidis, Evdokimos ;
Pappas, Costas ;
Bamidis, Panagiotis D. .
IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, 2010, 14 (03) :589-597
[5]   A Review on Nonlinear Methods Using Electroencephalographic Recordings for Emotion Recognition [J].
Garcia-Martinez, Beatriz ;
Martinez-Rodrigo, Arturo ;
Alcaraz, Raul ;
Fernandez-Caballero, Antonio .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2021, 12 (03) :801-820
[6]  
Garg Anumit, 2019, 2019 Fifth International Conference on Data Science and Engineering (ICDSE), P139, DOI 10.1109/ICDSE47409.2019.8971484
[7]   Toward an EEG-Based Recognition of Music Liking Using Time-Frequency Analysis [J].
Hadjidimitriou, Stelios K. ;
Hadjileontiadis, Leontios J. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (12) :3498-3510
[8]   E2ENNet: An end-to-end neural network for emotional brain-computer interface [J].
Han, Zhichao ;
Chang, Hongli ;
Zhou, Xiaoyan ;
Wang, Jihao ;
Wang, Lili ;
Shao, Yongbin .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2022, 16
[9]  
Hatamikia S, 2014, 2014 21th Iranian Conference on Biomedical Engineering (ICBME), P333, DOI 10.1109/ICBME.2014.7043946
[10]   APPROACH TO AN IRREGULAR TIME-SERIES ON THE BASIS OF THE FRACTAL THEORY [J].
HIGUCHI, T .
PHYSICA D-NONLINEAR PHENOMENA, 1988, 31 (02) :277-283