Emotion detection using electroencephalography signals and a zero-time windowing-based epoch estimation and relevant electrode identification

被引:66
作者
Gannouni, Sofien [1 ]
Aledaily, Arwa [1 ]
Belwafi, Kais [1 ]
Aboalsamh, Hatim [1 ]
机构
[1] King Saud Univ, Coll Comp & Informat Sci, Comp Sci Dept, Riyadh 11543, Saudi Arabia
关键词
FEATURE-EXTRACTION; RECOGNITION;
D O I
10.1038/s41598-021-86345-5
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Recognizing emotions using biological brain signals requires accurate and efficient signal processing and feature extraction methods. Existing methods use several techniques to extract useful features from a fixed number of electroencephalography (EEG) channels. The primary objective of this study was to improve the performance of emotion recognition using brain signals by applying a novel and adaptive channel selection method that acknowledges that brain activity has a unique behavior that differs from one person to another and one emotional state to another. Moreover, we propose identifying epochs, which are the instants at which excitation is maximum, during the emotion to improve the system's accuracy. We used the zero-time windowing method to extract instantaneous spectral information using the numerator group-delay function to accurately detect the epochs in each emotional state. Different classification scheme were defined using QDC and RNN and evaluated using the DEAP database. The experimental results showed that the proposed method is highly competitive compared with existing studies of multi-class emotion recognition. The average accuracy rate exceeded 89%. Compared with existing algorithms dealing with 9 emotions, the proposed method enhanced the accuracy rate by 8%. Moreover, experiment shows that the proposed system outperforms similar approaches discriminating between 3 and 4 emotions only. We also found that the proposed method works well, even when applying conventional classification algorithms.
引用
收藏
页数:17
相关论文
共 24 条
[11]   The brain basis of emotion: A meta-analytic review [J].
Lindquist, Kristen A. ;
Wager, Tor D. ;
Kober, Hedy ;
Bliss-Moreau, Eliza ;
Barrett, Lisa Feldman .
BEHAVIORAL AND BRAIN SCIENCES, 2012, 35 (03) :121-143
[12]  
Liu W., 2019, arXiv
[13]   Emotion recognition by deeply learned multi-channel textual and EEG features [J].
Liu, Yishu ;
Fu, Guifang .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 119 :1-6
[14]   Emotion recognition from EEG signals by using multivariate empirical mode decomposition [J].
Mert, Ahmet ;
Akan, Aydin .
PATTERN ANALYSIS AND APPLICATIONS, 2018, 21 (01) :81-89
[15]   Epoch Extraction From Speech Signals [J].
Murty, K. Sri Rama ;
Yegnanarayana, B. .
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2008, 16 (08) :1602-1613
[16]   Comparison of different feature extraction methods for EEG-based emotion recognition [J].
Nawaz, Rab ;
Cheah, Kit Hwa ;
Nisar, Humaira ;
Yap, Vooi Voon .
BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2020, 40 (03) :910-926
[17]  
Northoff G., 2014, Minding the brain: An introduction of philosophy and neuroscience, DOI [10.1007/978-1-137-40605-7, DOI 10.1007/978-1-137-40605-7]
[18]  
Pane ES, 2017, INT C INSTR COMMUN, P167
[19]   Employing PCA and t-statistical approach for feature extraction and classification of emotion from multichannel EEG signal [J].
Rahman, Md Asadur ;
Hossain, Md Foisal ;
Hossain, Mazhar ;
Ahmmed, Rasel .
EGYPTIAN INFORMATICS JOURNAL, 2020, 21 (01) :23-35
[20]  
Ranganathan Hiranmayi, 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), P1