EEG Channel Correlation Based Model for Emotion Recognition

被引:103
作者
Islam, Md Rabiul [1 ,2 ]
Islam, Md Milon [3 ]
Rahman, Md Mustafizur [4 ]
Mondal, Chayan [2 ]
Singha, Suvojit Kumar [2 ]
Ahmad, Mohiuddin [2 ]
Awal, Abdul [5 ]
Islam, Md Saiful [6 ]
Moni, Mohammad Ali [7 ]
机构
[1] Bangladesh Army Univ Engn & Technol, Elect & Elect Engn, Natore 6431, Bangladesh
[2] Khulna Univ Engn & Technol, Elect & Elect Engn, Khulna 9203, Bangladesh
[3] Khulna Univ Engn & Technol, Comp Sci & Engn, Khulna 9203, Bangladesh
[4] Jashore Univ Sci & Technol, Elect & Elect Engn, Jashore 7408, Bangladesh
[5] Khulna Univ, Elect & Commun Engn, Khulna 9208, Bangladesh
[6] Griffith Univ, Sch Informat & Commun Technol, Gold Coast, Australia
[7] Univ Queensland, Sch Hlth & Rehabil Sci, St Lucia, Qld 4072, Australia
关键词
Emotion; Convolutional neural network; Feature extraction; EEG; Complexity; CLASSIFICATION; MUSIC;
D O I
10.1016/j.compbiomed.2021.104757
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Emotion recognition using Artificial Intelligence (AI) is a fundamental prerequisite to improve Human-Computer Interaction (HCI). Recognizing emotion from Electroencephalogram (EEG) has been globally accepted in many applications such as intelligent thinking, decision-making, social communication, feeling detection, affective computing, etc. Nevertheless, due to having too low amplitude variation related to time on EEG signal, the proper recognition of emotion from this signal has become too challenging. Usually, considerable effort is required to identify the proper feature or feature set for an effective feature-based emotion recognition system. To extenuate the manual human effort of feature extraction, we proposed a deep machine-learning-based model with Convolutional Neural Network (CNN). At first, the one-dimensional EEG data were converted to Pearson's Correlation Coefficient (PCC) featured images of channel correlation of EEG sub-bands. Then the images were fed into the CNN model to recognize emotion. Two protocols were conducted, namely, protocol-1 to identify two levels and protocol-2 to recognize three levels of valence and arousal that demonstrate emotion. We investigated that only the upper triangular portion of the PCC featured images reduced the computational complexity and size of memory without hampering the model accuracy. The maximum accuracy of 78.22% on valence and 74.92% on arousal were obtained using the internationally authorized DEAP dataset.
引用
收藏
页数:11
相关论文
共 39 条
[1]  
Ackermann P, 2016, 2016 IEEE 18TH INTERNATIONAL CONFERENCE ON E-HEALTH NETWORKING, APPLICATIONS AND SERVICES (HEALTHCOM), P159
[2]   Emotions Recognition Using EEG Signals: A Survey [J].
Alarcao, Soraia M. ;
Fonseca, Manuel J. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2019, 10 (03) :374-393
[3]   Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers [J].
Atkinson, John ;
Campos, Daniel .
EXPERT SYSTEMS WITH APPLICATIONS, 2016, 47 :35-41
[4]   Training Deep Networks for Facial Expression Recognition with Crowd-Sourced Label Distribution [J].
Barsoum, Emad ;
Zhang, Cha ;
Ferrer, Cristian Canton ;
Zhang, Zhengyou .
ICMI'16: PROCEEDINGS OF THE 18TH ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2016, :279-283
[5]  
Chen M, 2015, INT CONF AFFECT, P63, DOI 10.1109/ACII.2015.7344552
[6]   Emotion Recognition From Multi-Channel EEG via Deep Forest [J].
Cheng, Juan ;
Chen, Meiyao ;
Li, Chang ;
Liu, Yu ;
Song, Rencheng ;
Liu, Aiping ;
Chen, Xun .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (02) :453-464
[7]   Multi-Feature Input Deep Forest for EEG-Based Emotion Recognition [J].
Fang, Yinfeng ;
Yang, Haiyang ;
Zhang, Xuguang ;
Liu, Han ;
Tao, Bo .
FRONTIERS IN NEUROROBOTICS, 2021, 14
[8]   EEG-Based Classification of Music Appraisal Responses Using Time-Frequency Analysis and Familiarity Ratings [J].
Hadjidimitriou, Stelios K. ;
Hadjileontiadis, Leontios J. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2013, 4 (02) :161-172
[9]   Common Bayesian Network for Classification of EEG-Based Multiclass Motor Imagery BCI [J].
He, Lianghua ;
Hu, Die ;
Wan, Meng ;
Wen, Ying ;
von Deneen, Karen M. ;
Zhou, MengChu .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2016, 46 (06) :843-854
[10]  
Islam M.R., 2019, WAVELET ANAL BASED C, DOI [10.1109/ECACE.2019.8679156, DOI 10.1109/ECACE.2019.8679156]