Deep Learning Methods for Multi-Channel EEG-Based Emotion Recognition

被引:35
作者
Olamat, Ali [1 ]
Ozel, Pinar [2 ]
Atasever, Sema [3 ]
机构
[1] Yildiz Tech Univ, Biomed Engn Dept, Istanbul, Turkey
[2] Nevsehir Haci Bektas Veli Univ, Biomed Engn Dept, Nevsehir, Turkey
[3] Nevsehir Haci Bektas Veli Univ, Comp Engn Dept, Nevsehir, Turkey
关键词
Multi-variate empirical mode decomposition; emotional state analysis; transfer learning; AutoKeras; EEG; EMPIRICAL MODE DECOMPOSITION; CONVOLUTIONAL NEURAL-NETWORKS; FEATURES; ENTROPY; SIGNALS; EMD; CLASSIFICATION;
D O I
10.1142/S0129065722500216
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Currently, Fourier-based, wavelet-based, and Hilbert-based time-frequency techniques have generated considerable interest in classification studies for emotion recognition in human-computer interface investigations. Empirical mode decomposition (EMD), one of the Hilbert-based time-frequency techniques, has been developed as a tool for adaptive signal processing. Additionally, the multi-variate version strongly influences designing the common oscillation structure of a multi-channel signal by utilizing the common instantaneous concepts of frequency and bandwidth. Additionally, electroencephalographic (EEG) signals are strongly preferred for comprehending emotion recognition perspectives in human-machine interactions. This study aims to herald an emotion detection design via EEG signal decomposition using multi-variate empirical mode decomposition (MEMD). For emotion recognition, the SJTU emotion EEG dataset (SEED) is classified using deep learning methods. Convolutional neural networks (AlexNet, DenseNet-201, ResNet-101, and ResNet50) and AutoKeras architectures are selected for image classification. The proposed framework reaches 99% and 100% classification accuracy when transfer learning methods and the AutoKeras method are used, respectively.
引用
收藏
页数:18
相关论文
共 93 条
[1]   Computer-Aided Diagnosis of Depression Using EEG Signals [J].
Acharya, U. Rajendra ;
Sudarshan, Vidya K. ;
Adeli, Hojjat ;
Santhosh, Jayasree ;
Koh, Joel E. W. ;
Adeli, Amir .
EUROPEAN NEUROLOGY, 2015, 73 (5-6) :329-336
[2]   ECG Pattern Analysis for Emotion Detection [J].
Agrafioti, Foteini ;
Hatzinakos, Dimitrios ;
Anderson, Adam K. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) :102-115
[3]   Spatiotemporal Analysis of Relative Convergence of EEGs Reveals Differences Between Brain Dynamics of Depressive Women and Men [J].
Ahmadlou, Mehran ;
Adeli, Hojjat ;
Adeli, Amir .
CLINICAL EEG AND NEUROSCIENCE, 2013, 44 (03) :175-181
[4]  
[Anonymous], SEED Dataset
[5]  
[Anonymous], 1980, EMOTION PSYCHOEVOLUT
[6]  
Asghar M. E., 2020, 2020 14 EUR C ANT PR, P1, DOI DOI 10.1016/j.eswa.2021.115452
[7]   An Innovative Multi-Model Neural Network Approach for Feature Selection in Emotion Recognition Using Deep Feature Clustering [J].
Asghar, Muhammad Adeel ;
Khan, Muhammad Jamil ;
Rizwan, Muhammad ;
Mehmood, Raja Majid ;
Kim, Sun-Hee .
SENSORS, 2020, 20 (13) :1-21
[8]   EEG-Based Multi-Modal Emotion Recognition using Bag of Deep Features: An Optimal Feature Selection Approach [J].
Asghar, Muhammad Adeel ;
Khan, Muhammad Jamil ;
Fawad ;
Amin, Yasar ;
Rizwan, Muhammad ;
Rahman, MuhibUr ;
Badnava, Salman ;
Mirjavadi, Seyed Sajad .
SENSORS, 2019, 19 (23)
[9]  
Azami H, 2016, IEEE ENG MED BIO, P3761, DOI 10.1109/EMBC.2016.7591546
[10]   Cross-subjects Emotions Classification from EEG Signals using a Hierarchical LSTM based Classifier [J].
Badicu, Bogdan ;
Udrea, Andreea .
2019 E-HEALTH AND BIOENGINEERING CONFERENCE (EHB), 2019,