Deep Learning Methods for Multi-Channel EEG-Based Emotion Recognition

被引:32
作者
Olamat, Ali [1 ]
Ozel, Pinar [2 ]
Atasever, Sema [3 ]
机构
[1] Yildiz Tech Univ, Biomed Engn Dept, Istanbul, Turkey
[2] Nevsehir Haci Bektas Veli Univ, Biomed Engn Dept, Nevsehir, Turkey
[3] Nevsehir Haci Bektas Veli Univ, Comp Engn Dept, Nevsehir, Turkey
关键词
Multi-variate empirical mode decomposition; emotional state analysis; transfer learning; AutoKeras; EEG; EMPIRICAL MODE DECOMPOSITION; CONVOLUTIONAL NEURAL-NETWORKS; FEATURES; ENTROPY; SIGNALS; EMD; CLASSIFICATION;
D O I
10.1142/S0129065722500216
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Currently, Fourier-based, wavelet-based, and Hilbert-based time-frequency techniques have generated considerable interest in classification studies for emotion recognition in human-computer interface investigations. Empirical mode decomposition (EMD), one of the Hilbert-based time-frequency techniques, has been developed as a tool for adaptive signal processing. Additionally, the multi-variate version strongly influences designing the common oscillation structure of a multi-channel signal by utilizing the common instantaneous concepts of frequency and bandwidth. Additionally, electroencephalographic (EEG) signals are strongly preferred for comprehending emotion recognition perspectives in human-machine interactions. This study aims to herald an emotion detection design via EEG signal decomposition using multi-variate empirical mode decomposition (MEMD). For emotion recognition, the SJTU emotion EEG dataset (SEED) is classified using deep learning methods. Convolutional neural networks (AlexNet, DenseNet-201, ResNet-101, and ResNet50) and AutoKeras architectures are selected for image classification. The proposed framework reaches 99% and 100% classification accuracy when transfer learning methods and the AutoKeras method are used, respectively.
引用
收藏
页数:18
相关论文
共 93 条
  • [1] Computer-Aided Diagnosis of Depression Using EEG Signals
    Acharya, U. Rajendra
    Sudarshan, Vidya K.
    Adeli, Hojjat
    Santhosh, Jayasree
    Koh, Joel E. W.
    Adeli, Amir
    [J]. EUROPEAN NEUROLOGY, 2015, 73 (5-6) : 329 - 336
  • [2] ECG Pattern Analysis for Emotion Detection
    Agrafioti, Foteini
    Hatzinakos, Dimitrios
    Anderson, Adam K.
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) : 102 - 115
  • [3] Spatiotemporal Analysis of Relative Convergence of EEGs Reveals Differences Between Brain Dynamics of Depressive Women and Men
    Ahmadlou, Mehran
    Adeli, Hojjat
    Adeli, Amir
    [J]. CLINICAL EEG AND NEUROSCIENCE, 2013, 44 (03) : 175 - 181
  • [4] [Anonymous], Seed Dataset
  • [5] Asghar MA, 2020, 2020 INT C ENG EM TE, P1, DOI DOI 10.1016/j.eswa.2021.115452
  • [6] An Innovative Multi-Model Neural Network Approach for Feature Selection in Emotion Recognition Using Deep Feature Clustering
    Asghar, Muhammad Adeel
    Khan, Muhammad Jamil
    Rizwan, Muhammad
    Mehmood, Raja Majid
    Kim, Sun-Hee
    [J]. SENSORS, 2020, 20 (13) : 1 - 21
  • [7] EEG-Based Multi-Modal Emotion Recognition using Bag of Deep Features: An Optimal Feature Selection Approach
    Asghar, Muhammad Adeel
    Khan, Muhammad Jamil
    Fawad
    Amin, Yasar
    Rizwan, Muhammad
    Rahman, MuhibUr
    Badnava, Salman
    Mirjavadi, Seyed Sajad
    [J]. SENSORS, 2019, 19 (23)
  • [8] Azami H, 2016, IEEE ENG MED BIO, P3761, DOI 10.1109/EMBC.2016.7591546
  • [9] Cross-subjects Emotions Classification from EEG Signals using a Hierarchical LSTM based Classifier
    Badicu, Bogdan
    Udrea, Andreea
    [J]. 2019 E-HEALTH AND BIOENGINEERING CONFERENCE (EHB), 2019,
  • [10] Upper Limb Movement Classification Via Electromyographic Signals and an Enhanced Probabilistic Network
    Burns, Alexis
    Adeli, Hojjat
    Buford, John A.
    [J]. JOURNAL OF MEDICAL SYSTEMS, 2020, 44 (10)