EESCN: A novel spiking neural network method for EEG-based emotion recognition

被引:25
|
作者
Xu, Feifan [1 ]
Pan, Deng [1 ]
Zheng, Haohao [1 ]
Ouyang, Yu [1 ]
Jia, Zhe [1 ]
Zeng, Hong [1 ,2 ]
机构
[1] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
[2] Key Lab Brain Machine Collaborat Zhejiang Prov, Hangzhou, Zhejiang, Peoples R China
基金
美国国家科学基金会;
关键词
Convolutional neural network (CNN); EEG emotion recognition; Neuromorphic; Recurrent neural network (RNN); Spiking neural network (SNN); CLASSIFICATION; OPTIMIZATION;
D O I
10.1016/j.cmpb.2023.107927
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: Although existing artificial neural networks have achieved good results in electroencephalograph (EEG) emotion recognition, further improvements are needed in terms of bio-interpretability and robustness. In this research, we aim to develop a highly efficient and high-performance method for emotion recognition based on EEG.Methods: We propose an Emo-EEGSpikeConvNet (EESCN), a novel emotion recognition method based on spiking neural network (SNN). It consists of a neuromorphic data generation module and a NeuroSpiking framework. The neuromorphic data generation module converts EEG data into 2D frame format as input to the NeuroSpiking framework, while the NeuroSpiking framework is used to extract spatio-temporal features of EEG for classification.Results: EESCN achieves high emotion recognition accuracies on DEAP and SEED-IV datasets, ranging from 94.56% to 94.81% on DEAP and a mean accuracy of 79.65% on SEED-IV. Compared to existing SNN methods, EESCN significantly improves EEG emotion recognition performance. In addition, it also has the advantages of faster running speed and less memory footprint.Conclusions: EESCN has shown excellent performance and efficiency in EEG-based emotion recognition with potential for practical applications requiring portability and resource constraints.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] A novel caps-EEGNet combined with channel selection for EEG-based emotion recognition
    Chen, Kun
    Jing, Huchuan
    Liu, Quan
    Ai, Qingsong
    Ma, Li
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86
  • [42] Subject-Independent EEG-based Emotion Recognition using Adversarial Learning
    Hwang, Sunhee
    Ki, Minsong
    Hong, Kibeom
    Byun, Hyeran
    2020 8TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2020, : 99 - 102
  • [43] Research of EEG-based emotion recognition for the deaf with feature fusion
    Mao, Zemin
    Zhao, Xuewen
    Song, Yu
    INTERNATIONAL JOURNAL OF BIOMEDICAL ENGINEERING AND TECHNOLOGY, 2024, 45 (03) : 216 - 236
  • [44] EEG-based Emotion Recognition Using Multiple Kernel Learning
    Cai, Qian
    Cui, Guo-Chong
    Wang, Hai-Xian
    MACHINE INTELLIGENCE RESEARCH, 2022, 19 (05) : 472 - 484
  • [45] EEG-based emotion recognition using empirical wavelet transform
    Huang, Dan
    Zhang, Suhua
    Zhang, Yong
    2017 4TH INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI), 2017, : 1444 - 1449
  • [46] Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks
    Zheng, Wei-Long
    Lu, Bao-Liang
    IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT, 2015, 7 (03) : 162 - 175
  • [47] Can Emotion Be Transferred?-A Review on Transfer Learning for EEG-Based Emotion Recognition
    Li, Wei
    Huan, Wei
    Hou, Bowen
    Tian, Ye
    Zhang, Zhen
    Song, Aiguo
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (03) : 833 - 846
  • [48] An Investigation of Deep Learning Models for EEG-Based Emotion Recognition
    Zhang, Yaqing
    Chen, Jinling
    Tan, Jen Hong
    Chen, Yuxuan
    Chen, Yunyi
    Li, Dihan
    Yang, Lei
    Su, Jian
    Huang, Xin
    Che, Wenliang
    FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [49] EEG-Based Emotion Recognition Datasets for Virtual Environments: A Survey
    Hamzah, Hussein Ali
    Abdalla, Kasim K.
    APPLIED COMPUTATIONAL INTELLIGENCE AND SOFT COMPUTING, 2024, 2024
  • [50] Deep Convolutional Neural Network for EEG-Based Motor Decoding
    Zhang, Jing
    Liu, Dong
    Chen, Weihai
    Pei, Zhongcai
    Wang, Jianhua
    MICROMACHINES, 2022, 13 (09)