EEG-Based Emotion Recognition Using Spatial-Temporal-Connective Features via Multi-Scale CNN

被引:23
作者
Li, Tianyi [1 ]
Fu, Baole [1 ]
Wu, Zixuan [1 ]
Liu, Yinhua [1 ]
机构
[1] Qingdao Univ, Inst Future, Qingdao 266000, Peoples R China
关键词
Feature extraction; Electroencephalography; Emotion recognition; Convolutional neural networks; Brain modeling; EEG; connective features; STC-CNN; CONVOLUTIONAL NEURAL-NETWORK; MULTICHANNEL EEG; ATTENTION;
D O I
10.1109/ACCESS.2023.3270317
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Electroencephalography (EEG) signals from each channel mainly reflect activities of the brain region close to the channel position, and the activities cooperated by various brain regions are response to the emotion-induced stimuli. In this paper, temporal, spatial and connective features are extracted from EEG signals gotten around the head, and used for emotion recognition via a proposed model, spatial-temporal-connective muti-scale convolutional neural network (STC-CNN). The channel-to-channel connectivity is gotten to describe brain region-to-region cooperation under emotion stimuli. The model obtained an average accuracy of 96.79% and 96.89% in classifying the two emotional dimensions of valence and arousal.
引用
收藏
页码:41859 / 41867
页数:9
相关论文
共 32 条
[1]  
Al-Nafjan A, 2017, APPL SCI-BASEL, V7, DOI [10.9734/acri/2017/32618, 10.3390/app7121239]
[2]  
Alhagry S, 2017, INT J ADV COMPUT SC, V8, P355, DOI 10.14569/IJACSA.2017.081046
[3]  
Bashivan P, 2016, Arxiv, DOI [arXiv:1511.06448, 10.48550/arXiv.1511.06448, DOI 10.48550/ARXIV.1511.06448]
[4]   Emotion Recognition Using Three-Dimensional Feature and Convolutional Neural Network from Multichannel EEG Signals [J].
Chao, Hao ;
Dong, Liang .
IEEE SENSORS JOURNAL, 2021, 21 (02) :2024-2034
[5]   EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network [J].
Cui, Heng ;
Liu, Aiping ;
Zhang, Xu ;
Chen, Xiang ;
Wang, Kongqiao ;
Chen, Xun .
KNOWLEDGE-BASED SYSTEMS, 2020, 205
[6]   EEG-GCN: Spatio-Temporal and Self-Adaptive Graph Convolutional Networks for Single and Multi-View EEG-Based Emotion Recognition [J].
Gao, Yue ;
Fu, Xiangling ;
Ouyang, Tianxiong ;
Wang, Yi .
IEEE SIGNAL PROCESSING LETTERS, 2022, 29 :1574-1578
[7]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[8]   Emotion recognition using deep learning approach from audio-visual emotional big data [J].
Hossain, M. Shamim ;
Muhammad, Ghulam .
INFORMATION FUSION, 2019, 49 :69-78
[9]   Deep Physiological Affect Network for the Recognition of Human Emotions [J].
Kim, Byung Hyung ;
Jo, Sungho .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2020, 11 (02) :230-243
[10]   Multi-Scale Neural Network for EEG Representation Learning in BCI [J].
Ko, Wonjun ;
Jeon, Eunjin ;
Jeong, Seungwoo ;
Suk, Heung-Il .
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2021, 16 (02) :31-45