An improved graph convolutional neural network for EEG emotion recognition

被引:0
作者
Xu, Bingyue [1 ]
Zhang, Xin [2 ]
Zhang, Xiu [3 ]
Sun, Baiwei [1 ]
Wang, Yujie [1 ]
机构
[1] Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission, Tianjin Normal University, Tianjin
[2] College of Artificial Intelligence, Tianjin Normal University, Tianjin
[3] College of Electronic and Communication Engineering, Tianjin Normal University, Tianjin
基金
中国国家自然科学基金;
关键词
Deep learning; Electroencephalogram; Emotion recognition; Graph convolution neural network;
D O I
10.1007/s00521-024-10469-8
中图分类号
学科分类号
摘要
Dynamic uncertainty of the relationship among brain regions is an important limiting factor in electroencephalography (EEG)-based emotion recognition. This uncertainty stems from individual differences and emotional volatility, which needs further in-depth study. In this paper, we propose a new emotion recognition method, which is named graph convolutional neural network with spatio-temporal modeling and long short-term memory (STLGCNN). The proposed method aims to address the instability of emotion intensity and underutilization of EEG biotopological information. The method consists of an attention module, a bi-directional long short-term memory network (BiLSTM), a graph convolutional neural network (GCNN) and a long short-term memory module (LSTM). The attention mechanism is utilized to reveal correlations between different time periods and to reduce emotional temporal volatility. The BiLSTM is employed to learn spatio-temporal features. Then, the GCNN learns the biotopological information of multi-channel EEG signals and extracts effective graph domain features. These features are then fed into the LSTM to integrate the graph-domain information and extract valid temporal information. To verify the effectiveness of the STLGCNN method, we conducted experiments on the DEAP and SEED datasets. The average accuracies on the two datasets are 93.95 and 96.78%, respectively. The results show that the STLGCNN method has better performance than existing methods. © The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2024.
引用
收藏
页码:23049 / 23060
页数:11
相关论文
共 40 条
[1]  
Manasa G., Nirde K.D., Gajre S.S., Manthalkar R., EEG signal-based classification of mental tasks using a one-dimensional convrest model, Neural Comput Appl, 36, pp. 9053-9072, (2024)
[2]  
Huang D., Chen S., Liu C., Zheng L., Jiang D., Differences first in asymmetric brain: a bi-hemisphere discrepancy convolutional neural network for EEG emotion recognition, Neurocomputing, 448, pp. 140-151, (2021)
[3]  
Shanmugam S., Dharmar S., A CNN-LSTM hybrid network for automatic seizure detection in EEG signals, Neural Comput Appl, 35, pp. 20605-20617, (2023)
[4]  
Xue Y., Zheng W., Zong Y., Chang H., Jiang X., Adaptive hierarchical graph convolutional network for eeg emotion recognition, 2022 International Joint Conference on Neural Networks (IJCNN), pp. 1-8, (2022)
[5]  
Yang Y., Wu Q., Qiu M., Wang Y., Chen X., Emotion recognition from multi-channel eeg through parallel convolutional recurrent neural network, 2018 International Joint Conference on Neural Networks (IJCNN), pp. 1-7, (2018)
[6]  
Lou Y., Wu R., Li J., Wang L., Li X., Chen G., A learning convolutional neural network approach for network robustness prediction, IEEE Trans Cybern, 537, pp. 4531-4544, (2023)
[7]  
Yuan Q., Dai Y., Li G., Exploration of english speech translation recognition based on the LSTM RNN algorithm, Neural Comput Appl, 35, pp. 24961-24970, (2023)
[8]  
Zhou H., Shao L., Zhang H., Srrnet: a transformer structure with adaptive 2-d spatial attention mechanism for cell phone-captured shopping receipt recognition, IEEE Trans Consumer Electron, 701, pp. 3289-3298, (2024)
[9]  
Wu Z., Li Q., Zhang H., Chain-structure echo state network with stochastic optimization: methodology and application, IEEE Trans Neural Netw Learn Syst, 335, pp. 1974-1985, (2022)
[10]  
Yan H., Zhang H., Shi J., Ma J., Xu X., Inspiration transfer for intelligent design: a generative adversarial network with fashion attributes disentanglement, IEEE Trans Consumer Electron, 694, pp. 1152-1163, (2023)