Multi-channel EEG emotion recognition through residual graph attention neural network

被引:7
作者
Chao, Hao [1 ]
Cao, Yiming [1 ]
Liu, Yongli [1 ]
机构
[1] Henan Polytech Univ, Coll Comp Sci & Technol, Jiaozuo, Peoples R China
关键词
EEG; emotion recognition; residual network; graph attention neural network; feature fusion;
D O I
10.3389/fnins.2023.1135850
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
In this paper, a novel EEG emotion recognition method based on residual graph attention neural network is proposed. The method constructs a three-dimensional sparse feature matrix according to the relative position of electrode channels, and inputs it into the residual network to extract high-level abstract features containing electrode spatial position information. At the same time, the adjacency matrix representing the connection relationship of electrode channels is constructed, and the time-domain features of multi-channel EEG are modeled using graph. Then, the graph attention neural network is utilized to learn the intrinsic connection relationship between EEG channels located in different brain regions from the adjacency matrix and the constructed graph structure data. Finally, the high-level abstract features extracted from the two networks are fused to judge the emotional state. The experiment is carried out on DEAP data set. The experimental results show that the spatial domain information of electrode channels and the intrinsic connection relationship between different channels contain salient information related to emotional state, and the proposed model can effectively fuse these information to improve the performance of multi-channel EEG emotion recognition.
引用
收藏
页数:15
相关论文
共 43 条
[1]  
Alhagry S, 2017, INT J ADV COMPUT SC, V8, P355, DOI 10.14569/IJACSA.2017.081046
[2]   The use of the EEG in measuring therapeutic drug action: focus on depression and antidepressants [J].
Alhaj, Hamid ;
Wisniewski, Grzegorz ;
McAllister-Williams, R. Hamish .
JOURNAL OF PSYCHOPHARMACOLOGY, 2011, 25 (09) :1175-1191
[3]   Scalp and Source Power Topography in Sleepwalking and Sleep Terrors: A High-Density EEG Study [J].
Castelnovo, Anna ;
Riedner, Brady A. ;
Smith, Richard F. ;
Tononi, Giulio ;
Boly, Melanie ;
Benca, Ruth M. .
SLEEP, 2016, 39 (10) :1815-1825
[4]   Emotion Recognition Using Three-Dimensional Feature and Convolutional Neural Network from Multichannel EEG Signals [J].
Chao, Hao ;
Dong, Liang .
IEEE SENSORS JOURNAL, 2021, 21 (02) :2024-2034
[5]   Characterization of surface EMG signal based on fuzzy entropy [J].
Chen, Weiting ;
Wang, Zhizhong ;
Xie, Hongbo ;
Yu, Wangxin .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2007, 15 (02) :266-272
[6]   EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network [J].
Cui, Heng ;
Liu, Aiping ;
Zhang, Xu ;
Chen, Xiang ;
Wang, Kongqiao ;
Chen, Xun .
KNOWLEDGE-BASED SYSTEMS, 2020, 205
[7]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[8]   A Multi-Dimensional Graph Convolution Network for EEG Emotion Recognition [J].
Du, Guanglong ;
Su, Jinshao ;
Zhang, Linlin ;
Su, Kang ;
Wang, Xueqian ;
Teng, Shaohua ;
Liu, Peter Xiaoping .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[9]   An artificial intelligence-based EEG algorithm for detection of epileptiform EEG discharges: Validation against the diagnostic gold standard [J].
Fuerbass, Franz ;
Kural, Mustafa Aykut ;
Gritsch, Gerhard ;
Hartmann, Manfred ;
Kluge, Tilmann ;
Beniczky, Sandor .
CLINICAL NEUROPHYSIOLOGY, 2020, 131 (06) :1174-1179
[10]   EEG-GCN: Spatio-Temporal and Self-Adaptive Graph Convolutional Networks for Single and Multi-View EEG-Based Emotion Recognition [J].
Gao, Yue ;
Fu, Xiangling ;
Ouyang, Tianxiong ;
Wang, Yi .
IEEE SIGNAL PROCESSING LETTERS, 2022, 29 :1574-1578