Graph Convolutional Network With Connectivity Uncertainty for EEG-Based Emotion Recognition

被引:8
作者
Gao, Hongxiang [1 ,2 ]
Wang, Xingyao [1 ,3 ]
Chen, Zhenghua [2 ]
Wu, Min [2 ]
Cai, Zhipeng [1 ]
Zhao, Lulu [1 ]
Li, Jianqing [1 ,4 ]
Liu, Chengyu [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, State Key Lab Digital Med Engn, Nanjing 210096, Peoples R China
[2] ASTAR, Inst Infocomm Res, Singapore 138632, Singapore
[3] ASTAR, Inst High Performance Comp, Singapore 138632, Singapore
[4] Nanjing Med Univ, Sch Biomed Engn & Informat, Nanjing 211166, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Electroencephalography; Uncertainty; Emotion recognition; Convolution; Brain modeling; Feature extraction; Noise measurement; EEG; connectivity uncertainty; graph neural network;
D O I
10.1109/JBHI.2024.3416944
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Automatic emotion recognition based on multichannel Electroencephalography (EEG) holds great potential in advancing human-computer interaction. However, several significant challenges persist in existing research on algorithmic emotion recognition. These challenges include the need for a robust model to effectively learn discriminative node attributes over long paths, the exploration of ambiguous topological information in EEG channels and effective frequency bands, and the mapping between intrinsic data qualities and provided labels. To address these challenges, this study introduces the distribution-based uncertainty method to represent spatial dependencies and temporal-spectral relativeness in EEG signals based on Graph Convolutional Network (GCN) architecture that adaptively assigns weights to functional aggregate node features, enabling effective long-path capturing while mitigating over-smoothing phenomena. Moreover, the graph mixup technique is employed to enhance latent connected edges and mitigate noisy label issues. Furthermore, we integrate the uncertainty learning method with deep GCN weights in a one-way learning fashion, termed Connectivity Uncertainty GCN (CU-GCN). We evaluate our approach on two widely used datasets, namely SEED and SEEDIV, for emotion recognition tasks. The experimental results demonstrate the superiority of our methodology over previous methods, yielding positive and significant improvements. Ablation studies confirm the substantial contributions of each component to the overall performance.
引用
收藏
页码:5917 / 5928
页数:12
相关论文
共 63 条
[51]   Mixup for Node and Graph Classification [J].
Wang, Yiwei ;
Wang, Wei ;
Liang, Yuxuan ;
Cai, Yujun ;
Hooi, Bryan .
PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, :3663-3674
[52]  
WILLIAMS RJ, 1992, MACH LEARN, V8, P229, DOI 10.1007/BF00992696
[53]  
Wu F, 2019, PR MACH LEARN RES, V97
[54]  
Xu B, 2019, ICLR, P1, DOI DOI 10.1109/RADAR41533.2019.171253
[55]  
Zhang H., 2018, INT C LEARNING REPRE
[56]   GCB-Net: Graph Convolutional Broad Network and Its Application in Emotion Recognition [J].
Zhang, Tong ;
Wang, Xuehan ;
Xu, Xiangmin ;
Chen, C. L. Philip .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (01) :379-388
[57]   Spatial-Temporal Recurrent Neural Network for Emotion Recognition [J].
Zhang, Tong ;
Zheng, Wenming ;
Cui, Zhen ;
Zong, Yuan ;
Li, Yang .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (03) :839-847
[58]   Emotion Recognition From Multimodal Physiological Signals Using a Regularized Deep Fusion of Kernel Machine [J].
Zhang, Xiaowei ;
Liu, Jinyong ;
Shen, Jian ;
Li, Shaojie ;
Hou, Kechen ;
Hu, Bin ;
Gao, Jin ;
Zhang, Tong .
IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (09) :4386-4399
[59]  
Zhang YX, 2019, AAAI CONF ARTIF INTE, P5829
[60]   EmotionMeter: A Multimodal Framework for Recognizing Human Emotions [J].
Zheng, Wei-Long ;
Liu, Wei ;
Lu, Yifei ;
Lu, Bao-Liang ;
Cichocki, Andrzej .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (03) :1110-1122