Graph Convolutional Network With Connectivity Uncertainty for EEG-Based Emotion Recognition

被引:2
|
作者
Gao, Hongxiang [1 ,2 ]
Wang, Xingyao [1 ,3 ]
Chen, Zhenghua [2 ]
Wu, Min [2 ]
Cai, Zhipeng [1 ]
Zhao, Lulu [1 ]
Li, Jianqing [1 ,4 ]
Liu, Chengyu [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, State Key Lab Digital Med Engn, Nanjing 210096, Peoples R China
[2] ASTAR, Inst Infocomm Res, Singapore 138632, Singapore
[3] ASTAR, Inst High Performance Comp, Singapore 138632, Singapore
[4] Nanjing Med Univ, Sch Biomed Engn & Informat, Nanjing 211166, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Electroencephalography; Uncertainty; Emotion recognition; Convolution; Brain modeling; Feature extraction; Noise measurement; EEG; connectivity uncertainty; graph neural network;
D O I
10.1109/JBHI.2024.3416944
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Automatic emotion recognition based on multichannel Electroencephalography (EEG) holds great potential in advancing human-computer interaction. However, several significant challenges persist in existing research on algorithmic emotion recognition. These challenges include the need for a robust model to effectively learn discriminative node attributes over long paths, the exploration of ambiguous topological information in EEG channels and effective frequency bands, and the mapping between intrinsic data qualities and provided labels. To address these challenges, this study introduces the distribution-based uncertainty method to represent spatial dependencies and temporal-spectral relativeness in EEG signals based on Graph Convolutional Network (GCN) architecture that adaptively assigns weights to functional aggregate node features, enabling effective long-path capturing while mitigating over-smoothing phenomena. Moreover, the graph mixup technique is employed to enhance latent connected edges and mitigate noisy label issues. Furthermore, we integrate the uncertainty learning method with deep GCN weights in a one-way learning fashion, termed Connectivity Uncertainty GCN (CU-GCN). We evaluate our approach on two widely used datasets, namely SEED and SEEDIV, for emotion recognition tasks. The experimental results demonstrate the superiority of our methodology over previous methods, yielding positive and significant improvements. Ablation studies confirm the substantial contributions of each component to the overall performance.
引用
收藏
页码:5917 / 5928
页数:12
相关论文
共 50 条
  • [1] Hierarchical Dynamic Graph Convolutional Network With Interpretability for EEG-Based Emotion Recognition
    Ye, Mengqing
    Chen, C. L. Philip
    Zhang, Tong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, : 1 - 12
  • [2] A Multi-Domain Adaptive Graph Convolutional Network for EEG-based Emotion Recognition
    Li, Rui
    Wang, Yiting
    Lu, Bao-Liang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5565 - 5573
  • [3] EEG-based Emotion Recognition Using Graph Convolutional Network with Learnable Electrode Relations
    Jin, Ming
    Chen, Hao
    Li, Zhunan
    Li, Jinpeng
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 5953 - 5957
  • [4] Emotion recognition with convolutional neural network and EEG-based EFDMs
    Wang, Fei
    Wu, Shichao
    Zhang, Weiwei
    Xu, Zongfeng
    Zhang, Yahui
    Wu, Chengdong
    Coleman, Sonya
    NEUROPSYCHOLOGIA, 2020, 146
  • [5] A Domain Generative Graph Network for EEG-Based Emotion Recognition
    Gu, Yun
    Zhong, Xinyue
    Qu, Cheng
    Liu, Chuanjun
    Chen, Bin
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (05) : 2377 - 2386
  • [6] EEG-Based Emotion Recognition Using Trainable Adjacency Relation Driven Graph Convolutional Network
    Li, Wei
    Wang, Mingming
    Zhu, Junyi
    Song, Aiguo
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (04) : 1656 - 1672
  • [7] EEG-based emotion recognition using graph convolutional neural network with dual attention mechanism
    Chen, Wei
    Liao, Yuan
    Dai, Rui
    Dong, Yuanlin
    Huang, Liya
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2024, 18
  • [8] Identifying sex differences in EEG-based emotion recognition using graph convolutional network with attention mechanism
    Peng, Dan
    Zheng, Wei-Long
    Liu, Luyu
    Jiang, Wei-Bang
    Li, Ziyi
    Lu, Yong
    Lu, Bao-Liang
    JOURNAL OF NEURAL ENGINEERING, 2023, 20 (06)
  • [9] CONVOLUTIONAL NEURAL NETWORK APPROACH FOR EEG-BASED EMOTION RECOGNITION USING BRAIN CONNECTIVITY AND ITS SPATIAL INFORMATION
    Moon, Seong-Eun
    Jang, Soobeom
    Lee, Jong-Seok
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 2556 - 2560
  • [10] EEG-Based Emotion Recognition by Using Convolutional Echo-State Network
    Chao H.
    Ma Q.
    Liu Y.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2022, 45 (02): : 36 - 43