SFT-SGAT: A semi-supervised fine-tuning self-supervised graph attention network for emotion recognition and consciousness detection

被引:1
|
作者
Qiu, Lina [1 ,2 ]
Zhong, Liangquan [1 ]
Li, Jianping [1 ]
Feng, Weisen [1 ]
Zhou, Chengju [1 ]
Pan, Jiahui [1 ]
机构
[1] South China Normal Univ, Sch Artificial Intelligence, Guangzhou 510630, Peoples R China
[2] South China Normal Univ, Res Stn Math, Guangzhou 510630, Peoples R China
基金
中国国家自然科学基金;
关键词
Emotion recognition; Cross-subject; Semi-supervised; Self-supervised; Graph attention network; EEG; BRAIN; DISORDERS; DEFICITS;
D O I
10.1016/j.neunet.2024.106643
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotional recognition is highly important in the field of brain-computer interfaces (BCIs). However, due to the individual variability in electroencephalogram (EEG) signals and the challenges in obtaining accurate emotional labels, traditional methods have shown poor performance in cross-subject emotion recognition. In this study, we propose a cross-subject EEG emotion recognition method based on a semi-supervised finetuning self-supervised graph attention network (SFT-SGAT). First, we model multi-channel EEG signals by constructing a graph structure that dynamically captures the spatiotemporal topological features of EEG signals. Second, we employ a self-supervised graph attention neural network to facilitate model training, mitigating the impact of signal noise on the model. Finally, a semi-supervised approach is used to fine-tune the model, enhancing its generalization ability in cross-subject classification. By combining supervised and unsupervised learning techniques, the SFT-SGAT maximizes the utility of limited labeled data in EEG emotion recognition tasks, thereby enhancing the model's performance. Experiments based on leave-one-subject-out cross-validation demonstrate that SFT-SGAT achieves state-of-the-art cross-subject emotion recognition performance on the SEED and SEED-IV datasets, with accuracies of 92.04% and 82.76%, respectively. Furthermore, experiments conducted on a self-collected dataset comprising ten healthy subjects and eight patients with disorders of consciousness (DOCs) revealed that the SFT-SGAT attains high classification performance in healthy subjects (maximum accuracy of 95.84%) and was successfully applied to DOC patients, with four patients achieving emotion recognition accuracies exceeding 60%. The experiments demonstrate the effectiveness of the proposed SFT-SGAT model in cross-subject EEG emotion recognition and its potential for assessing levels of consciousness in patients with DOC.
引用
收藏
页数:11
相关论文
共 23 条
  • [21] Semi-supervised few-shot fault diagnosis driven by multi-head dynamic graph attention network under speed fluctuations
    Jiang, Li
    Wang, Shuaiyu
    Zhang, Tianao
    Wang, Lei
    Li, Yibing
    Zhang, Xin
    DIGITAL SIGNAL PROCESSING, 2024, 151
  • [22] Emotion Recognition in Gaming Dataset to Reduce Artifacts in the Self-Assessed Labeling Using Semi-Supervised Clustering (vol 12, pg 52659, 2024)
    Almanza-Conejo, Oscar
    Avina-Cervantes, Juan Gabriel
    Garcia-Perez, Arturo
    Ibarra-Manzano, Mario Alberto
    IEEE ACCESS, 2024, 12 : 179488 - 179488
  • [23] SSA-Net: Spatial self-attention network for COVID-19 pneumonia infection segmentation with semi-supervised few-shot learning
    Wang, Xiaoyan
    Yuan, Yiwen
    Guo, Dongyan
    Huang, Xiaojie
    Cui, Ying
    Xia, Ming
    Wang, Zhenhua
    Bai, Cong
    Chen, Shengyong
    MEDICAL IMAGE ANALYSIS, 2022, 79