Contrastive Learning of EEG Representation of Brain Area for Emotion Recognition

被引:0
作者
Dai, Sheng [1 ]
Li, Ming [1 ]
Wu, Xu [1 ]
Ju, Xiangyu [1 ]
Li, Xinyu [1 ]
Yang, Jun [1 ]
Hu, Dewen [1 ]
机构
[1] Natl Univ Def Technol, Coll Intelligence Sci & Technol, Changsha 410073, Peoples R China
关键词
Feature extraction; Electrodes; Brain modeling; Brain; Data mining; Deep learning; Training; Brain area; contrastive learning; electroencephalography (EEG); emotion recognition; self-supervised learning; CONVOLUTIONAL NEURAL-NETWORKS; ATTENTION;
D O I
10.1109/TIM.2025.3533618
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Emotion recognition based on electroencephalography (EEG) has demonstrated promising effectiveness in recent years. However, challenges have been experienced, such as limited dataset availability, experimental protocol inconsistencies, and inherent spatiotemporal redundancies in the EEG data. In this work, we introduce a novel method of contrastive learning of EEG representation of brain area (CLRA). Our method is based on the fact that the EEG signals are of high similarity within brain regions and show significant differences between brain regions. The model is designed to obtain the representation capable of distinguishing signals from different brain areas. Specifically, a 1-D convolutional neural network (CNN) and a recurrent network were applied to learn temporal representations from channelwise EEG in contrastive learning. The representations were recombined and fused to extract features for emotion classification. Experimental evaluations performed on public database for emotion analysis using physiological signals (DEAP) and Shanghai Jiao Tong University emotion EEG dataset (SEED) demonstrate the efficacy of our proposed framework, yielding state-of-the-art results in EEG-based emotion recognition tasks. In our cross-subject experiment, our method achieved an accuracy of 95.23% and 96.31% in valence and arousal on the DEAP, and an accuracy of 95.16% on SEED. Additionally, our experiments involving reduced channel configurations demonstrated an improvement in classification accuracy even with fewer electrodes. Furthermore, CLRA exhibits strong generalization performance and robustness, facilitated by its ability to extract informative single-channel features, thus enabling seamless cross-dataset integration and training.
引用
收藏
页数:13
相关论文
共 52 条
[1]   Emotions Recognition Using EEG Signals: A Survey [J].
Alarcao, Soraia M. ;
Fonseca, Manuel J. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2019, 10 (03) :374-393
[2]   Attention-based generative adversarial network with internal damage segmentation using thermography [J].
Ali, Rahmat ;
Cha, Young-Jin .
AUTOMATION IN CONSTRUCTION, 2022, 141
[3]   Dynamic Convolution With Multilevel Attention for EEG-Based Motor Imagery Decoding [J].
Altaheri, Hamdi ;
Muhammad, Ghulam ;
Alsulaiman, Mansour .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (21) :18579-18588
[4]   Human Emotions Classification Using EEG via Audiovisual Stimuli and AI [J].
Asiri, Abdullah A. ;
Badshah, Akhtar ;
Muhammad, Fazal ;
Alshamrani, Hassan A. ;
Ullah, Khalil ;
Alshamrani, Khalaf A. ;
Alqhtani, Samar ;
Irfan, Muhammad ;
Halawani, Hanan Talal ;
Mehdar, Khlood M. .
CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (03) :5075-5089
[5]   Uncovering the structure of clinical EEG signals with self-supervised learning [J].
Banville, Hubert ;
Chehab, Omar ;
Hyvarinen, Aapo ;
Engemann, Denis-Alexander ;
Gramfort, Alexandre .
JOURNAL OF NEURAL ENGINEERING, 2021, 18 (04)
[6]   Emotion Recognition Based on High-Resolution EEG Recordings and Reconstructed Brain Sources [J].
Becker, Hanna ;
Fleureau, Julien ;
Guillotel, Philippe ;
Wendling, Fabrice ;
Merlet, Isabelle ;
Albera, Laurent .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2020, 11 (02) :244-257
[7]   DNoiseNet: Deep learning-based feedback active noise control in various noisy environments [J].
Cha, Young-Jin ;
Mostafavi, Alireza ;
Benipal, Sukhpreet S. .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 121
[8]   EEG-CLNet: Collaborative Learning for Simultaneous Measurement of Sleep Stages and OSA Events Based on Single EEG Signal [J].
Cheng, Liu ;
Luo, Shengqiong ;
Yu, Xinge ;
Ghayvat, Hemant ;
Zhang, Haibo ;
Zhang, Yuan .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[9]  
Devlin J, 2019, Arxiv, DOI arXiv:1810.04805
[10]   LGGNet: Learning From Local-Global-Graph Representations for Brain-Computer Interface [J].
Ding, Yi ;
Robinson, Neethu ;
Tong, Chengxuan ;
Zeng, Qiuhao ;
Guan, Cuntai .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) :9773-9786