Generator-based Domain Adaptation Method with Knowledge Free for Cross-subject EEG Emotion Recognition

被引:22
作者
Huang, Dongmin [1 ]
Zhou, Sijin [1 ]
Jiang, Dazhi [1 ]
机构
[1] Shantou Univ, Dept Comp Sci, Shantou 515063, Peoples R China
基金
中国国家自然科学基金;
关键词
EEG; GAN; Domain adaptation; Emotion recognition; SENTIMENT; ATTENTION; MACHINE; NETWORK;
D O I
10.1007/s12559-022-10016-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most existing approaches for cross-subject electroencephalogram (EEG) emotion recognition learn the universal features between different subjects with the neurological findings. The performance of these methods may be sub-optimal due to the inadequate investigation of the relationships between the brain and the emotion. Hence, in case of insufficient neurological findings, it is essential to develop a domain adaptation method for EEG data. In this paper, we propose a generator-based domain adaptation method with knowledge free (GDAKF) mechanism for the cross-subject EEG emotion recognition. Specifically, the feature distribution of the source domain is transformed into a feature distribution of the target domain via adversarial learning between the generator and the discriminator. Additionally, the transformation process is constrained by the EEG content regression loss and emotion information loss to maintain the emotional information during the feature alignment. To evaluate the effectiveness and performance of GDAKF, many experiments are carried out on the benchmark dataset, DEAP. The experimental result shows that GDAKF achieves excellent performance with 63.85% mean accuracy in low/high valence, which shows that the proposed method is comparable to the EEG cross-subject emotion recognition methods in the literature. This paper provides a novel idea for addressing cross-subject EEG emotion recognition, and it can also be applied to cross-session and cross-device emotion recognition tasks.
引用
收藏
页码:1316 / 1327
页数:12
相关论文
共 68 条
[1]   Review and Classification of Emotion Recognition Based on EEG Brain-Computer Interface System Research: A Systematic Review [J].
Al-Nafjan, Abeer ;
Hosny, Manar ;
Al-Ohali, Yousef ;
Al-Wabil, Areej .
APPLIED SCIENCES-BASEL, 2017, 7 (12)
[2]   Emotions Recognition Using EEG Signals: A Survey [J].
Alarcao, Soraia M. ;
Fonseca, Manuel J. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2019, 10 (03) :374-393
[3]  
Bahari Fatemeh, 2013, 2013 20th Iranian Conference on Biomedical Engineering (ICBME). Proceedings, P228, DOI 10.1109/ICBME.2013.6782224
[4]   Emotion Recognition Based on High-Resolution EEG Recordings and Reconstructed Brain Sources [J].
Becker, Hanna ;
Fleureau, Julien ;
Guillotel, Philippe ;
Wendling, Fabrice ;
Merlet, Isabelle ;
Albera, Laurent .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2020, 11 (02) :244-257
[5]  
Cambria E, 2013, PROCEEDINGS OF THE 2013 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE FOR HUMAN-LIKE INTELLIGENCE (CIHLI), P108, DOI 10.1109/CIHLI.2013.6613272
[6]   Combining Sentiment Lexicons and Content-Based Features for Depression Detection [J].
Chiong, Raymond ;
Budhi, Gregorious Satia ;
Dhakal, Sandeep .
IEEE INTELLIGENT SYSTEMS, 2021, 36 (06) :99-105
[7]   Investigating the Use of Pretrained Convolutional Neural Network on Cross-Subject and Cross-Dataset EEG Emotion Recognition [J].
Cimtay, Yucel ;
Ekmekcioglu, Erhan .
SENSORS, 2020, 20 (07)
[8]   EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network [J].
Cui, Heng ;
Liu, Aiping ;
Zhang, Xu ;
Chen, Xiang ;
Wang, Kongqiao ;
Chen, Xun .
KNOWLEDGE-BASED SYSTEMS, 2020, 205
[9]   A Review and Meta-Analysis of Multimodal Affect Detection Systems [J].
D'Mello, Sidney K. ;
Kory, Jacqueline .
ACM COMPUTING SURVEYS, 2015, 47 (03)
[10]   Brain-Computer Interface: Current and Emerging Rehabilitation Applications [J].
Daly, Janis J. ;
Huggins, Jane E. .
ARCHIVES OF PHYSICAL MEDICINE AND REHABILITATION, 2015, 96 (03) :S1-S7