EEG emotion Enhancement using Task-specific Domain Adversarial Neural Network

被引:11
作者
Ding, Ke-Ming [1 ]
Kimura, Tsukasa
Fukui, Ken-ichi
Numao, Masayuki
机构
[1] Osaka Univ, Inst Sci & Ind Res ISIR, Suita, Osaka, Japan
来源
2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2021年
关键词
electroencephalogram (EEG); emotion; Domain Adaptation; Cross-Phase; Cross-Subject;
D O I
10.1109/IJCNN52387.2021.9533310
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electroencephalogram (EEG) signal has been widely applied in detecting human emotion. Individual differences limit the generalization in cross-subject classification since the release of emotion will be definitely different across persons even with the same emotion stimuli. Previous research utilizes domain adaptation to solve this problem in a leave-one-subject-out training that is learning common emotion-related features from many subjects and testing on a new subject, which requires abundant labeled data. This paper proposed a novel one-to-one domain adaptation method, the Task-specific Domain Adversarial Neural Network (T-DANN) which transfers knowledge from either one subject to predict on another subject or knowledge from one phase to predict on another phase within the same subject. Therefore, T-DANN is more flexible and requires much less data during training. T-DANN is an adversarial training method which adapts the conditional distribution between domains and adapts classification boundaries between classes simultaneously. Compared with data from different subjects, phase data from the same subject has much deeper correlation thus enhances the prediction of emotion in new phase. We evaluated our method on EEG emotion benchmark dataset SEED. The experiments showed that our proposed method outperformed other baseline methods in cross-subject adaptation. By cross-phase adaptation, our method achieved accuracy that approximately 3% lower than the state-of-the-art method but only used 1/14 labeled data, indicating the priority of our proposed method in real-time application.
引用
收藏
页数:8
相关论文
共 27 条
[1]   A comprehensive review of EEG-based brain-computer interface paradigms [J].
Abiri, Reza ;
Borhani, Soheil ;
Sellers, Eric W. ;
Jiang, Yang ;
Zhao, Xiaopeng .
JOURNAL OF NEURAL ENGINEERING, 2019, 16 (01)
[2]  
Azab AM, 2018, IET CONTR ROBOT SENS, V114, P81, DOI 10.1049/PBCE114E_ch5
[3]   A Fast, Efficient Domain Adaptation Technique for Cross-Domain Electroencephalography(EEG)-Based Emotion Recognition [J].
Chai, Xin ;
Wang, Qisong ;
Zhao, Yongping ;
Li, Yongqiang ;
Liu, Dan ;
Liu, Xin ;
Bai, Ou .
SENSORS, 2017, 17 (05)
[4]  
Clerc Maureen, 2016, BRAIN COMPUTER INTEI
[5]  
Collobert R, 2006, J MACH LEARN RES, V7, P1687
[6]  
Duan RN, 2013, I IEEE EMBS C NEUR E, P81, DOI 10.1109/NER.2013.6695876
[7]  
Ganin Y, 2016, J MACH LEARN RES, V17
[8]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[9]   EMOTION REGULATION AND MENTAL-HEALTH [J].
GROSS, JJ ;
MUNOZ, RF .
CLINICAL PSYCHOLOGY-SCIENCE AND PRACTICE, 1995, 2 (02) :151-164
[10]   Associative Domain Adaptation [J].
Haeusser, Philip ;
Frerix, Thomas ;
Mordvintsev, Alexander ;
Cremers, Daniel .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2784-2792