EEG emotion Enhancement using Task-specific Domain Adversarial Neural Network

被引:10
作者
Ding, Ke-Ming [1 ]
Kimura, Tsukasa
Fukui, Ken-ichi
Numao, Masayuki
机构
[1] Osaka Univ, Inst Sci & Ind Res ISIR, Suita, Osaka, Japan
来源
2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2021年
关键词
electroencephalogram (EEG); emotion; Domain Adaptation; Cross-Phase; Cross-Subject;
D O I
10.1109/IJCNN52387.2021.9533310
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electroencephalogram (EEG) signal has been widely applied in detecting human emotion. Individual differences limit the generalization in cross-subject classification since the release of emotion will be definitely different across persons even with the same emotion stimuli. Previous research utilizes domain adaptation to solve this problem in a leave-one-subject-out training that is learning common emotion-related features from many subjects and testing on a new subject, which requires abundant labeled data. This paper proposed a novel one-to-one domain adaptation method, the Task-specific Domain Adversarial Neural Network (T-DANN) which transfers knowledge from either one subject to predict on another subject or knowledge from one phase to predict on another phase within the same subject. Therefore, T-DANN is more flexible and requires much less data during training. T-DANN is an adversarial training method which adapts the conditional distribution between domains and adapts classification boundaries between classes simultaneously. Compared with data from different subjects, phase data from the same subject has much deeper correlation thus enhances the prediction of emotion in new phase. We evaluated our method on EEG emotion benchmark dataset SEED. The experiments showed that our proposed method outperformed other baseline methods in cross-subject adaptation. By cross-phase adaptation, our method achieved accuracy that approximately 3% lower than the state-of-the-art method but only used 1/14 labeled data, indicating the priority of our proposed method in real-time application.
引用
收藏
页数:8
相关论文
共 27 条
  • [1] A comprehensive review of EEG-based brain-computer interface paradigms
    Abiri, Reza
    Borhani, Soheil
    Sellers, Eric W.
    Jiang, Yang
    Zhao, Xiaopeng
    [J]. JOURNAL OF NEURAL ENGINEERING, 2019, 16 (01)
  • [2] Azab AM, 2018, IET CONTR ROBOT SENS, V114, P81, DOI 10.1049/PBCE114E_ch5
  • [3] A Fast, Efficient Domain Adaptation Technique for Cross-Domain Electroencephalography(EEG)-Based Emotion Recognition
    Chai, Xin
    Wang, Qisong
    Zhao, Yongping
    Li, Yongqiang
    Liu, Dan
    Liu, Xin
    Bai, Ou
    [J]. SENSORS, 2017, 17 (05)
  • [4] Clerc Maureen, 2016, BRAIN COMPUTER INTEI
  • [5] Collobert R, 2006, J MACH LEARN RES, V7, P1687
  • [6] Duan RN, 2013, I IEEE EMBS C NEUR E, P81, DOI 10.1109/NER.2013.6695876
  • [7] Ganin Y, 2016, J MACH LEARN RES, V17
  • [8] Generative Adversarial Networks
    Goodfellow, Ian
    Pouget-Abadie, Jean
    Mirza, Mehdi
    Xu, Bing
    Warde-Farley, David
    Ozair, Sherjil
    Courville, Aaron
    Bengio, Yoshua
    [J]. COMMUNICATIONS OF THE ACM, 2020, 63 (11) : 139 - 144
  • [9] EMOTION REGULATION AND MENTAL-HEALTH
    GROSS, JJ
    MUNOZ, RF
    [J]. CLINICAL PSYCHOLOGY-SCIENCE AND PRACTICE, 1995, 2 (02) : 151 - 164
  • [10] Associative Domain Adaptation
    Haeusser, Philip
    Frerix, Thomas
    Mordvintsev, Alexander
    Cremers, Daniel
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2784 - 2792