An Intersubject Brain-Computer Interface Based on Domain-Adversarial Training of Convolutional Neural Network

被引:0
作者
Chen, Di [1 ,2 ]
Huang, Haiyun [2 ,3 ]
Guan, Zijing [1 ,2 ]
Pan, Jiahui [2 ,3 ]
Li, Yuanqing [1 ,2 ]
机构
[1] South China Univ Technol, Sch Automat Sci & Engn, Guangzhou, Peoples R China
[2] Pazhou Lab, Res Ctr Brain Comp Interface, Pazhou, Peoples R China
[3] South China Normal Univ, Sch Software, Guangzhou 510630, Peoples R China
基金
中国国家自然科学基金;
关键词
Index Terms -Electroencephalography (EEG); intersubject; attention decoding; offline analysis; domain-adversarial training neural network (DANN); online brain- computer interface (BCI); EEG; NEUROFEEDBACK; DEPRESSION; ALERTNESS; POWER;
D O I
10.1109/TBME.2024.3404131
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
- Objective: Attention decoding plays a vital role in daily life, where electroencephalography (EEG) has been widely involved. However, training a universally effective model for everyone is impractical due to substantial interindividual variability in EEG signals. To tackle the above challenge, we propose an end-to-end brain-computer interface (BCI) framework, including temporal and spatial one-dimensional (1D) convolutional neural network and domain-adversarial training strategy, namely DA-TSnet. Method: Specifically, DA-TSnet extracts temporal and spatial features of EEG, while it is jointly supervised by task loss and domain loss. During training, DA-TSnet aims to maximize the domain loss while simultaneously minimizing the task loss. We conduct an offline analysis, simulate online experiments on a self-collected dataset of 85 subjects, and real online experiments on 22 subjects. Main results: DA-TSnet achieves a leave-one-subject-out (LOSO) cross-validation (CV) classification accuracy of 89.40% +/- 9.96%, outperforming several state-of-the-art attention EEG decoding methods. In simulated online experiments, DA-TSnet achieves an outstanding accuracy of 88.07% +/- 11.22%. In real online experiments, it achieves an average accuracy surpassing 86%. Significance: An end-to-end network framework does not rely on elaborate preprocessing and feature extraction steps, which saves time and human workload. Moreover, our framework utilizes domain-adversarial training neural network (DANN) to tackle the challenge posed by the high interindividual variability in EEG signals, which has significant reference value for handling other EEG signal decoding issues. Last, the performance of the DA-TSnet framework in offline and online experiments underscores its potential to facilitate more reliable applications.
引用
收藏
页码:2956 / 2967
页数:12
相关论文
共 49 条
  • [1] [Anonymous], 2016, INT C LEARN REPR
  • [2] Real-time analysis of EEG indexes of alertness, cognition, and memory acquired with a wireless EEG headset
    Berka, C
    Levendowski, DJ
    Cvetinovic, MM
    Petrovic, MM
    Davis, G
    Lumicao, MN
    Zivkovic, VT
    Popovic, MV
    Olmstead, R
    [J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2004, 17 (02) : 151 - 170
  • [3] An EEG-based attention recognition method: fusion of time domain, frequency domain, and non-linear dynamics features
    Chen, Di
    Huang, Haiyun
    Bao, Xiaoyu
    Pan, Jiahui
    Li, Yuanqing
    [J]. FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [4] Estimation of neural dynamics from MEG/EEG cortical current density maps: Application, to the reconstruction of large-scale cortical synchrony
    David, O
    Garnero, L
    Cosmelli, D
    Varela, FJ
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2002, 49 (09) : 975 - 987
  • [5] Generative Adversarial Networks-Based Data Augmentation for Brain-Computer Interface
    Fahimi, Fatemeh
    Dosen, Strahinja
    Ang, Kai Keng
    Mrachacz-Kersting, Natalie
    Guan, Cuntai
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (09) : 4039 - 4051
  • [6] Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI
    Fahimi, Fatemeh
    Zhang, Zhuo
    Goh, Wooi Boon
    Lee, Tih-Shi
    Ang, Kai Keng
    Guan, Cuntai
    [J]. JOURNAL OF NEURAL ENGINEERING, 2019, 16 (02)
  • [7] Predicting Treatment Failure in Regular Care Internet-Delivered Cognitive Behavior Therapy for Depression and Anxiety Using Only Weekly Symptom Measures
    Forsell, Erik
    Isacsson, Nils
    Blom, Kerstin
    Jernelov, Susanna
    Ben Abdesslem, Fehmi
    Lindefors, Nils
    Boman, Magnus
    Kaldo, Viktor
    [J]. JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY, 2020, 88 (04) : 311 - 321
  • [8] Ganin Y, 2016, J MACH LEARN RES, V17
  • [9] Ganin Y, 2015, PR MACH LEARN RES, V37, P1180
  • [10] Learning Invariant Patterns Based on a Convolutional Neural Network and Big Electroencephalography Data for Subject-Independent P300 Brain-Computer Interfaces
    Gao, Wei
    Yu, Tianyou
    Yu, Jin-Gang
    Gu, Zhenghui
    Li, Kendi
    Huang, Yong
    Yu, Zhu Liang
    Li, Yuanqing
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 : 1047 - 1057