Convolutional Transformer-Based Cross Subject Model for SSVEP-Based BCI Classification

被引:0
|
作者
Liu, Jiawei [1 ]
Wang, Ruimin [2 ]
Yang, Yuankui [1 ]
Zong, Yuan [1 ]
Leng, Yue [1 ]
Zheng, Wenming [1 ]
Ge, Sheng [1 ]
机构
[1] Southeast Univ, Sch Biol Sci & Med Engn, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 211189, Peoples R China
[2] Saga Univ, Fac Sci & Engn, Dept Elect & Elect Engn, Saga 8408502, Japan
基金
中国国家自然科学基金;
关键词
Feature extraction; Calibration; Transformers; Data models; Brain modeling; Correlation; Convolution; Brain-computer interface; domain generalization; steady-state visual evoked potentials; transformer; BRAIN-COMPUTER INTERFACE; NEURAL-NETWORK; RECOGNITION;
D O I
10.1109/JBHI.2024.3454158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Steady-state visual evoked potential (SSVEP) is a commonly used brain-computer interface (BCI) paradigm. The performance of cross-subject SSVEP classification has a strong impact on SSVEP-BCI. This study designed a cross subject generalization SSVEP classification model based on an improved transformer structure that uses domain generalization (DG). The global receptive field of multi-head self-attention is used to learn the global generalized SSVEP temporal information across subjects. This is combined with a parallel local convolution module, designed to avoid oversmoothing the oscillation characteristics of temporal SSVEP data and better fit the feature. Moreover, to improve the cross-subject calibration-free SSVEP classification performance, an DG method named StableNet is combined with the proposed convolutional transformer structure to form the DG-Conformer method, which can eliminate spurious correlations between SSVEP discriminative information and background noise to improve cross-subject generalization. Experiments on two public datasets, Benchmark and BETA, demonstrated the outstanding performance of the proposed DG-Conformer compared with other calibration-free methods, FBCCA, tt-CCA, Compact-CNN, FB-tCNN, and SSVEPNet. Additionally, DG-Conformer outperforms the classic calibration-required algorithms eCCA, eTRCA and eSSCOR when calibration is used. An incomplete partial stimulus calibration scheme was also explored on the Benchmark dataset, and it was demonstrated to be a potential solution for further high-performance personalized SSVEP-BCI with quick calibration.
引用
收藏
页码:6581 / 6593
页数:13
相关论文
共 50 条
  • [1] A transformer-based deep neural network model for SSVEP classification
    Chen, Jianbo
    Zhang, Yangsong
    Pan, Yudong
    Xu, Peng
    Guan, Cuntai
    NEURAL NETWORKS, 2023, 164 : 521 - 534
  • [2] A Study on SSVEP-Based BCI
    Zheng-Hua Wu is with School of Computer Science Engineering
    Journal of Electronic Science and Technology, 2009, 7 (01) : 7 - 11
  • [3] Cross-Subject Transfer Method Based on Domain Generalization for Facilitating Calibration of SSVEP-Based BCIs
    Huang, Jiayang
    Zhang, Zhi-Qiang
    Xiong, Bang
    Wang, Quan
    Wan, Bo
    Li, Fengqi
    Yang, Pengfei
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 3307 - 3319
  • [4] Wavelet Transform in Detection of the Subject Specific Frequencies for SSVEP-Based BCI
    Rejer, Izabela
    HARD AND SOFT COMPUTING FOR ARTIFICIAL INTELLIGENCE, MULTIMEDIA AND SECURITY, 2017, 534 : 146 - 155
  • [5] Information Bottleneck as Optimisation Method for SSVEP-Based BCI
    Ingel, Anti
    Vicente, Raul
    FRONTIERS IN HUMAN NEUROSCIENCE, 2021, 15
  • [6] Online Adaptation Boosts SSVEP-Based BCI Performance
    Wong, Chi Man
    Wang, Ze
    Nakanishi, Masaki
    Wang, Boyu
    Rosa, Agostinho
    Chen, C. L. Philip
    Jung, Tzyy-Ping
    Wan, Feng
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2022, 69 (06) : 2018 - 2028
  • [7] Subject-Specific Methodology in the Frequency Scanning Phase of SSVEP-Based BCI
    Rejer, Izabela
    Cieszynski, Lukasz
    HARD AND SOFT COMPUTING FOR ARTIFICIAL INTELLIGENCE, MULTIMEDIA AND SECURITY, 2017, 534 : 123 - 132
  • [8] The element of user training for SSVEP-based BCI
    Szalowski, Artur
    Picovici, Dorel
    2019 30TH IRISH SIGNALS AND SYSTEMS CONFERENCE (ISSC), 2019,
  • [9] A Generalized Zero-Shot Learning Scheme for SSVEP-Based BCI System
    Wang, Xietian
    Liu, Aiping
    Wu, Le
    Li, Chang
    Liu, Yu
    Chen, Xun
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 863 - 874
  • [10] Fuzzy Tracking and Control Algorithm for an SSVEP-Based BCI System
    Chen, Yeou-Jiunn
    Chen, Shih-Chung
    Zaeni, Ilham A. E.
    Wu, Chung-Min
    APPLIED SCIENCES-BASEL, 2016, 6 (10):