Convolutional Transformer-Based Cross Subject Model for SSVEP-Based BCI Classification

被引:0
作者
Liu, Jiawei [1 ]
Wang, Ruimin [2 ]
Yang, Yuankui [1 ]
Zong, Yuan [1 ]
Leng, Yue [1 ]
Zheng, Wenming [1 ]
Ge, Sheng [1 ]
机构
[1] Southeast Univ, Sch Biol Sci & Med Engn, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 211189, Peoples R China
[2] Saga Univ, Fac Sci & Engn, Dept Elect & Elect Engn, Saga 8408502, Japan
基金
中国国家自然科学基金;
关键词
Feature extraction; Calibration; Transformers; Data models; Brain modeling; Correlation; Convolution; Brain-computer interface; domain generalization; steady-state visual evoked potentials; transformer; BRAIN-COMPUTER INTERFACE; NEURAL-NETWORK; RECOGNITION;
D O I
10.1109/JBHI.2024.3454158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Steady-state visual evoked potential (SSVEP) is a commonly used brain-computer interface (BCI) paradigm. The performance of cross-subject SSVEP classification has a strong impact on SSVEP-BCI. This study designed a cross subject generalization SSVEP classification model based on an improved transformer structure that uses domain generalization (DG). The global receptive field of multi-head self-attention is used to learn the global generalized SSVEP temporal information across subjects. This is combined with a parallel local convolution module, designed to avoid oversmoothing the oscillation characteristics of temporal SSVEP data and better fit the feature. Moreover, to improve the cross-subject calibration-free SSVEP classification performance, an DG method named StableNet is combined with the proposed convolutional transformer structure to form the DG-Conformer method, which can eliminate spurious correlations between SSVEP discriminative information and background noise to improve cross-subject generalization. Experiments on two public datasets, Benchmark and BETA, demonstrated the outstanding performance of the proposed DG-Conformer compared with other calibration-free methods, FBCCA, tt-CCA, Compact-CNN, FB-tCNN, and SSVEPNet. Additionally, DG-Conformer outperforms the classic calibration-required algorithms eCCA, eTRCA and eSSCOR when calibration is used. An incomplete partial stimulus calibration scheme was also explored on the Benchmark dataset, and it was demonstrated to be a potential solution for further high-performance personalized SSVEP-BCI with quick calibration.
引用
收藏
页码:6581 / 6593
页数:13
相关论文
共 50 条
  • [21] Multivariate Synchronization Index Based on Independent Component Analysis for SSVEP-Based BCI
    Zhu, Yanlong
    Dai, Chenglong
    Pi, Dechang
    ADVANCED DATA MINING AND APPLICATIONS, ADMA 2018, 2018, 11323 : 105 - 115
  • [22] Autonomous Parameter Adjustment for SSVEP-Based BCIs with a Novel BCI Wizard
    Gembler, Felix
    Stawicki, Piotr
    Volosyak, Ivan
    FRONTIERS IN NEUROSCIENCE, 2015, 9
  • [23] Influence of Stimuli Color Combination on Online SSVEP-based BCI Performance
    Li, Xiaodong
    Wang, Xiaojun
    Wong, Chi Man
    Wen, Rongwei
    Wan, Feng
    Hu, Yong
    2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND VIRTUAL ENVIRONMENTS FOR MEASUREMENT SYSTEMS AND APPLICATIONS (CIVEMSA 2019), 2019, : 34 - 38
  • [24] Analysis of the Influence of the MVDR Filter Parameters on the Performance of SSVEP-Based BCI
    Lima, Lucas Brazzarola
    Viana, Ramon Fernandes
    Rosa-Jr, Jose Martins
    Arruda Leite, Harlei Miguel
    Vargas, Guilherme Vettorazzi
    Carvalho, Sarah Negreiros
    INTELLIGENT SYSTEMS, PT I, 2022, 13653 : 313 - 324
  • [25] Frequency Recognition for SSVEP-Based BCI With Data Adaptive Reference Signals
    Islam, Md. Rabiul
    Tanaka, Toshihisa
    Morikawa, Naoki
    Molla, Md. Khademul Islam
    2015 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2015, : 799 - 803
  • [26] How to identify the user specific stimulation frequencies for SSVEP-based BCI
    Rejer, Izabela
    Cieszynski, Lukasz
    2016 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2016, : 2750 - 2755
  • [27] Filter Bank Spatiotemporal Beamforming for Frequency Detection in SSVEP-based BCI
    Jiang, Yichuan
    Kang, Yue
    Wang, Peng
    Ge, Sheng
    2019 IEEE EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL & HEALTH INFORMATICS (BHI), 2019,
  • [28] Enhancing SSVEP-Based BCI Performance via Consensus Information Transfer Among Subjects
    Zhang, Xinyi
    Wei, Wei
    Qiu, Shuang
    Li, Xujin
    Wang, Yijun
    He, Huiguang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [29] A SSVEP-Based BCI for Controlling a 4-DOF Robotic Manipulator
    Lin, Canguang
    Deng, Xiaoyan
    Yu, Zhu Liang
    Gu, Zhenghui
    2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 2174 - 2179
  • [30] L1-Regularized Multiway Canonical Correlation Analysis for SSVEP-Based BCI
    Zhang, Yu
    Zhou, Guoxu
    Jin, Jing
    Wang, Minjue
    Wang, Xingyu
    Cichocki, Andrzej
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2013, 21 (06) : 887 - 896