Convolutional Transformer-Based Cross Subject Model for SSVEP-Based BCI Classification

被引:2
作者
Liu, Jiawei [1 ]
Wang, Ruimin [2 ]
Yang, Yuankui [1 ]
Zong, Yuan [1 ]
Leng, Yue [1 ]
Zheng, Wenming [1 ]
Ge, Sheng [1 ]
机构
[1] Southeast Univ, Sch Biol Sci & Med Engn, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 211189, Peoples R China
[2] Saga Univ, Fac Sci & Engn, Dept Elect & Elect Engn, Saga 8408502, Japan
基金
中国国家自然科学基金;
关键词
Feature extraction; Calibration; Transformers; Data models; Brain modeling; Correlation; Convolution; Brain-computer interface; domain generalization; steady-state visual evoked potentials; transformer; BRAIN-COMPUTER INTERFACE; NEURAL-NETWORK; RECOGNITION;
D O I
10.1109/JBHI.2024.3454158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Steady-state visual evoked potential (SSVEP) is a commonly used brain-computer interface (BCI) paradigm. The performance of cross-subject SSVEP classification has a strong impact on SSVEP-BCI. This study designed a cross subject generalization SSVEP classification model based on an improved transformer structure that uses domain generalization (DG). The global receptive field of multi-head self-attention is used to learn the global generalized SSVEP temporal information across subjects. This is combined with a parallel local convolution module, designed to avoid oversmoothing the oscillation characteristics of temporal SSVEP data and better fit the feature. Moreover, to improve the cross-subject calibration-free SSVEP classification performance, an DG method named StableNet is combined with the proposed convolutional transformer structure to form the DG-Conformer method, which can eliminate spurious correlations between SSVEP discriminative information and background noise to improve cross-subject generalization. Experiments on two public datasets, Benchmark and BETA, demonstrated the outstanding performance of the proposed DG-Conformer compared with other calibration-free methods, FBCCA, tt-CCA, Compact-CNN, FB-tCNN, and SSVEPNet. Additionally, DG-Conformer outperforms the classic calibration-required algorithms eCCA, eTRCA and eSSCOR when calibration is used. An incomplete partial stimulus calibration scheme was also explored on the Benchmark dataset, and it was demonstrated to be a potential solution for further high-performance personalized SSVEP-BCI with quick calibration.
引用
收藏
页码:6581 / 6593
页数:13
相关论文
共 50 条
[21]   Online SSVEP-based BCI using Riemannian geometry [J].
Kalunga, Emmanuel K. ;
Chevallier, Sylvain ;
Barthelemy, Quentin ;
Djouani, Karim ;
Monacelli, Eric ;
Hamam, Yskandar .
NEUROCOMPUTING, 2016, 191 :55-68
[22]   Influence of Stimuli Color Combination on Online SSVEP-based BCI Performance [J].
Li, Xiaodong ;
Wang, Xiaojun ;
Wong, Chi Man ;
Wen, Rongwei ;
Wan, Feng ;
Hu, Yong .
2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND VIRTUAL ENVIRONMENTS FOR MEASUREMENT SYSTEMS AND APPLICATIONS (CIVEMSA 2019), 2019, :34-38
[23]   Autonomous Parameter Adjustment for SSVEP-Based BCIs with a Novel BCI Wizard [J].
Gembler, Felix ;
Stawicki, Piotr ;
Volosyak, Ivan .
FRONTIERS IN NEUROSCIENCE, 2015, 9
[24]   Analysis of the Influence of the MVDR Filter Parameters on the Performance of SSVEP-Based BCI [J].
Lima, Lucas Brazzarola ;
Viana, Ramon Fernandes ;
Rosa-Jr, Jose Martins ;
Arruda Leite, Harlei Miguel ;
Vargas, Guilherme Vettorazzi ;
Carvalho, Sarah Negreiros .
INTELLIGENT SYSTEMS, PT I, 2022, 13653 :313-324
[25]   Frequency Recognition for SSVEP-Based BCI With Data Adaptive Reference Signals [J].
Islam, Md. Rabiul ;
Tanaka, Toshihisa ;
Morikawa, Naoki ;
Molla, Md. Khademul Islam .
2015 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2015, :799-803
[26]   Filter Bank Spatiotemporal Beamforming for Frequency Detection in SSVEP-based BCI [J].
Jiang, Yichuan ;
Kang, Yue ;
Wang, Peng ;
Ge, Sheng .
2019 IEEE EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL & HEALTH INFORMATICS (BHI), 2019,
[27]   How to identify the user specific stimulation frequencies for SSVEP-based BCI [J].
Rejer, Izabela ;
Cieszynski, Lukasz .
2016 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2016, :2750-2755
[28]   L1-Regularized Multiway Canonical Correlation Analysis for SSVEP-Based BCI [J].
Zhang, Yu ;
Zhou, Guoxu ;
Jin, Jing ;
Wang, Minjue ;
Wang, Xingyu ;
Cichocki, Andrzej .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2013, 21 (06) :887-896
[29]   A SSVEP-Based BCI for Controlling a 4-DOF Robotic Manipulator [J].
Lin, Canguang ;
Deng, Xiaoyan ;
Yu, Zhu Liang ;
Gu, Zhenghui .
2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, :2174-2179
[30]   Enhancing SSVEP-Based BCI Performance via Consensus Information Transfer Among Subjects [J].
Zhang, Xinyi ;
Wei, Wei ;
Qiu, Shuang ;
Li, Xujin ;
Wang, Yijun ;
He, Huiguang .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,