Convolutional Transformer-Based Cross Subject Model for SSVEP-Based BCI Classification

被引:0
作者
Liu, Jiawei [1 ]
Wang, Ruimin [2 ]
Yang, Yuankui [1 ]
Zong, Yuan [1 ]
Leng, Yue [1 ]
Zheng, Wenming [1 ]
Ge, Sheng [1 ]
机构
[1] Southeast Univ, Sch Biol Sci & Med Engn, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 211189, Peoples R China
[2] Saga Univ, Fac Sci & Engn, Dept Elect & Elect Engn, Saga 8408502, Japan
基金
中国国家自然科学基金;
关键词
Feature extraction; Calibration; Transformers; Data models; Brain modeling; Correlation; Convolution; Brain-computer interface; domain generalization; steady-state visual evoked potentials; transformer; BRAIN-COMPUTER INTERFACE; NEURAL-NETWORK; RECOGNITION;
D O I
10.1109/JBHI.2024.3454158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Steady-state visual evoked potential (SSVEP) is a commonly used brain-computer interface (BCI) paradigm. The performance of cross-subject SSVEP classification has a strong impact on SSVEP-BCI. This study designed a cross subject generalization SSVEP classification model based on an improved transformer structure that uses domain generalization (DG). The global receptive field of multi-head self-attention is used to learn the global generalized SSVEP temporal information across subjects. This is combined with a parallel local convolution module, designed to avoid oversmoothing the oscillation characteristics of temporal SSVEP data and better fit the feature. Moreover, to improve the cross-subject calibration-free SSVEP classification performance, an DG method named StableNet is combined with the proposed convolutional transformer structure to form the DG-Conformer method, which can eliminate spurious correlations between SSVEP discriminative information and background noise to improve cross-subject generalization. Experiments on two public datasets, Benchmark and BETA, demonstrated the outstanding performance of the proposed DG-Conformer compared with other calibration-free methods, FBCCA, tt-CCA, Compact-CNN, FB-tCNN, and SSVEPNet. Additionally, DG-Conformer outperforms the classic calibration-required algorithms eCCA, eTRCA and eSSCOR when calibration is used. An incomplete partial stimulus calibration scheme was also explored on the Benchmark dataset, and it was demonstrated to be a potential solution for further high-performance personalized SSVEP-BCI with quick calibration.
引用
收藏
页码:6581 / 6593
页数:13
相关论文
共 50 条
  • [31] Character encoding based on occurrence probability enhances the performance of SSVEP-based BCI spellers
    Sadeghi, Sahar
    Maleki, Ali
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2020, 58 (58)
  • [32] EEG Classification with Transformer-Based Models
    Sun, Jiayao
    Xie, Jin
    Zhou, Huihui
    [J]. 2021 IEEE 3RD GLOBAL CONFERENCE ON LIFE SCIENCES AND TECHNOLOGIES (IEEE LIFETECH 2021), 2021, : 92 - 93
  • [33] Inter- and Intra-Subject Transfer Reduces Calibration Effort for High-Speed SSVEP-Based BCIs
    Wong, Chi Man
    Wang, Ze
    Wang, Boyu
    Lao, Ka Fai
    Rosa, Agostinho
    Xu, Peng
    Jung, Tzyy-Ping
    Chen, C. L. Philip
    Wan, Feng
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (10) : 2123 - 2135
  • [34] Discriminative Feature Extraction via Multivariate Linear Regression for SSVEP-Based BCI
    Wang, Haiqiang
    Zhang, Yu
    Waytowich, Nicholas R.
    Krusienski, Dean J.
    Zhou, Guoxu
    Jin, Jing
    Wang, Xingyu
    Cichocki, Andrzej
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2016, 24 (05) : 532 - 541
  • [35] Evaluate the Feasibility of Using Frontal SSVEP to Implement an SSVEP-Based BCI in Young, Elderly and ALS Groups
    Hsu, Hao-Teng
    Lee, I-Hui
    Tsai, Han-Ting
    Chang, Hsiang-Chih
    Shyu, Kuo-Kai
    Hsu, Chuan-Chih
    Chang, Hsiao-Huang
    Yeh, Ting-Kuang
    Chang, Chun-Yen
    Lee, Po-Lei
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2016, 24 (05) : 603 - 615
  • [36] Frequency Detection for SSVEP-Based BCI using Deep Canonical Correlation Analysis
    Vu, Hanh
    Koo, Bonkon
    Choi, Seungjin
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2016, : 1983 - 1987
  • [37] An SSVEP-Based BCI Using High Duty-Cycle Visual Flicker
    Lee, Po-Lei
    Yeh, Chia-Lung
    Cheng, John Yung-Sung
    Yang, Chia-Yen
    Lan, Gong-Yau
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2011, 58 (12) : 3350 - 3359
  • [38] Muscle Artifact Removal Toward Mobile SSVEP-Based BCI: A Comparative Study
    Liu, Aiping
    Liu, Qingze
    Zhang, Xu
    Chen, Xiang
    Chen, Xun
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70 (70)
  • [39] A New Object-oriented SSVEP-based BCI Paradigm Using Continuous Action Scene
    Zhang, Liming
    Zhang, Xiaodong
    Lu, Zhufeng
    Li, Rui
    [J]. 2017 IEEE 7TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (CYBER), 2017, : 1078 - 1082
  • [40] Control of a 7-DOF Robotic Arm System With an SSVEP-Based BCI
    Chen, Xiaogang
    Zhao, Bing
    Wang, Yijun
    Xu, Shengpu
    Gao, Xiaorong
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2018, 28 (08)