Convolutional Transformer-Based Cross Subject Model for SSVEP-Based BCI Classification

被引:2
作者
Liu, Jiawei [1 ]
Wang, Ruimin [2 ]
Yang, Yuankui [1 ]
Zong, Yuan [1 ]
Leng, Yue [1 ]
Zheng, Wenming [1 ]
Ge, Sheng [1 ]
机构
[1] Southeast Univ, Sch Biol Sci & Med Engn, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 211189, Peoples R China
[2] Saga Univ, Fac Sci & Engn, Dept Elect & Elect Engn, Saga 8408502, Japan
基金
中国国家自然科学基金;
关键词
Feature extraction; Calibration; Transformers; Data models; Brain modeling; Correlation; Convolution; Brain-computer interface; domain generalization; steady-state visual evoked potentials; transformer; BRAIN-COMPUTER INTERFACE; NEURAL-NETWORK; RECOGNITION;
D O I
10.1109/JBHI.2024.3454158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Steady-state visual evoked potential (SSVEP) is a commonly used brain-computer interface (BCI) paradigm. The performance of cross-subject SSVEP classification has a strong impact on SSVEP-BCI. This study designed a cross subject generalization SSVEP classification model based on an improved transformer structure that uses domain generalization (DG). The global receptive field of multi-head self-attention is used to learn the global generalized SSVEP temporal information across subjects. This is combined with a parallel local convolution module, designed to avoid oversmoothing the oscillation characteristics of temporal SSVEP data and better fit the feature. Moreover, to improve the cross-subject calibration-free SSVEP classification performance, an DG method named StableNet is combined with the proposed convolutional transformer structure to form the DG-Conformer method, which can eliminate spurious correlations between SSVEP discriminative information and background noise to improve cross-subject generalization. Experiments on two public datasets, Benchmark and BETA, demonstrated the outstanding performance of the proposed DG-Conformer compared with other calibration-free methods, FBCCA, tt-CCA, Compact-CNN, FB-tCNN, and SSVEPNet. Additionally, DG-Conformer outperforms the classic calibration-required algorithms eCCA, eTRCA and eSSCOR when calibration is used. An incomplete partial stimulus calibration scheme was also explored on the Benchmark dataset, and it was demonstrated to be a potential solution for further high-performance personalized SSVEP-BCI with quick calibration.
引用
收藏
页码:6581 / 6593
页数:13
相关论文
共 50 条
[41]   User performance Evaluation with Visual Stimulator Regulation of SSVEP-based BCI System [J].
Punsawad, Yunyong ;
Wongsawat, Yodchanan .
2014 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2014,
[42]   FREQUENCY RECOGNITION IN SSVEP-BASED BCI USING MULTISET CANONICAL CORRELATION ANALYSIS [J].
Zhang, Yu ;
Zhou, Guoxu ;
Jin, Jing ;
Wang, Xingyu ;
Cichocki, Andrzej .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2014, 24 (04)
[43]   An Analysis of Traditional Methods and Deep Learning Methods in SSVEP-Based BCI: A Survey [J].
Wu, Jiaxuan ;
Wang, Jingjing .
ELECTRONICS, 2024, 13 (14)
[44]   A Novel Combination of Time Phase and EEG Frequency Components for SSVEP-Based BCI [J].
Jin, Jing ;
Zhang, Yu ;
Wang, Xingyu .
NEURAL INFORMATION PROCESSING, PT I, 2011, 7062 :273-+
[45]   Transfer Learning for SSVEP-based BCI using Riemannian similarities between users [J].
Kalunga, Emmanuel K. ;
Chevallier, Sylvain ;
Barthelemy, Quentin .
2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, :1685-1689
[46]   Control of a 7-DOF Robotic Arm System With an SSVEP-Based BCI [J].
Chen, Xiaogang ;
Zhao, Bing ;
Wang, Yijun ;
Xu, Shengpu ;
Gao, Xiaorong .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2018, 28 (08)
[47]   An Asynchronous P300 BCI With SSVEP-Based Control State Detection [J].
Panicker, Rajesh C. ;
Puthusserypady, Sadasivan ;
Sun, Ying .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2011, 58 (06) :1781-1788
[48]   A Generalized Zero-Shot Learning Scheme for SSVEP-Based BCI System [J].
Wang, Xietian ;
Liu, Aiping ;
Wu, Le ;
Li, Chang ;
Liu, Yu ;
Chen, Xun .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 :863-874
[49]   On the Relative Contribution of Deep Convolutional Neural Networks for SSVEP-Based Bio-Signal Decoding in BCI Speller Applications [J].
Podmore, Joshua J. ;
Breckon, Toby P. ;
Aznan, Nik K. N. ;
Connolly, Jason D. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2019, 27 (04) :611-618
[50]   Self-Flickering Visual Stimulus based on Visual illusion for SSVEP-based BCI System [J].
Punsawad, Yunyong ;
Siribunyaphat, Nannaphat ;
Wongsawat, Yodchanan .
2018 11TH BIOMEDICAL ENGINEERING INTERNATIONAL CONFERENCE (BMEICON 2018), 2018,