A Generalized Zero-Shot Learning Scheme for SSVEP-Based BCI System

被引:0
作者
Wang, Xietian [1 ]
Liu, Aiping [1 ]
Wu, Le [1 ]
Li, Chang [2 ]
Liu, Yu [2 ]
Chen, Xun [3 ,4 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Peoples R China
[2] Hefei Univ Technol, Dept Biomed Engi neering, Hefei 230009, Peoples R China
[3] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Peoples R China
[4] Inst Dataspace, Hefei Comprehens Natl Sci Ctr, Hefei 230088, Peoples R China
基金
中国国家自然科学基金;
关键词
Brain-computer interface; steady-state visual evoked potential; generalized zero-shot learning;
D O I
暂无
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The steady-state visual evoked potential (SSVEP) has been widely used in building multi-target brain-computer interfaces (BCIs) based on electro-encephalogram (EEG). However, methods for high-accuracy SSVEP systems require training data for each target, which needs significant calibration time. This study aimed to use the data of only part of the targets for training while achieving high classification accuracy on all targets. In this work, we proposed a generalized zero-shot learning (GZSL) scheme for SSVEP classification. We divided the target classes into seen and unseen classes and trained the classifier only using the seen classes. During the test time, the search space contained both seen classes and unseen classes. In the proposed scheme, the EEG data and the sine waves are embedded into the same latent space using convolutional neural networks (CNN). We use the correlation coefficient of the two outputs in the latent space for classification. Our method was tested on two public datasets and reached 89.9% of the classification accuracy of the state-of-the-art (SOTA) data-driven method, which needs the training data of all targets. Compared to the SOTA training-free method, our method achieved a multifold improvement. This work shows that it is promising to build an SSVEP classification system that does not need the training data of all targets.
引用
收藏
页码:863 / 874
页数:12
相关论文
共 53 条
[1]   A comprehensive review of EEG-based brain-computer interface paradigms [J].
Abiri, Reza ;
Borhani, Soheil ;
Sellers, Eric W. ;
Jiang, Yang ;
Zhao, Xiaopeng .
JOURNAL OF NEURAL ENGINEERING, 2019, 16 (01)
[2]  
Akata Z, 2015, PROC CVPR IEEE, P2927, DOI 10.1109/CVPR.2015.7298911
[3]  
Bai SJ, 2018, Arxiv, DOI DOI 10.48550/ARXIV.1803.01271
[4]   An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wild [J].
Chao, Wei-Lun ;
Changpinyo, Soravit ;
Gong, Boqing ;
Sha, Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :52-68
[5]  
Chen X, 2016, ADV NEUR IN, V29
[6]   Combination of high-frequency SSVEP-based BCI and computer vision for controlling a robotic arm [J].
Chen, Xiaogang ;
Zhao, Bing ;
Wang, Yijun ;
Gao, Xiaorong .
JOURNAL OF NEURAL ENGINEERING, 2019, 16 (02)
[7]   High-speed spelling with a noninvasive brain-computer interface [J].
Chen, Xiaogang ;
Wang, Yijun ;
Nakanishi, Masaki ;
Gao, Xiaorong ;
Jung, Tzyy-Ping ;
Gao, Shangkai .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2015, 112 (44) :E6058-E6067
[8]   Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain-computer interface [J].
Chen, Xiaogang ;
Wang, Yijun ;
Gao, Shangkai ;
Jung, Tzyy-Ping ;
Gao, Xiaorong .
JOURNAL OF NEURAL ENGINEERING, 2015, 12 (04)
[9]   Toward Open-World Electroencephalogram Decoding Via Deep Learning: A comprehensive survey [J].
Chen, Xun ;
Li, Chang ;
Liu, Aiping ;
McKeown, Martin J. ;
Qian, Ruobing ;
Wang, Z. Jane .
IEEE SIGNAL PROCESSING MAGAZINE, 2022, 39 (02) :117-134
[10]   Implementing a calibration-free SSVEP-based BCI system with 160 targets [J].
Chen, Yonghao ;
Yang, Chen ;
Ye, Xiaochen ;
Chen, Xiaogang ;
Wang, Yijun ;
Gao, Xiaorong .
JOURNAL OF NEURAL ENGINEERING, 2021, 18 (04)