A Novel Data Augmentation Approach Using Mask Encoding for Deep Learning-Based Asynchronous SSVEP-BCI

被引:8
作者
Ding, Wenlong [1 ]
Liu, Aiping [1 ]
Guan, Ling [2 ,3 ]
Chen, Xun [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Peoples R China
[2] Beijing Tiantan Hosp, Natl Ctr Neurol Disorders, Beijing 100070, Peoples R China
[3] Univ British Columbia, Dept Med, Vancouver, BC V6H 3N1, Canada
关键词
Asynchronous brain-computer interface; data augmentation; deep learning; electroencephalography mask encoding; steady-state visual evoked potential; CANONICAL CORRELATION-ANALYSIS; FREQUENCY RECOGNITION; NEURAL-NETWORK; MOTOR IMAGERY; BRAIN; CLASSIFICATION; PERFORMANCE;
D O I
10.1109/TNSRE.2024.3366930
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Deep learning (DL)-based methods have been successfully employed as asynchronous classification algorithms in the steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) system. However, these methods often suffer from the limited amount of electroencephalography (EEG) data, leading to overfitting. This study proposes an effective data augmentation approach called EEG mask encoding (EEG-ME) to mitigate overfitting. EEG-ME forces models to learn more robust features by masking partial EEG data, leading to enhanced generalization capabilities of models. Three different network architectures, including an architecture integrating convolutional neural networks (CNN) with Transformer (CNN-Former), time domain-based CNN (tCNN), and a lightweight architecture (EEGNet) are utilized to validate the effectiveness of EEG-ME on publicly available benchmark and BETA datasets. The results demonstrate that EEG-ME significantly enhances the average classification accuracy of various DL-based methods with different data lengths of time windows on two public datasets. Specifically, CNN-Former, tCNN, and EEGNet achieve respective improvements of 3.18%, 1.42%, and 3.06% on the benchmark dataset as well as 11.09%, 3.12%, and 2.81% on the BETA dataset, with the 1-second time window as an example. The enhanced performance of SSVEP classification with EEG-ME promotes the implementation of the asynchronous SSVEP-BCI system, leading to improved robustness and flexibility in human-machine interaction.
引用
收藏
页码:875 / 886
页数:12
相关论文
共 47 条
[1]   Simulating Brain Signals: Creating Synthetic EEG Data via Neural-Based Generative Models for Improved SSVEP Classification [J].
Aznan, Nik Khadijah Nik ;
Atapour-Abarghouei, Amir ;
Bonner, Stephen ;
Connolly, Jason D. ;
Al Moubayed, Noura ;
Breckon, Toby P. .
2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
[2]  
Ba JL, 2016, arXiv
[3]   Transfer learning and SpecAugment applied to SSVEP based BCI classification [J].
Bassi, Pedro R. A. S. ;
Rampazzo, Willian ;
Attux, Romis .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 67
[4]   A transformer-based deep neural network model for SSVEP classification [J].
Chen, Jianbo ;
Zhang, Yangsong ;
Pan, Yudong ;
Xu, Peng ;
Guan, Cuntai .
NEURAL NETWORKS, 2023, 164 :521-534
[5]   Adaptive asynchronous control system of robotic arm based on augmented reality-assisted brain-computer interface [J].
Chen, Lingling ;
Chen, Pengfei ;
Zhao, Shaokai ;
Luo, Zhiguo ;
Chen, Wei ;
Pei, Yu ;
Zhao, Hongyu ;
Jiang, Jing ;
Xu, Minpeng ;
Yan, Ye ;
Yin, Erwei .
JOURNAL OF NEURAL ENGINEERING, 2021, 18 (06)
[6]   High-speed spelling with a noninvasive brain-computer interface [J].
Chen, Xiaogang ;
Wang, Yijun ;
Nakanishi, Masaki ;
Gao, Xiaorong ;
Jung, Tzyy-Ping ;
Gao, Shangkai .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2015, 112 (44) :E6058-E6067
[7]   Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain-computer interface [J].
Chen, Xiaogang ;
Wang, Yijun ;
Gao, Shangkai ;
Jung, Tzyy-Ping ;
Gao, Xiaorong .
JOURNAL OF NEURAL ENGINEERING, 2015, 12 (04)
[8]  
Clevert DA, 2016, Arxiv, DOI arXiv:1511.07289
[9]  
Devlin J, 2019, Arxiv, DOI arXiv:1810.04805
[10]   Filter Bank Convolutional Neural Network for Short Time-Window Steady-State Visual Evoked Potential Classification [J].
Ding, Wenlong ;
Shan, Jianhua ;
Fang, Bin ;
Wang, Chengyin ;
Sun, Fuchun ;
Li, Xinyue .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 :2615-2624