A Novel Data Augmentation Approach Using Mask Encoding for Deep Learning-Based Asynchronous SSVEP-BCI

被引:7
作者
Ding, Wenlong [1 ]
Liu, Aiping [1 ]
Guan, Ling [2 ,3 ]
Chen, Xun [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Peoples R China
[2] Beijing Tiantan Hosp, Natl Ctr Neurol Disorders, Beijing 100070, Peoples R China
[3] Univ British Columbia, Dept Med, Vancouver, BC V6H 3N1, Canada
关键词
Asynchronous brain-computer interface; data augmentation; deep learning; electroencephalography mask encoding; steady-state visual evoked potential; CANONICAL CORRELATION-ANALYSIS; FREQUENCY RECOGNITION; NEURAL-NETWORK; MOTOR IMAGERY; BRAIN; CLASSIFICATION; PERFORMANCE;
D O I
10.1109/TNSRE.2024.3366930
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Deep learning (DL)-based methods have been successfully employed as asynchronous classification algorithms in the steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) system. However, these methods often suffer from the limited amount of electroencephalography (EEG) data, leading to overfitting. This study proposes an effective data augmentation approach called EEG mask encoding (EEG-ME) to mitigate overfitting. EEG-ME forces models to learn more robust features by masking partial EEG data, leading to enhanced generalization capabilities of models. Three different network architectures, including an architecture integrating convolutional neural networks (CNN) with Transformer (CNN-Former), time domain-based CNN (tCNN), and a lightweight architecture (EEGNet) are utilized to validate the effectiveness of EEG-ME on publicly available benchmark and BETA datasets. The results demonstrate that EEG-ME significantly enhances the average classification accuracy of various DL-based methods with different data lengths of time windows on two public datasets. Specifically, CNN-Former, tCNN, and EEGNet achieve respective improvements of 3.18%, 1.42%, and 3.06% on the benchmark dataset as well as 11.09%, 3.12%, and 2.81% on the BETA dataset, with the 1-second time window as an example. The enhanced performance of SSVEP classification with EEG-ME promotes the implementation of the asynchronous SSVEP-BCI system, leading to improved robustness and flexibility in human-machine interaction.
引用
收藏
页码:875 / 886
页数:12
相关论文
共 47 条
[11]   Brain-Computer Interface Integrated With Augmented Reality for Human-Robot Interaction [J].
Fang, Bin ;
Ding, Wenlong ;
Sun, Fuchun ;
Shan, Jianhua ;
Wang, Xiaojia ;
Wang, Chengyin ;
Zhang, Xinyu .
IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (04) :1702-1711
[12]   Res2Net: A New Multi-Scale Backbone Architecture [J].
Gao, Shang-Hua ;
Cheng, Ming-Ming ;
Zhao, Kai ;
Zhang, Xin-Yu ;
Yang, Ming-Hsuan ;
Torr, Philip .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (02) :652-662
[13]   Interface, interaction, and intelligence in generalized brain-computer interfaces [J].
Gao, Xiaorong ;
Wang, Yijun ;
Chen, Xiaogang ;
Gao, Shangkai .
TRENDS IN COGNITIVE SCIENCES, 2021, 25 (08) :671-684
[14]   A Deep Neural Network for SSVEP-Based Brain-Computer Interfaces [J].
Guney, Osman Berke ;
Oblokulov, Muhtasham ;
Ozkan, Huseyin .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2022, 69 (02) :932-944
[15]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[16]   SleepTransformer: Automatic Sleep Staging With Interpretability and Uncertainty Quantification [J].
Huy Phan ;
Mikkelsen, Kaare ;
Chen, Oliver Y. ;
Koch, Philipp ;
Mertins, Alfred ;
De Vos, Maarten .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2022, 69 (08) :2456-2467
[17]   Temporal Combination Pattern Optimization Based on Feature Selection Method for Motor Imagery BCIs [J].
Jiang, Jing ;
Wang, Chunhui ;
Wu, Jinghan ;
Qin, Wei ;
Xu, Minpeng ;
Yin, Erwei .
FRONTIERS IN HUMAN NEUROSCIENCE, 2020, 14
[18]   Enhancing Detection of Control State for High-Speed Asynchronous SSVEP-BCIs Using Frequency-Specific Framework [J].
Ke, Yufeng ;
Du, Jiale ;
Liu, Shuang ;
Ming, Dong .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 :1405-1417
[19]   Data augmentation for deep-learning-based electroencephalography [J].
Lashgari, Elnaz ;
Liang, Dehua ;
Maoz, Uri .
JOURNAL OF NEUROSCIENCE METHODS, 2020, 346
[20]   Deep learning [J].
LeCun, Yann ;
Bengio, Yoshua ;
Hinton, Geoffrey .
NATURE, 2015, 521 (7553) :436-444