Generative Adversarial Networks-Based Data Augmentation for Brain-Computer Interface

被引:137
作者
Fahimi, Fatemeh [1 ,2 ]
Dosen, Strahinja [3 ]
Ang, Kai Keng [1 ,2 ]
Mrachacz-Kersting, Natalie [4 ]
Guan, Cuntai [1 ]
机构
[1] Nanyang Technol Univ NTU, Sch Comp Sci & Engn, Singapore, Singapore
[2] ASTAR, Inst Infocomm Res I2R, Singapore, Singapore
[3] Aalborg Univ, Dept Hlth Sci & Technol, DK-9220 Aalborg, Denmark
[4] Dortmund Univ Appl Sci & Art, D-44139 Dortmund, Germany
关键词
Brain-computer interface (BCI); data augmentation; deep learning; diverted attention; electroencephalogram (EEG); generative adversarial networks (GANs); intersubject transfer learning;
D O I
10.1109/TNNLS.2020.3016666
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The performance of a classifier in a brain-computer interface (BCI) system is highly dependent on the quality and quantity of training data. Typically, the training data are collected in a laboratory where the users perform tasks in a controlled environment. However, users' attention may be diverted in real-life BCI applications and this may decrease the performance of the classifier. To improve the robustness of the classifier, additional data can be acquired in such conditions, but it is not practical to record electroencephalogram (EEG) data over several long calibration sessions. A potentially time- and cost-efficient solution is artificial data generation. Hence, in this study, we proposed a framework based on the deep convolutional generative adversarial networks (DCGANs) for generating artificial EEG to augment the training set in order to improve the performance of a BCI classifier. To make a comparative investigation, we designed a motor task experiment with diverted and focused attention conditions. We used an end-to-end deep convolutional neural network for classification between movement intention and rest using the data from 14 subjects. The results from the leave-one subject-out (LOO) classification yielded baseline accuracies of 73.04% for diverted attention and 80.09% for focused attention without data augmentation. Using the proposed DCGANs-based framework for augmentation, the results yielded a significant improvement of 7.32% for diverted attention (p < 0.01) and 5.45% for focused attention (p < 0.01 ). In addition, we implemented the method on the data set IV a from BCI competition III to distinguish different motor imagery tasks. The proposed method increased the accuracy by 3.57% (p < 0.02). This study shows that using GANs for EEG augmentation can significantly improve BCI performance, especially in real-life applications, whereby users' attention may be diverted.
引用
收藏
页码:4039 / 4051
页数:13
相关论文
共 51 条
[1]   Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals [J].
Acharya, U. Rajendra ;
Oh, Shu Lih ;
Hagiwara, Yuki ;
Tan, Jen Hong ;
Adeli, Hojjat .
COMPUTERS IN BIOLOGY AND MEDICINE, 2018, 100 :270-278
[2]  
Ang KK, 2008, IEEE IJCNN, P2390, DOI 10.1109/IJCNN.2008.4634130
[3]  
[Anonymous], 2018, EEG-GAN: Generative adversarial networks for electroencephalographic (EEG) brain signals
[4]  
Antoniou A., 2017, CoRR
[5]  
Arjovsky M., 2017, arXiv preprint arXiv:1701.07875
[6]   EEG Data Space Adaptation to Reduce Intersession Nonstationarity in Brain-Computer Interface [J].
Arvaneh, Mahnaz ;
Guan, Cuntai ;
Ang, Kai Keng ;
Quek, Chai .
NEURAL COMPUTATION, 2013, 25 (08) :2146-2171
[7]   Simulating Brain Signals: Creating Synthetic EEG Data via Neural-Based Generative Models for Improved SSVEP Classification [J].
Aznan, Nik Khadijah Nik ;
Atapour-Abarghouei, Amir ;
Bonner, Stephen ;
Connolly, Jason D. ;
Al Moubayed, Noura ;
Breckon, Toby P. .
2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
[8]   Optimizing spatial filters for robust EEG single-trial analysis [J].
Blankertz, Benjamin ;
Tomioka, Ryota ;
Lemm, Steven ;
Kawanabe, Motoaki ;
Mueller, Klaus-Robert .
IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (01) :41-56
[9]   Brain-computer interfacing under distraction: an evaluation study [J].
Brandl, Stephanie ;
Frolich, Laura ;
Hoehne, Johannes ;
Mueller, Klaus-Robert ;
Samek, Wojciech .
JOURNAL OF NEURAL ENGINEERING, 2016, 13 (05)
[10]  
Corley Isaac A., 2018, 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), P100, DOI 10.1109/BHI.2018.8333379