A Novel Deep Learning Approach With Data Augmentation to Classify Motor Imagery Signals

被引:157
作者
Zhang, Zhiwen [1 ]
Duan, Feng [1 ]
Sole-Casals, Jordi [2 ,3 ]
Dinares-Ferran, Josep [2 ]
Cichocki, Andrzej [4 ,5 ,6 ,7 ]
Yang, Zhenglu [8 ]
Sun, Zhe [9 ]
机构
[1] Nankai Univ, Dept Artificial Intelligence, Tianjin 300350, Peoples R China
[2] Univ Vic, Cent Univ Catalonia, Dept Engn, Barcelona 08500, Spain
[3] Univ Cambridge, Dept Psychiat, Cambridge CB2 3EB, England
[4] Skolkowo Inst Sci & Technol, Moscow 121205, Russia
[5] Hangzhou Dianzi Univ, Coll Comp Sci, Hangzhou 310018, Zhejiang, Peoples R China
[6] Nicolaus Copernicus Univ, Dept Informat, PL-87100 Torun, Poland
[7] Polish Acad Sci, Syst Res Inst, PL-01447 Warsaw, Poland
[8] Nankai Univ, Dept Comp Sci, Tianjin 300350, Peoples R China
[9] RIKEN, Computat Engn Applicat Unit, Head Off Informat Syst & Cybersecur, Saitama 3510198, Japan
基金
中国国家自然科学基金;
关键词
Motor imagery classification; deep learning; convolutional neural network; wavelet neural network; empirical mode decomposition; artificial EEG frames; EMPIRICAL MODE DECOMPOSITION; BRAIN-COMPUTER INTERFACE; EEG SIGNALS; CLASSIFICATION; PERFORMANCE; FEATURES;
D O I
10.1109/ACCESS.2019.2895133
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Brain-computer interface provides a new communication bridge between the human mind and devices, depending largely on the accurate classification and identification of non-invasive EEG signals. Recently, the deep learning approaches have been widely used in many fields to extract features and classify various types of data successfully. However, the deep learning approach requires massive data to train its neural networks, and the amount of data impacts greatly on the quality of the classifiers. This paper proposes a novel approach that combines deep learning and data augmentation for EEG classification. We applied the empirical mode decomposition on the EEG frames and mixed their intrinsic mode functions to create new artificial EEG frames, followed by transforming all EEG data into tensors as inputs of the neural network by complex Morlet wavelets. We proposed two neural networks-convolutional neural network and wavelet neural network-to train the weights and classify two classes of motor imagery signals. The wavelet neural network is a new type of neural network using wavelets to replace the convolutional layers. The experimental results show that the artificial EEG frames substantially improve the training of neural networks, and both two networks yield relatively higher classification accuracies compared to prevailing approaches. Meanwhile, we also verified the performance of our new proposed wavelet neural network model in the classification of steady-state visual evoked potentials.
引用
收藏
页码:15945 / 15954
页数:10
相关论文
共 47 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   Performance variation in motor imagery brain-computer interface: A brief review [J].
Ahn, Minkyu ;
Jun, Sung Chan .
JOURNAL OF NEUROSCIENCE METHODS, 2015, 243 :103-110
[3]   Architectonic Mapping of the Human Brain beyond Brodmann [J].
Amunts, Katrin ;
Zilles, Karl .
NEURON, 2015, 88 (06) :1086-1107
[4]   A Deep Learning Method for Classification of EEG Data Based on Motor Imagery [J].
An, Xiu ;
Kuang, Deping ;
Guo, Xiaojiao ;
Zhao, Yilu ;
He, Lianghua .
INTELLIGENT COMPUTING IN BIOINFORMATICS, 2014, 8590 :203-210
[5]   Tensor decompositions for feature extraction and classification of high dimensional datasets [J].
Anh Huy Phan ;
Ciehoeki, Andrzej .
IEICE NONLINEAR THEORY AND ITS APPLICATIONS, 2010, 1 (01) :37-68
[6]  
[Anonymous], 2014, P INT COMP S ICS, DOI DOI 10.3233/978-1-61499-484-8-150
[7]  
[Anonymous], FRONT NEUROSCI SWITZ
[8]  
[Anonymous], TECH REP
[9]  
[Anonymous], IEEE J BIOMED HLTH I
[10]   Control of a humanoid robot by a noninvasive brain-computer interface in humans [J].
Bell, Christian J. ;
Shenoy, Pradeep ;
Chalodhorn, Rawichote ;
Rao, Rajesh P. N. .
JOURNAL OF NEURAL ENGINEERING, 2008, 5 (02) :214-220