An end-to-end deep learning approach to MI-EEG signal classification for BCIs

被引:257
作者
Dose, Hauke [1 ]
Moller, Jakob S. [1 ]
Iversen, Helle K. [2 ]
Puthusserypady, Sadasivan [1 ]
机构
[1] Tech Univ Denmark, Dept Elect Engn, DK-2800 Lyngby, Denmark
[2] Glostrup Cty Hosp, Neurol Dept, DK-2600 Glostrup, Denmark
关键词
Deep learning (DL); Electroencephalogram (EEG); Motor imagery (MI); Convolutional neural networks (CNNs); Brain computer interface (BCI); Stroke rehabilitation; BRAIN-COMPUTER INTERFACES; MOTOR IMAGERY; CHANNEL SELECTION; REHABILITATION; INFORMATION; PATTERNS;
D O I
10.1016/j.eswa.2018.08.031
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Goal: To develop and implement a Deep Learning (DL) approach for an electroencephalogram (EEG) based Motor Imagery (MI) Brain-Computer Interface (BCI) system that could potentially be used to improve the current stroke rehabilitation strategies. Method: The DL model is using Convolutional Neural Network (CNN) layers for learning generalized features and dimension reduction, while a conventional Fully Connected (FC) layer is used for classification. Together they build a unified end-to-end model that can be applied to raw EEG signals. This previously proposed model was applied to a new set of data to validate its robustness against data variations. Furthermore, it was extended by subject-specific adaptation. Lastly, an analysis of the learned filters provides insights into how such a model derives a classification decision. Results: The selected global classifier reached 80.38%, 69.82%, and 58.58% mean accuracies for datasets with two, three, and four classes, respectively, validated using 5-fold crossvalidation. As a novel approach in this context, transfer learning was used to adapt the global classifier to single individuals improving the overall mean accuracy to 86.49%, 79.25%, and 68.51%, respectively. The global models were trained on 3s segments of EEG data from different subjects than they were tested on, which proved the generalization performance of the model. Conclusion: The results are comparable with the reported accuracy values in related studies and the presented model outperforms the results in the literature on the same underlying data. Given that the model can learn features from data without having to use specialized feature extraction methods, DL should be considered as an alternative to established EEG classification methods, if enough data is available. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:532 / 542
页数:11
相关论文
共 46 条
[1]   Separable Common Spatio-Spectral Patterns for Motor Imagery BCI Systems [J].
Aghaei, Amirhossein S. ;
Mahanta, Mohammad Shahin ;
Plataniotis, Konstantinos N. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2016, 63 (01) :15-29
[2]  
Ang KK, 2008, IEEE IJCNN, P2390, DOI 10.1109/IJCNN.2008.4634130
[3]  
[Anonymous], 2013, CIRCULATION
[4]  
[Anonymous], INT J ADV RES ARTIFI
[5]  
[Anonymous], 2016, ICLR C
[6]   Repetitive transcranial magnetic stimulation for stroke rehabilitation-potential therapy or misplaced hope? [J].
Bates, Kristyn Alissa ;
Rodger, Jennifer .
RESTORATIVE NEUROLOGY AND NEUROSCIENCE, 2015, 33 (04) :557-569
[7]   Random Forest and Filter Bank Common Spatial Patterns for EEG-Based Motor Imagery Classification [J].
Bentlemsan, Maouia ;
Zemouri, ET-Tahir ;
Bouchaffra, Djamel ;
Yahya-Zoubir, Bahia ;
Ferroudji, Karim .
PROCEEDINGS FIFTH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS, MODELLING AND SIMULATION, 2014, :235-238
[8]   Brain-computer interfaces for communication and rehabilitation [J].
Chaudhary, Ujwal ;
Birbaumer, Niels ;
Ramos-Murguialday, Ander .
NATURE REVIEWS NEUROLOGY, 2016, 12 (09) :513-525
[9]  
Do AH, 2012, IEEE ENG MED BIO, P6414, DOI 10.1109/EMBC.2012.6347462
[10]   Brain-Computer Interface Controlled Functional Electrical Stimulation System for Ankle Movement [J].
Do, An H. ;
Wang, Po T. ;
King, Christine E. ;
Abiri, Ahmad ;
Nenadic, Zoran .
JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2011, 8