A novel approach of decoding EEG four-class motor imagery tasks via scout ESI and CNN

被引:108
作者
Hou, Yimin [1 ]
Zhou, Lu [1 ]
Jia, Shuyue [2 ]
Lun, Xiangmin [3 ]
机构
[1] Northeast Elect Power Univ, Sch Automat Engn, Jilin, Jilin, Peoples R China
[2] Northeast Elect Power Univ, Sch Comp Sci, Jilin, Jilin, Peoples R China
[3] Changchun Univ Sci & Technol, Coll Mech & Elect Engn, Changchun, Peoples R China
关键词
EEG source imaging; motor imagery; convolutional neural networks; joint time-frequency analysis; CONVOLUTIONAL NEURAL-NETWORKS; BOUNDARY-ELEMENT METHOD; CLASSIFICATION;
D O I
10.1088/1741-2552/ab4af6
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. To develop and implement a novel approach which combines the technique of scout EEG source imaging (ESI) with convolutional neural network (CNN) for the classification of motor imagery (MI) tasks. Approach. The technique of ESI uses a boundary element method (BEM) and weighted minimum norm estimation (WMNE) to solve the EEG forward and inverse problems, respectively. Ten scouts are then created within the motor cortex to select the region of interest (ROI). We extract features from the time series of scouts using a Morlet wavelet approach. Lastly, CNN is employed for classifying MI tasks. Main results. The overall mean accuracy on the Physionet database reaches 94.5% and the individual accuracy of each task reaches 95.3%, 93.3%, 93.6%, 96% for the left fist, right fist, both fists and both feet, correspondingly, validated using ten-fold cross validation. We report an increase of up to 14.4% for overall classification compared with the competitive results from the state-of-the-art MI classification methods. Then, we add four new subjects to verify the validity of the method and the overall mean accuracy is 92.5%. Furthermore, the global classifier was adapted to single subjects improving the overall mean accuracy to 94.54%. Significance. The combination of scout ESI and CNN enhances BCI performance of decoding EEG four-class MI tasks.
引用
收藏
页数:15
相关论文
共 58 条
[1]  
Alkinoos A, 2017, BIOMED RES INT, V2017, P1
[2]   Neurophysiological predictor of SMR-based BCI performance [J].
Blankertz, Benjamin ;
Sannelli, Claudia ;
Haider, Sebastian ;
Hammer, Eva M. ;
Kuebler, Andrea ;
Mueller, Klaus-Robert ;
Curio, Gabriel ;
Dickhaus, Thorsten .
NEUROIMAGE, 2010, 51 (04) :1303-1309
[3]   Synchronous Oscillatory Neural Ensembles for Rules in the Prefrontal Cortex [J].
Buschman, Timothy J. ;
Denovellis, Eric L. ;
Diogo, Cinira ;
Bullock, Daniel ;
Miller, Earl K. .
NEURON, 2012, 76 (04) :838-846
[4]   High-speed spelling with a noninvasive brain-computer interface [J].
Chen, Xiaogang ;
Wang, Yijun ;
Nakanishi, Masaki ;
Gao, Xiaorong ;
Jung, Tzyy-Ping ;
Gao, Shangkai .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2015, 112 (44) :E6058-E6067
[5]   Deep learning for hybrid EEG-fNIRS brain-computer interface: application to motor imagery classification [J].
Chiarelli, Antonio Maria ;
Croce, Pierpaolo ;
Merla, Arcangelo ;
Zappasodi, Filippo .
JOURNAL OF NEURAL ENGINEERING, 2018, 15 (03)
[6]   High-resolution EEG techniques for brain-computer interface applications [J].
Cincotti, Febo ;
Mattia, Donatella ;
Aloise, Fabio ;
Bufalari, Simona ;
Astolfi, Laura ;
Fallani, Fabrizio De Vico ;
Tocci, Andrea ;
Bianchi, Luigi ;
Marciani, Maria Grazia ;
Gao, Shangkai ;
Millan, Jose ;
Babiloni, Fabio .
JOURNAL OF NEUROSCIENCE METHODS, 2008, 167 (01) :31-42
[7]   Design and construction of a realistic digital brain phantom [J].
Collins, DL ;
Zijdenbos, AP ;
Kollokian, V ;
Sled, JG ;
Kabani, NJ ;
Holmes, CJ ;
Evans, AC .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 1998, 17 (03) :463-468
[8]   Mobile robot navigation with a self-paced brain-computer interface based on high-frequency SSVEP [J].
Diez, Pablo F. ;
Mut, Vicente A. ;
Laciar, Eric ;
Perona, Enrique M. Avila .
ROBOTICA, 2014, 32 (05) :695-709
[9]   An end-to-end deep learning approach to MI-EEG signal classification for BCIs [J].
Dose, Hauke ;
Moller, Jakob S. ;
Iversen, Helle K. ;
Puthusserypady, Sadasivan .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 114 :532-542
[10]   A Voting Optimized Strategy Based on ELM for Improving Classification of Motor Imagery BCI Data [J].
Duan, Lijuan ;
Zhong, Hongyan ;
Miao, Jun ;
Yang, Zhen ;
Ma, Wei ;
Zhang, Xuan .
COGNITIVE COMPUTATION, 2014, 6 (03) :477-483