Motor Imagery EEG Classification Using Capsule Networks

被引:90
作者
Ha, Kwon-Woo [1 ]
Jeong, Jin-Woo [1 ]
机构
[1] Kumoh Natl Inst Technol, Dept Comp Engn, Gumi 39177, South Korea
基金
新加坡国家研究基金会;
关键词
brain-computer interface (BCI); capsule network; deep learning; electroencephalogram (EEG); motor imagery classification; BRAIN-COMPUTER INTERFACES; SINGLE-TRIAL EEG;
D O I
10.3390/s19132854
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Various convolutional neural network (CNN)-based approaches have been recently proposed to improve the performance of motor imagery based-brain-computer interfaces (BCIs). However, the classification accuracy of CNNs is compromised when target data are distorted. Specifically for motor imagery electroencephalogram (EEG), the measured signals, even from the same person, are not consistent and can be significantly distorted. To overcome these limitations, we propose to apply a capsule network (CapsNet) for learning various properties of EEG signals, thereby achieving better and more robust performance than previous CNN methods. The proposed CapsNet-based framework classifies the two-class motor imagery, namely right-hand and left-hand movements. The motor imagery EEG signals are first transformed into 2D images using the short-time Fourier transform (STFT) algorithm and then used for training and testing the capsule network. The performance of the proposed framework was evaluated on the BCI competition IV 2b dataset. The proposed framework outperformed state-of-the-art CNN-based methods and various conventional machine learning approaches. The experimental results demonstrate the feasibility of the proposed approach for classification of motor imagery EEG signals.
引用
收藏
页数:20
相关论文
共 44 条
[31]  
Pedregosa F, 2011, J MACH LEARN RES, V12, P2825
[32]   EEG-based discrimination between imagination of right and left hand movement [J].
Pfurtscheller, G ;
Neuper, C ;
Flotzinger, D ;
Pregenzer, M .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1997, 103 (06) :642-651
[33]   Event-related EEG/MEG synchronization and desynchronization: basic principles [J].
Pfurtscheller, G ;
da Silva, FHL .
CLINICAL NEUROPHYSIOLOGY, 1999, 110 (11) :1842-1857
[34]   Optimal spatial filtering of single trial EEG during imagined hand movement [J].
Ramoser, H ;
Müller-Gerking, J ;
Pfurtscheller, G .
IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, 2000, 8 (04) :441-446
[35]  
Sabour S., 2017, ADV NEURAL INFORM PR, P3856
[36]   Deep Learning With Convolutional Neural Networks for EEG Decoding and Visualization [J].
Schirrmeister, Robin Tibor ;
Springenberg, Jost Tobias ;
Fiederer, Lukas Dominique Josef ;
Glasstetter, Martin ;
Eggensperger, Katharina ;
Tangermann, Michael ;
Hutter, Frank ;
Burgard, Wolfram ;
Ball, Tonio .
HUMAN BRAIN MAPPING, 2017, 38 (11) :5391-5420
[37]   Brain-Computer Interfaces in Medicine [J].
Shih, Jerry J. ;
Krusienski, Dean J. ;
Wolpaw, Jonathan R. .
MAYO CLINIC PROCEEDINGS, 2012, 87 (03) :268-279
[38]   An Analysis of Scale Invariance in Object Detection - SNIP [J].
Singh, Bharat ;
Davis, Larry S. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3578-3587
[39]   A novel deep learning approach for classification of EEG motor imagery signals [J].
Tabar, Yousef Rezaei ;
Halici, Ugur .
JOURNAL OF NEURAL ENGINEERING, 2017, 14 (01)
[40]  
Thomas J, 2017, IEEE SYS MAN CYBERN, P234, DOI 10.1109/SMC.2017.8122608