Motor Imagery EEG Classification Using Capsule Networks

被引:90
作者
Ha, Kwon-Woo [1 ]
Jeong, Jin-Woo [1 ]
机构
[1] Kumoh Natl Inst Technol, Dept Comp Engn, Gumi 39177, South Korea
基金
新加坡国家研究基金会;
关键词
brain-computer interface (BCI); capsule network; deep learning; electroencephalogram (EEG); motor imagery classification; BRAIN-COMPUTER INTERFACES; SINGLE-TRIAL EEG;
D O I
10.3390/s19132854
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Various convolutional neural network (CNN)-based approaches have been recently proposed to improve the performance of motor imagery based-brain-computer interfaces (BCIs). However, the classification accuracy of CNNs is compromised when target data are distorted. Specifically for motor imagery electroencephalogram (EEG), the measured signals, even from the same person, are not consistent and can be significantly distorted. To overcome these limitations, we propose to apply a capsule network (CapsNet) for learning various properties of EEG signals, thereby achieving better and more robust performance than previous CNN methods. The proposed CapsNet-based framework classifies the two-class motor imagery, namely right-hand and left-hand movements. The motor imagery EEG signals are first transformed into 2D images using the short-time Fourier transform (STFT) algorithm and then used for training and testing the capsule network. The performance of the proposed framework was evaluated on the BCI competition IV 2b dataset. The proposed framework outperformed state-of-the-art CNN-based methods and various conventional machine learning approaches. The experimental results demonstrate the feasibility of the proposed approach for classification of motor imagery EEG signals.
引用
收藏
页数:20
相关论文
共 44 条
[1]  
Ang KK, 2006, IEEE IJCNN, P742
[2]  
Ang KK, 2008, IEEE IJCNN, P2390, DOI 10.1109/IJCNN.2008.4634130
[3]  
[Anonymous], 2017, PROC IEEE C COMPUT V
[4]  
[Anonymous], PROC CVPR IEEE
[5]  
[Anonymous], FRONT NEUROSCI SWITZ
[6]  
[Anonymous], 2017, COMMUN ACM, DOI DOI 10.1145/3065386
[7]  
[Anonymous], P 2016 INT C LEARN R
[8]  
Bahdanau Dzmitry, 2015, 3 INT C LEARNING REP
[9]   CONVOLUTIONAL LONG-SHORT TERM MEMORY NETWORKS MODEL FOR LONG DURATION EEG SIGNAL CLASSIFICATION [J].
Baloglu, Ulas Baran ;
Yildirim, Ozal .
JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2019, 19 (01)
[10]   A spelling device for the paralysed [J].
Birbaumer, N ;
Ghanayim, N ;
Hinterberger, T ;
Iversen, I ;
Kotchoubey, B ;
Kübler, A ;
Perelmouter, J ;
Taub, E ;
Flor, H .
NATURE, 1999, 398 (6725) :297-298