State-of-the-Art Versus Deep Learning: A Comparative Study of Motor Imagery Decoding Techniques

被引:3
作者
George, Olawunmi [1 ]
Dabas, Sarthak [1 ]
Sikder, Abdur [1 ]
Smith, Roger O. [2 ]
Madiraju, Praveen [1 ]
Yahyasoltani, Nasim [1 ]
Ahamed, Sheikh Iqbal [1 ]
机构
[1] Marquette Univ, Comp Sci Dept, Milwaukee, WI 53233 USA
[2] Univ Wisconsin, Dept Rehabil Sci & Technol, Occupat Therapy Sci & Technol Program, Milwaukee, WI 53211 USA
关键词
Feature extraction; Support vector machines; Electroencephalography; Deep learning; Decoding; Convolutional neural networks; Transforms; EEG; BCI; motor imagery; deep learning; machine learning; BRAIN-COMPUTER INTERFACE; SIGNAL CLASSIFICATION; BCI; MEG;
D O I
10.1109/ACCESS.2022.3165197
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
State-of-the-art techniques (SOTA) for motor imagery decoding have largely involved the use of common spatial patterns (CSP) and power spectral density (PSD), for feature extraction. Other frequency transforms, such as wavelets and empirical mode decomposition (EMD) have also been used but the aforementioned two have been the most popular. For classification, linear discriminant analysis (LDA) and support vector machines (SVM) have been mostly used. It is, however, worth investigating other approaches, such as deep learning, which offer a potential for improvement, but are not yet mainstream. Deep learning techniques based on neural networks (NNs) have been underexplored in motor imagery processing. Considering their success in other fields, which speaks to their potential for obtaining improved results over the SOTA, they should be explored for motor imagery decoding. This study takes a comparative approach in the use of deep learning as compared with the SOTA. From our findings, we infer that neural networks are suitable for motor imagery decoding and might be preferable over the SOTA. The use of specific feature extraction is also not as necessary as seen with SOTA approaches, though it might offer some gains in performance. Our results show a statistically significant improvement in decoding accuracies, up to 20% increase, with the use of NNs as compared with the SOTA. Also, we conclude that the use of crops for data augmentation might yield better results with shallow architectures as against deeper ones and that there might be other factors affecting the effectiveness of crops, needing further investigation.
引用
收藏
页码:45605 / 45619
页数:15
相关论文
共 38 条
[1]  
Blankertz B., 2008, BCI COMPETITION 4
[2]   Exceeding chance level by chance: The caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy [J].
Combrisson, Etienne ;
Jerbi, Karim .
JOURNAL OF NEUROSCIENCE METHODS, 2015, 250 :126-136
[3]   An end-to-end deep learning approach to MI-EEG signal classification for BCIs [J].
Dose, Hauke ;
Moller, Jakob S. ;
Iversen, Helle K. ;
Puthusserypady, Sadasivan .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 114 :532-542
[4]   Towards correlation-based time window selection method for motor imagery BCIs [J].
Feng, Jiankui ;
Yin, Erwei ;
Jin, Jing ;
Saab, Rami ;
Daly, Ian ;
Wang, Xingyu ;
Hu, Dewen ;
Cichocki, Andrzej .
NEURAL NETWORKS, 2018, 102 :87-95
[5]   Motor Imagery: A Review of Existing Techniques, Challenges and Potentials [J].
George, Olawunmi ;
Smith, Roger ;
Madiraju, Praveen ;
Yahyasoltani, Nasim ;
Ahamed, Sheikh Iqbal .
2021 IEEE 45TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2021), 2021, :1893-1899
[6]   PhysioBank, PhysioToolkit, and PhysioNet - Components of a new research resource for complex physiologic signals [J].
Goldberger, AL ;
Amaral, LAN ;
Glass, L ;
Hausdorff, JM ;
Ivanov, PC ;
Mark, RG ;
Mietus, JE ;
Moody, GB ;
Peng, CK ;
Stanley, HE .
CIRCULATION, 2000, 101 (23) :E215-E220
[7]   MEG and EEG data analysis with MNE-Python']Python [J].
Gramfort, Alexandre ;
Luessi, Martin ;
Larson, Eric ;
Engemann, Denis A. ;
Strohmeier, Daniel ;
Brodbeck, Christian ;
Goj, Roman ;
Jas, Mainak ;
Brooks, Teon ;
Parkkonen, Lauri ;
Haemaelaeinen, Matti .
FRONTIERS IN NEUROSCIENCE, 2013, 7
[8]   Hangman BCI: An unsupervised adaptive self-paced Brain-Computer Interface for playing games [J].
Hasan, Bashar Awwad Shiekh ;
Gan, John Q. .
COMPUTERS IN BIOLOGY AND MEDICINE, 2012, 42 (05) :598-606
[9]   Autoreject: Automated artifact rejection for MEG and EEG data [J].
Jas, Mainak ;
Engemann, Denis A. ;
Bekhti, Yousra ;
Raimondo, Federico ;
Gramfort, Alexandre .
NEUROIMAGE, 2017, 159 :417-429
[10]   Correlation-based channel selection and regularized feature optimization for MI-based BCI [J].
Jin, Jing ;
Miao, Yangyang ;
Daly, Ian ;
Zuo, Cili ;
Hu, Dewen ;
Cichocki, Andrzej .
NEURAL NETWORKS, 2019, 118 :262-270