Temporal-spatial-frequency depth extraction of brain-computer interface based on mental tasks

With the help of brain-computer interface (BCI) systems, the electroencephalography (EEG) signals can be translated into control commands. It is rare to extract temporal-spatial-frequency features of the EEG signals at the same time by conventional deep neural networks. In this study, two types of series and parallel structures are proposed by combining convolutional neural network (CNN) and long short term memory (LSTM). The frequency and spatial features of EEG are extracted by CNN, and the temporal features are extracted by LSTM. The EEG signals of mental tasks with speech imagery are extracted and classified by these architectures. In addition, the proposed methods are further validated by the 2008 BCl competition IV-2a EEG data set, and its mental task is motor imagery. The series structure with compact CNN obtains the best results for two data sets. Compared with the algorithms of other literatures, our proposed method achieves the best result. Better classification results can be obtained by designing the well structured deep neural network. (C) 2020 Elsevier Ltd. All rights reserved.