Motor Imagery Classification via Temporal Attention Cues of Graph Embedded EEG Signals

被引:133
作者
Zhang, Dalin [1 ]
Chen, Kaixuan [1 ]
Jian, Debao [1 ]
Yao, Lina [1 ]
机构
[1] Univ New South, Sch Comp Sci & Engn, Sydney, NSW 2052, Australia
关键词
Electroencephalography; Brain modeling; Synchronous motors; Deep learning; Task analysis; Feature extraction; Informatics; EEG; Motor Imagery; Deep Learning; CONVOLUTIONAL NEURAL-NETWORKS; BRAIN-COMPUTER INTERFACE; FEATURE-EXTRACTION; BCI; SELECTION; PATTERNS;
D O I
10.1109/JBHI.2020.2967128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Motor imagery classification from EEG signals is essential for motor rehabilitation with a Brain-Computer Interface (BCI). Most current works on this issue require a subject-specific adaptation step before applied to a new user. Thus the research of directly extending a pre-trained model to new users is particularly desired and indispensable. As brain dynamics fluctuate considerably across different subjects, it is challenging to design practical hand-crafted features based on prior knowledge. Regarding this gap, this paper proposes a Graph-based Convolutional Recurrent Attention Model (G-CRAM) to explore EEG features across different subjects for motor imagery classification. A graph structure is first developed to represent the positioning information of EEG nodes. Then a convolutional recurrent attention model learns EEG features from both spatial and temporal dimensions and emphasizes on the most distinguishable temporal periods. We evaluate the proposed approach on two benchmark EEG datasets of motor imagery classification on the subject-independent testing. The results show that the G-CRAM achieves superior performance to state-of-the-art methods regarding recognition accuracy and ROC-AUC. Furthermore, model interpretation studies reveal the learning process of different neural network components and demonstrate that the proposed model can extract detailed features efficiently.
引用
收藏
页码:2570 / 2579
页数:10
相关论文
共 55 条
[1]   Graph based anomaly detection and description: a survey [J].
Akoglu, Leman ;
Tong, Hanghang ;
Koutra, Danai .
DATA MINING AND KNOWLEDGE DISCOVERY, 2015, 29 (03) :626-688
[2]   Filter bank common spatial pattern algorithm on BCI competition IV Datasets 2a and 2b [J].
Ang, Kai Keng ;
Chin, Zheng Yang ;
Wang, Chuanchu ;
Guan, Cuntai ;
Zhang, Haihong .
FRONTIERS IN NEUROSCIENCE, 2012, 6
[3]  
Ang KK, 2008, IEEE IJCNN, P2390, DOI 10.1109/IJCNN.2008.4634130
[4]  
[Anonymous], 2016, Proceedings of the 4th International Conference on Learning Representations (ICLR)
[5]  
Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
[6]  
Bandanau D, 2016, INT CONF ACOUST SPEE, P4945, DOI 10.1109/ICASSP.2016.7472618
[7]   Current State and Future Prospects of EEG and fNIRS in Robot-Assisted Gait Rehabilitation: A Brief Review [J].
Berger, Alisa ;
Horst, Fabian ;
Mueller, Sophia ;
Steinberg, Fabian ;
Doppelmayr, Michael .
FRONTIERS IN HUMAN NEUROSCIENCE, 2019, 13
[8]  
Brunner C, 2008, TRANS DISTRIB CONF, P1342
[9]  
Chen KX, 2019, AAAI CONF ARTIF INTE, P3321
[10]  
Chengeta K, 2018, 2018 CONFERENCE ON INFORMATION COMMUNICATIONS TECHNOLOGY AND SOCIETY (ICTAS)