Motor Imagery Classification via Temporal Attention Cues of Graph Embedded EEG Signals

被引:133
作者
Zhang, Dalin [1 ]
Chen, Kaixuan [1 ]
Jian, Debao [1 ]
Yao, Lina [1 ]
机构
[1] Univ New South, Sch Comp Sci & Engn, Sydney, NSW 2052, Australia
关键词
Electroencephalography; Brain modeling; Synchronous motors; Deep learning; Task analysis; Feature extraction; Informatics; EEG; Motor Imagery; Deep Learning; CONVOLUTIONAL NEURAL-NETWORKS; BRAIN-COMPUTER INTERFACE; FEATURE-EXTRACTION; BCI; SELECTION; PATTERNS;
D O I
10.1109/JBHI.2020.2967128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Motor imagery classification from EEG signals is essential for motor rehabilitation with a Brain-Computer Interface (BCI). Most current works on this issue require a subject-specific adaptation step before applied to a new user. Thus the research of directly extending a pre-trained model to new users is particularly desired and indispensable. As brain dynamics fluctuate considerably across different subjects, it is challenging to design practical hand-crafted features based on prior knowledge. Regarding this gap, this paper proposes a Graph-based Convolutional Recurrent Attention Model (G-CRAM) to explore EEG features across different subjects for motor imagery classification. A graph structure is first developed to represent the positioning information of EEG nodes. Then a convolutional recurrent attention model learns EEG features from both spatial and temporal dimensions and emphasizes on the most distinguishable temporal periods. We evaluate the proposed approach on two benchmark EEG datasets of motor imagery classification on the subject-independent testing. The results show that the G-CRAM achieves superior performance to state-of-the-art methods regarding recognition accuracy and ROC-AUC. Furthermore, model interpretation studies reveal the learning process of different neural network components and demonstrate that the proposed model can extract detailed features efficiently.
引用
收藏
页码:2570 / 2579
页数:10
相关论文
共 55 条
[51]   A Convolutional Recurrent Attention Model for Subject-Independent EEG Signal Analysis [J].
Zhang, Dalin ;
Yao, Lina ;
Chen, Kaixuan ;
Monaghan, Jessica .
IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (05) :715-719
[52]   Ready for Use: Subject-Independent Movement Intention Recognition via a Convolutional Attention Model [J].
Zhang, Dalin ;
Yao, Lina ;
Chen, Kaixuan ;
Wang, Sen .
CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, :1763-1766
[53]   Fuzzy Integral Optimization with Deep Q-Network for EEG-Based Intention Recognition [J].
Zhang, Dalin ;
Yao, Lina ;
Wang, Sen ;
Chen, Kaixuan ;
Yang, Zheng ;
Benatallah, Boualem .
ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2018, PT I, 2018, 10937 :156-168
[54]   Learning Spatial-Spectral-Temporal EEG Features With Recurrent 3D Convolutional Neural Networks for Cross-Task Mental Workload Assessment [J].
Zhang, Pengbo ;
Wang, Xue ;
Zhang, Weihang ;
Chen, Junfeng .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2019, 27 (01) :31-42
[55]   Separated channel convolutional neural network to realize the training free motor imagery BCI systems [J].
Zhu, Xuyang ;
Li, Peiyang ;
Li, Cunbo ;
Yao, Dezhong ;
Zhang, Rui ;
Xu, Peng .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2019, 49 :396-403