Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition

被引:18
作者
Hou, Yimin [1 ]
Jia, Shuyue [2 ]
Lun, Xiangmin [1 ,3 ]
Zhang, Shu [4 ]
Chen, Tao [1 ]
Wang, Fang [1 ]
Lv, Jinglei [5 ]
机构
[1] Northeast Elect Power Univ, Sch Automat Engn, Jilin, Jilin, Peoples R China
[2] Northeast Elect Power Univ, Sch Comp Sci, Jilin, Jilin, Peoples R China
[3] Changchun Univ Sci & Technol, Coll Mech & Elect Engn, Changchun, Peoples R China
[4] Northwestern Polytech Univ, Sch Comp Sci, Xian, Peoples R China
[5] Univ Sydney, Sch Biomed Engn & Brain & Mind Ctr, Sydney, NSW, Australia
关键词
brain-computer interface (BCI); electroencephalography (EEG); motor imagery (MI); bidirectional long short-term memory (BiLSTM); graph convolutional neural network (GCN); INTERFACES; MOVEMENT; DESIGN; CUTS;
D O I
10.3389/fbioe.2021.706229
中图分类号
Q81 [生物工程学(生物技术)]; Q93 [微生物学];
学科分类号
071005 ; 0836 ; 090102 ; 100705 ;
摘要
Recognition accuracy and response time are both critically essential ahead of building the practical electroencephalography (EEG)-based brain-computer interface (BCI). However, recent approaches have compromised either the classification accuracy or the responding time. This paper presents a novel deep learning approach designed toward both remarkably accurate and responsive motor imagery (MI) recognition based on scalp EEG. Bidirectional long short-term memory (BiLSTM) with the attention mechanism is employed, and the graph convolutional neural network (GCN) promotes the decoding performance by cooperating with the topological structure of features, which are estimated from the overall data. Particularly, this method is trained and tested on the short EEG recording with only 0.4 s in length, and the result has shown effective and efficient prediction based on individual and groupwise training, with 98.81% and 94.64% accuracy, respectively, which outperformed all the state-of-the-art studies. The introduced deep feature mining approach can precisely recognize human motion intents from raw and almost-instant EEG signals, which paves the road to translate the EEG-based MI recognition to practical BCI systems.
引用
收藏
页数:11
相关论文
共 56 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   Multilevel Weighted Feature Fusion Using Convolutional Neural Networks for EEG Motor Imagery Classification [J].
Amin, Syed Umar ;
Alsulaiman, Mansour ;
Muhammad, Ghulam ;
Bencherif, Mohamed A. ;
Hossain, M. Shamim .
IEEE ACCESS, 2019, 7 :18940-18950
[3]  
[Anonymous], 2004, 21 INT C MACH LEARN
[4]  
Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
[5]   Restoring cortical control of functional movement in a human with quadriplegia [J].
Bouton, Chad E. ;
Shaikhouni, Ammar ;
Annetta, Nicholas V. ;
Bockbrader, Marcia A. ;
Friedenberg, David A. ;
Nielson, Dylan M. ;
Sharma, Gaurav ;
Sederberg, Per B. ;
Glenn, Bradley C. ;
Mysiw, W. Jerry ;
Morgan, Austin G. ;
Deogaonkar, Milind ;
Rezai, Ali R. .
NATURE, 2016, 533 (7602) :247-+
[6]  
Cho K., 2014, COMPUT SCI
[7]  
Chorowski J, 2015, ADV NEUR IN, V28
[8]   Brain-computer interfaces in neurological rehabilitation [J].
Daly, Janis J. ;
Wolpaw, Jonathan R. .
LANCET NEUROLOGY, 2008, 7 (11) :1032-1043
[9]  
Defferrard M, 2016, ADV NEUR IN, V29
[10]  
Dhillon IS, 2007, IEEE T PATTERN ANAL, V29, P1944, DOI 10.1109/TP'AMI.2007.1115