A deep CNN approach to decode motor preparation of upper limbs from time-frequency maps of EEG signals at source level

被引:114
作者
Mammone, Nadia [1 ]
Ieracitano, Cosimo [1 ]
Morabito, Francesco C. [1 ]
机构
[1] Univ Mediterranea Reggio Calabria, DICEAM, Via Graziella, I-89122 Reggio Di Calabria, Italy
关键词
Brain computer interface; Electroencephalography; Deep learning; Convolutional neural network; Time-frequency analysis; Beamforming; NEURAL-NETWORKS; BRAIN; CLASSIFICATION; IMAGERY; INTERFACES;
D O I
10.1016/j.neunet.2020.01.027
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A system that can detect the intention to move and decode the planned movement could help all those subjects that can plan motion but are unable to implement it. In this paper, motor planning activity is investigated by using electroencephalographic (EEG) signals with the aim to decode motor preparation phases. A publicly available database of 61-channels EEG signals recorded from 15 healthy subjects during the execution of different movements (elbow flexion/extension, forearm pronation/supination, hand open/close) of the right upper limb was employed to generate a dataset of EEG epochs preceding resting and movement's onset. A novel system is introduced for the classification of premovement vs resting and of premovement vs premovement epochs. For every epoch, the proposed system generates a time-frequency (TF) map of every source signal in the motor cortex, through beamforming and Continuous Wavelet Transform (CWT), then all the maps are embedded in a volume and used as input to a deep CNN. The proposed system succeeded in discriminating premovement from resting with an average accuracy of 90.3% (min 74.6%, max 100%), outperforming comparable methods in the literature, and in discriminating premovement vs premovement with an average accuracy of 62.47%. The achieved results encourage to investigate motor planning at source level in the time-frequency domain through deep learning approaches. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页码:357 / 372
页数:16
相关论文
共 64 条
[1]  
[Anonymous], 2017, 7TH INTERNATIONAL BC
[2]  
[Anonymous], 2005, Electric Fields of the Brain-The Neurophysics of EEG
[3]  
[Anonymous], 1992, Society for Industrial and Applied Mathematics
[4]  
[Anonymous], 2012, FRONTIERS NEUROENG
[5]  
[Anonymous], ADV NEURAL INFORM PR
[6]  
[Anonymous], 2015, C P IEEE ENG MED BIO
[7]  
[Anonymous], 2010, P 27 INT C MACH LEAR, DOI 10.5555/3104322.3104425
[8]   Electromagnetic brain mapping [J].
Baillet, S ;
Mosher, JC ;
Leahy, RM .
IEEE SIGNAL PROCESSING MAGAZINE, 2001, 18 (06) :14-30
[9]   Is EMG a Viable Alternative to BCI for Detecting Movement Intention in Severe Stroke? [J].
Balasubramanian, Sivakumar ;
Garcia-Cossio, Eliana ;
Birbaumer, Niels ;
Burdet, Etienne ;
Ramos-Murguialday, Ander .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2018, 65 (12) :2790-2797
[10]  
Bengio Yoshua, 2012, Neural Networks: Tricks of the Trade. Second Edition: LNCS 7700, P437, DOI 10.1007/978-3-642-35289-8_26