Decoding kinetic features of hand motor preparation from single-trial EEG using convolutional neural networks

被引:7
|
作者
Gatti, Ramiro [1 ,2 ]
Atum, Yanina [2 ]
Schiaffino, Luciano [2 ]
Jochumsen, Mads [3 ]
Biurrun Manresa, Jose [1 ,2 ,4 ]
机构
[1] UNER, CONICET, Inst Res & Dev Bioengn & Bioinformat IBB, Route 11 Km 10, Oro Verde, Entre Rios, Argentina
[2] Natl Univ Entre Rios, Fac Engn, Lab Rehabil Engn & Neuromuscular & Sensor Res LIR, Oro Verde, Argentina
[3] Aalborg Univ, Ctr Sensory Motor Interact SMI, Aalborg, Denmark
[4] Aalborg Univ, Ctr Neuroplast & Pain CNAP, Aalborg, Denmark
基金
新加坡国家研究基金会;
关键词
brain computer interface; deep learning; movement prediction; multi-class classification; neural engineering; MOVEMENT-RELATED POTENTIALS; BRAIN-COMPUTER INTERFACES; CLASSIFICATION; SELECTION; INTENTION;
D O I
10.1111/ejn.14936
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Building accurate movement decoding models from brain signals is crucial for many biomedical applications. Predicting specific movement features, such as speed and force, before movement execution may provide additional useful information at the expense of increasing the complexity of the decoding problem. Recent attempts to predict movement speed and force from the electroencephalogram (EEG) achieved classification accuracies at or slightly above chance levels, highlighting the need for more accurate prediction strategies. Thus, the aims of this study were to accurately predict hand movement speed and force from single-trial EEG signals and to decode neurophysiological information of motor preparation from the prediction strategies. To these ends, a decoding model based on convolutional neural networks (ConvNets) was implemented and compared against other state-of-the-art prediction strategies, such as support vector machines and decision trees. ConvNets outperformed the other prediction strategies, achieving an overall accuracy of 84% in the classification of two different levels of speed and force (four-class classification) from pre-movement single-trial EEG (100 ms and up to 1,600 ms prior to movement execution). Furthermore, an analysis of the ConvNet architectures suggests that the network performs a complex spatiotemporal integration of EEG data to optimize classification accuracy. These results show that movement speed and force can be accurately predicted from single-trial EEG, and that the prediction strategies may provide useful neurophysiological information about motor preparation.
引用
收藏
页码:556 / 570
页数:15
相关论文
共 50 条
  • [1] Single-trial EEG classification of motor imagery using deep convolutional neural networks
    Tang, Zhichuan
    Li, Chao
    Sun, Shouqian
    OPTIK, 2017, 130 : 11 - 18
  • [2] Decoding Sequence Learning from Single-Trial Intracranial EEG in Humans
    De Lucia, Marzia
    Constantinescu, Irina
    Sterpenich, Virginie
    Pourtois, Gilles
    Seeck, Margitta
    Schwartz, Sophie
    PLOS ONE, 2011, 6 (12):
  • [3] Convolutional Neural Network for Target Face Detection using Single-trial EEG Signal
    Wang, Haofei
    Shi, Bertram E.
    Wang, Yiwen
    2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 2008 - 2011
  • [4] IFNet: An Interactive Frequency Convolutional Neural Network for Enhancing Motor Imagery Decoding From EEG
    Wang, Jiaheng
    Yao, Lin
    Wang, Yueming
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 1900 - 1911
  • [5] Decoding Multi-Class EEG Signals of Hand Movement Using Multivariate Empirical Mode Decomposition and Convolutional Neural Network
    Tao, Yi
    Xu, Weiwei
    Wang, Guangming
    Yuan, Ziwen
    Wang, Maode
    Houston, Michael
    Zhang, Yingchun
    Chen, Badong
    Yan, Xiangguo
    Wang, Gang
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2022, 30 : 2754 - 2763
  • [6] Assessment of Cognitive Engagement in Stroke Patients From Single-Trial EEG During Motor Rehabilitation
    Park, Wanjoo
    Kwon, Gyu Hyun
    Kim, Da-Hye
    Kim, Yun-Hee
    Kim, Sung-Phil
    Kim, Laehyun
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2015, 23 (03) : 351 - 362
  • [7] Convolutional neural networks for decoding electroencephalography responses and visualizing trial by trial changes in discriminant features
    Aellen, Florence M.
    Goktepe-Kavis, Pinar
    Apostolopoulos, Stefanos
    Tzovara, Athina
    JOURNAL OF NEUROSCIENCE METHODS, 2021, 364
  • [8] Decoding Color Visual Working Memory from EEG Signals Using Graph Convolutional Neural Networks
    Che, Xiaowei
    Zheng, Yuanjie
    Chen, Xin
    Song, Sutao
    Li, Shouxin
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2022, 32 (02)
  • [9] EEG Motor Execution Decoding via Interpretable Sinc-Convolutional Neural Networks
    Borra, Davide
    Fantozzi, Silvia
    Magosso, Elisa
    XV MEDITERRANEAN CONFERENCE ON MEDICAL AND BIOLOGICAL ENGINEERING AND COMPUTING - MEDICON 2019, 2020, 76 : 1113 - 1122
  • [10] Motor Imagery Analysis from Extensive EEG Data Representations Using Convolutional Neural Networks
    Lomelin-Ibarra, Vicente A.
    Gutierrez-Rodriguez, Andres E.
    Cantoral-Ceballos, Jose A.
    SENSORS, 2022, 22 (16)