Decoding sensorimotor information from superior parietal lobule of macaque via Convolutional Neural Networks

被引:12
作者
Filippini, Matteo [1 ]
Borra, Davide [2 ]
Ursino, Mauro [2 ,3 ]
Magosso, Elisa [2 ,3 ]
Fattori, Patrizia [1 ,3 ]
机构
[1] Univ Bologna, Dept Biomed & Neuromotor Sci, Piazza Porta San Donato 2, I-40126 Bologna, Italy
[2] Univ Bologna, Dept Elect Elect & Informat Engn Guglielmo Marcon, Cesena Campus, Cesena, Italy
[3] Alma Mater Res Inst Human Ctr Artificial Intellig, Bologna, Italy
基金
欧盟地平线“2020”;
关键词
Neural decoding; Posterior parietal cortex; Convolutional neural network; Sensorymotor transformation; Brain-computer interfaces; Monkey; MEDIAL PARIETOOCCIPITAL CORTEX; CORTICAL AREA V6A; SIGNALS; REPRESENTATIONS; DIRECTION; DEPTH; REACH; INTENTION; SPACE;
D O I
10.1016/j.neunet.2022.03.044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite the well-recognized role of the posterior parietal cortex (PPC) in processing sensory information to guide action, the differential encoding properties of this dynamic processing, as operated by different PPC brain areas, are scarcely known. Within the monkey's PPC, the superior parietal lobule hosts areas V6A, PEc, and PE included in the dorso-medial visual stream that is specialized in planning and guiding reaching movements. Here, a Convolutional Neural Network (CNN) approach is used to investigate how the information is processed in these areas. We trained two macaque monkeys to perform a delayed reaching task towards 9 positions (distributed on 3 different depth and direction levels) in the 3D peripersonal space. The activity of single cells was recorded from V6A, PEc, PE and fed to convolutional neural networks that were designed and trained to exploit the temporal structure of neuronal activation patterns, to decode the target positions reached by the monkey. Bayesian Optimization was used to define the main CNN hyper-parameters. In addition to discrete positions in space, we used the same network architecture to decode plausible reaching trajectories. We found that data from the most caudal V6A and PEc areas outperformed PE area in the spatial position decoding. In all areas, decoding accuracies started to increase at the time the target to reach was instructed to the monkey, and reached a plateau at movement onset. The results support a dynamic encoding of the different phases and properties of the reaching movement differentially distributed over a network of interconnected areas. This study highlights the usefulness of neurons' firing rate decoding via CNNs to improve our understanding of how sensorimotor information is encoded in PPC to perform reaching movements. The obtained results may have implications in the perspective of novel neuroprosthetic devices based on the decoding of these rich signals for faithfully carrying out patient's intentions.(C) 2022 Published by Elsevier Ltd.
引用
收藏
页码:276 / 294
页数:19
相关论文
共 71 条
  • [1] Decoding motor imagery from the posterior parietal cortex of a tetraplegic human
    Aflalo, Tyson
    Kellis, Spencer
    Klaes, Christian
    Lee, Brian
    Shi, Ying
    Pejsa, Kelsie
    Shanfield, Kathleen
    Hayes-Jackson, Stephanie
    Aisen, Mindy
    Heck, Christi
    Liu, Charles
    Andersen, Richard A.
    [J]. SCIENCE, 2015, 348 (6237) : 906 - 910
  • [2] Toward More Versatile and Intuitive Cortical Brain-Machine Interfaces
    Andersen, Richard A.
    Kellis, Spencer
    Klaes, Christian
    Aflalo, Tyson
    [J]. CURRENT BIOLOGY, 2014, 24 (18) : R885 - R897
  • [3] Cognitive Neural Prosthetics
    Andersen, Richard A.
    Hwang, Eun Jung
    Mulliken, Grant H.
    [J]. ANNUAL REVIEW OF PSYCHOLOGY, 2010, 61 : 169 - 190
  • [4] Intention, Action Planning, and Decision Making in Parietal-Frontal Circuits
    Andersen, Richard A.
    Cui, He
    [J]. NEURON, 2009, 63 (05) : 568 - 583
  • [5] CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING
    BENJAMINI, Y
    HOCHBERG, Y
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) : 289 - 300
  • [6] Bergstra J., 2011, P 2011 ANN C NEURAL, V24, DOI DOI 10.5555/2986459.2986743
  • [7] A Lightweight Multi-Scale Convolutional Neural Network for P300 Decoding: Analysis of Training Strategies and Uncovering of Network Decision
    Borra, Davide
    Fantozzi, Silvia
    Magosso, Elisa
    [J]. FRONTIERS IN HUMAN NEUROSCIENCE, 2021, 15
  • [8] Interpretable and lightweight convolutional neural network for EEG decoding: Application to movement execution and imagination
    Borra, Davide
    Fantozzi, Silvia
    Magosso, Elisa
    [J]. NEURAL NETWORKS, 2020, 129 : 55 - 74
  • [9] Visual, somatosensory, and bimodal activities in the macaque parietal area PEc
    Breveglieri, Rossella
    Galletti, Claudio
    Monaco, Simona
    Fattori, Patrizia
    [J]. CEREBRAL CORTEX, 2008, 18 (04) : 806 - 816
  • [10] Eye Position Encoding in Three-Dimensional Space: Integration of Version and Vergence Signals in the Medial Posterior Parietal Cortex
    Breveglieri, Rossella
    Hadjidimitrakis, Kostas
    Bosco, Annalisa
    Sabatini, Silvio P.
    Galletti, Claudio
    Fattori, Patrizia
    [J]. JOURNAL OF NEUROSCIENCE, 2012, 32 (01) : 159 - 169