Perspective Reward signals in the cerebellum: Origins, targets, and functional implications

被引:58
作者
Kostadinov, Dimitar [1 ,2 ]
Hausser, Michael [1 ,2 ]
机构
[1] UCL, Wolfson Inst Biomed Res, London, England
[2] UCL, Dept Neurosci Physiol & Pharmacol, London, England
基金
英国惠康基金;
关键词
CLIMBING FIBER INPUT; PURKINJE-CELLS; BASAL GANGLIA; DOPAMINE NEURONS; PREDICTION ERROR; INTERNAL-MODELS; INFERIOR OLIVE; COMPLEX-SPIKE; PREFRONTAL CORTEX; EYE-MOVEMENTS;
D O I
10.1016/j.neuron.2022.02.015
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The cerebellum has long been proposed to play a role in cognitive function, although this has remained controversial. This idea has received renewed support with the recent discovery that signals associated with reward can be observed in the cerebellar circuitry, particularly in goal-directed learning tasks involving an interplay between the cerebellar cortex, basal ganglia, and cerebral cortex. Remarkably, a wide range of reward contingencies-including reward expectation, delivery, size, and omission-can be encoded by specific circuit elements in a manner that reflects the microzonal organization of the cerebellar cortex. The facts that reward signals have been observed in both the mossy fiber and climbing fiber input pathways to the cerebellar cortex and that their convergence may trigger plasticity in Purkinje cells suggest that these interactions may be crucial for the role of the cerebellar cortex in learned behavior. These findings strengthen the emerging consensus that the cerebellum plays a pivotal role in shaping cognitive processing and suggest that the cerebellum may combine both supervised learning and reinforcement learning to optimize goaldirected action. We make specific predictions about how cerebellar circuits can work in concert with the basal ganglia to guide different stages of learning.
引用
收藏
页码:1290 / 1303
页数:14
相关论文
共 135 条
[31]   Conversion of Graded Presynaptic Climbing Fiber Activity into Graded Postsynaptic Ca2+ Signals by Purkinje Cell Dendrites [J].
Gaffield, Michael A. ;
Bonnan, Audrey ;
Christie, Jason M. .
NEURON, 2019, 102 (04) :762-+
[32]   A cortico-cerebellar loop for motor planning [J].
Gao, Zhenyu ;
Davis, Courtney ;
Thomas, Alyse M. ;
Economo, Michael N. ;
Abrego, Amada M. ;
Svoboda, Karel ;
De Zeeuw, Chris I. ;
Li, Nuo .
NATURE, 2018, 563 (7729) :113-+
[33]   Excitatory Cerebellar Nucleocortical Circuit Provides Internal Amplification during Associative Conditioning [J].
Gao, Zhenyu ;
Proietti-Onori, Martina ;
Lin, Zhanmin ;
ten Brinke, Michiel M. ;
Boele, Henk-Jan ;
Potters, Jan-Willem ;
Ruigrok, Tom J. H. ;
Hoebeek, Freek E. ;
De Zeeuw, Chris I. .
NEURON, 2016, 89 (03) :645-657
[34]   Distributed synergistic plasticity and cerebellar learning [J].
Gao, Zhenyu ;
van Beugen, Boeke J. ;
De Zeeuw, Chris I. .
NATURE REVIEWS NEUROSCIENCE, 2012, 13 (09) :619-635
[35]   Active integration of glutamatergic input to the inferior olive generates bidirectional postsynaptic potentials [J].
Garden, Derek L. F. ;
Rinaldi, Arianna ;
Nolan, Matthew F. .
JOURNAL OF PHYSIOLOGY-LONDON, 2017, 595 (04) :1239-1251
[36]   PURKINJE-CELL ACTIVITY DURING MOTOR LEARNING [J].
GILBERT, PFC ;
THACH, WT .
BRAIN RESEARCH, 1977, 128 (02) :309-328
[37]   Cerebellar granule cells acquire a widespread predictive feedback signal during motor learning [J].
Giovannucci, Andrea ;
Badura, Aleksandra ;
Deverett, Ben ;
Najafi, Farzaneh ;
Pereira, Talmo D. ;
Gao, Zhenyu ;
Ozden, Ilker ;
Kloth, Alexander D. ;
Pnevmatikakis, Eftychios ;
Paninski, Liam ;
De Zeeuw, Chris I. ;
Medina, Javier F. ;
Wang, Samuel S-H .
NATURE NEUROSCIENCE, 2017, 20 (05) :727-+
[38]   Surprise Signals in Anterior Cingulate Cortex: Neuronal Encoding of Unsigned Reward Prediction Errors Driving Adjustment in Behavior [J].
Hayden, Benjamin Y. ;
Heilbronner, Sarah R. ;
Pearson, John M. ;
Platt, Michael L. .
JOURNAL OF NEUROSCIENCE, 2011, 31 (11) :4178-4187
[39]   Classical conditioning drives learned reward prediction signals in climbing fibers across the lateral cerebellum [J].
Heffley, William ;
Hull, Court .
ELIFE, 2019, 8
[40]   Coordinated cerebellar climbing fiber activity signals learned sensorimotor predictions [J].
Heffley, William ;
Song, Eun Young ;
Xu, Ziye ;
Taylor, Benjamin N. ;
Hughes, Mary Anne ;
McKinney, Andrew ;
Joshua, Mati ;
Hull, Court .
NATURE NEUROSCIENCE, 2018, 21 (10) :1431-+