The super-learning hypothesis: Integrating learning processes across cortex, cerebellum and basal ganglia

被引:79
作者
Caligiore, Daniele [1 ]
Arbib, Michael A. [2 ]
Miall, R. Chris [3 ]
Baldassarre, Gianluca [1 ]
机构
[1] CNR, Inst Cognit Sci & Technol, Via San Martino della Battaglia 44, I-00185 Rome, Italy
[2] Univ Calif San Diego, Dept Psychol, La Jolla, CA 92093 USA
[3] Univ Birmingham, Sch Psychol, Birmingham B15 2TT, W Midlands, England
基金
美国国家科学基金会;
关键词
Cortex; Cerebellum; Basal ganglia; Unsupervised learning; Supervised learning; Reinforcement learning; Super-learning; Interplay between learning mechanisms; System-level neuroscience; Cortical-subcortical hierarchies; Neuromodulation; Dopamine; Serotonin; Noradrenaline; Acetylcholine; INTERNAL-MODELS; COMPUTATIONAL MODEL; PREFRONTAL CORTEX; SUBCORTICAL LOOPS; ADAPTIVE-CONTROL; ACTION SELECTION; SACCADIC GAIN; NEURAL MODEL; TOOL USE; MOTOR;
D O I
10.1016/j.neubiorev.2019.02.008
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Despite wide evidence suggesting anatomical and functional interactions between cortex, cerebellum and basal ganglia, the learning processes operating within them -often viewed as respectively unsupervised, supervised and reinforcement learning- are studied in isolation, neglecting their strong interdependence. We discuss how those brain areas form a highly integrated system combining different learning mechanisms into an effective super-learning process supporting the acquisition of flexible motor behaviour. The term "super-learning" does not indicate a new learning paradigm. Rather, it refers to the fact that different learning mechanisms act in synergy as they: (a) affect neural structures often relying on the widespread action of neuromodulators; (b) act within various stages of cortical/subcortical pathways that are organised in pipeline to support multiple sensation-toaction mappings operating at different levels of abstraction; (c) interact through the reciprocal influence of the output compartments of different brain structures, most notably in the cerebello-cortical and basal ganglia-cortical loops. Here we articulate this new hypothesis and discuss empirical evidence supporting it by specifically referring to motor adaptation and sequence learning.
引用
收藏
页码:19 / 34
页数:16
相关论文
共 223 条
[61]   What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? [J].
Doya, K .
NEURAL NETWORKS, 1999, 12 (7-8) :961-974
[62]   Complementary roles of basal ganglia and cerebellum in learning and motor control [J].
Doya, K .
CURRENT OPINION IN NEUROBIOLOGY, 2000, 10 (06) :732-739
[63]   Metalearning and neuromodulation [J].
Doya, K .
NEURAL NETWORKS, 2002, 15 (4-6) :495-506
[64]   Experience-dependent changes in cerebellar contributions to motor sequence learning [J].
Doyon, J ;
Song, AW ;
Karni, A ;
Lalonde, F ;
Adams, MM ;
Ungerleider, LG .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2002, 99 (02) :1017-1022
[65]   Distinct contribution of the cortico-striatal and cortico-cerebellar systems to motor skill learning [J].
Doyon, J ;
Penhune, V ;
Ungerleider, LG .
NEUROPSYCHOLOGIA, 2003, 41 (03) :252-262
[66]   Contributions of the basal ganglia and functionally related brain structures to motor learning [J].
Doyon, Julien ;
Bellec, Pierre ;
Amsel, Rhonda ;
Penhune, Virginia ;
Monchi, Oury ;
Carrier, Julie ;
Lehericy, Stephane ;
Benali, Habib .
BEHAVIOURAL BRAIN RESEARCH, 2009, 199 (01) :61-75
[67]   The basal ganglia: from motor commands to the control of vigor [J].
Dudman, Joshua T. ;
Krakauer, John W. .
CURRENT OPINION IN NEUROBIOLOGY, 2016, 37 :158-166
[68]  
Edelman G, 2001, ANN NY ACAD SCI, V929, P111
[69]   A Large-Scale Model of the Functioning Brain [J].
Eliasmith, Chris ;
Stewart, Terrence C. ;
Choo, Xuan ;
Bekolay, Trevor ;
DeWolf, Travis ;
Tang, Charlie ;
Rasmussen, Daniel .
SCIENCE, 2012, 338 (6111) :1202-1205
[70]   Modeling parietal-premotor interactions in primate control of grasping [J].
Fagg, AH ;
Arbib, MA .
NEURAL NETWORKS, 1998, 11 (7-8) :1277-1303