The super-learning hypothesis: Integrating learning processes across cortex, cerebellum and basal ganglia

被引:79
作者
Caligiore, Daniele [1 ]
Arbib, Michael A. [2 ]
Miall, R. Chris [3 ]
Baldassarre, Gianluca [1 ]
机构
[1] CNR, Inst Cognit Sci & Technol, Via San Martino della Battaglia 44, I-00185 Rome, Italy
[2] Univ Calif San Diego, Dept Psychol, La Jolla, CA 92093 USA
[3] Univ Birmingham, Sch Psychol, Birmingham B15 2TT, W Midlands, England
基金
美国国家科学基金会;
关键词
Cortex; Cerebellum; Basal ganglia; Unsupervised learning; Supervised learning; Reinforcement learning; Super-learning; Interplay between learning mechanisms; System-level neuroscience; Cortical-subcortical hierarchies; Neuromodulation; Dopamine; Serotonin; Noradrenaline; Acetylcholine; INTERNAL-MODELS; COMPUTATIONAL MODEL; PREFRONTAL CORTEX; SUBCORTICAL LOOPS; ADAPTIVE-CONTROL; ACTION SELECTION; SACCADIC GAIN; NEURAL MODEL; TOOL USE; MOTOR;
D O I
10.1016/j.neubiorev.2019.02.008
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Despite wide evidence suggesting anatomical and functional interactions between cortex, cerebellum and basal ganglia, the learning processes operating within them -often viewed as respectively unsupervised, supervised and reinforcement learning- are studied in isolation, neglecting their strong interdependence. We discuss how those brain areas form a highly integrated system combining different learning mechanisms into an effective super-learning process supporting the acquisition of flexible motor behaviour. The term "super-learning" does not indicate a new learning paradigm. Rather, it refers to the fact that different learning mechanisms act in synergy as they: (a) affect neural structures often relying on the widespread action of neuromodulators; (b) act within various stages of cortical/subcortical pathways that are organised in pipeline to support multiple sensation-toaction mappings operating at different levels of abstraction; (c) interact through the reciprocal influence of the output compartments of different brain structures, most notably in the cerebello-cortical and basal ganglia-cortical loops. Here we articulate this new hypothesis and discuss empirical evidence supporting it by specifically referring to motor adaptation and sequence learning.
引用
收藏
页码:19 / 34
页数:16
相关论文
共 223 条
[21]  
Baldassarre G., 2013, INTRINSICALLY MOTIVA
[22]   Information processing, dimensionality reduction and reinforcement learning in the basal ganglia [J].
Bar-Gad, I ;
Morris, G ;
Bergman, H .
PROGRESS IN NEUROBIOLOGY, 2003, 71 (06) :439-473
[23]   Consensus paper: Decoding the Contributions of the Cerebellum as a Time Machine. From Neurons to Clinical Applications [J].
Bares, Martin ;
Apps, Richard ;
Avanzino, Laura ;
Breska, Assaf ;
D'Angelo, Egidio ;
Filip, Pavel ;
Gerwig, Marcus ;
Ivry, Richard B. ;
Lawrenson, Charlotte L. ;
Louis, Elan D. ;
Lusk, Nicholas A. ;
Manto, Mario ;
Meck, Warren H. ;
Mitoma, Hiroshi ;
Petter, Elijah A. .
CEREBELLUM, 2019, 18 (02) :266-286
[24]   Cerebellar dentate nuclei lesions reduce motivation in appetitive operant conditioning and open field exploration [J].
Bauer, David J. ;
Kerr, Abigail L. ;
Swain, Rodney A. .
NEUROBIOLOGY OF LEARNING AND MEMORY, 2011, 95 (02) :166-175
[25]   Development of reaching in infancy [J].
Berthier, NE ;
Keen, R .
EXPERIMENTAL BRAIN RESEARCH, 2006, 169 (04) :507-518
[26]  
Blatt G.J., 2013, Handbook of the Cerebellum and Cerebellar Disorders, P479, DOI DOI 10.1007/978-94-007-1333-8_22
[27]   Learning to grasp and extract affordances: the Integrated Learning of Grasps and Affordances (ILGA) model [J].
Bonaiuto, James ;
Arbib, Michael A. .
BIOLOGICAL CYBERNETICS, 2015, 109 (06) :639-669
[28]   The role of the basal ganglia and cerebellum in language processing [J].
Booth, James R. ;
Wood, Lydia ;
Lu, Dong ;
Houk, James C. ;
Bitan, Tali .
BRAIN RESEARCH, 2007, 1133 (01) :136-144
[29]   The embodied mind extended: using words as social tools [J].
Borghi, Anna M. ;
Scorolli, Claudia ;
Caligiore, Daniele ;
Baldassarre, Gianluca ;
Tummolini, Luca .
FRONTIERS IN PSYCHOLOGY, 2013, 4
[30]   The basal ganglia and the cerebellum: nodes in an integrated network [J].
Bostan, Andreea C. ;
Strick, Peter L. .
NATURE REVIEWS NEUROSCIENCE, 2018, 19 (06) :338-350