The super-learning hypothesis: Integrating learning processes across cortex, cerebellum and basal ganglia

被引:79
作者
Caligiore, Daniele [1 ]
Arbib, Michael A. [2 ]
Miall, R. Chris [3 ]
Baldassarre, Gianluca [1 ]
机构
[1] CNR, Inst Cognit Sci & Technol, Via San Martino della Battaglia 44, I-00185 Rome, Italy
[2] Univ Calif San Diego, Dept Psychol, La Jolla, CA 92093 USA
[3] Univ Birmingham, Sch Psychol, Birmingham B15 2TT, W Midlands, England
基金
美国国家科学基金会;
关键词
Cortex; Cerebellum; Basal ganglia; Unsupervised learning; Supervised learning; Reinforcement learning; Super-learning; Interplay between learning mechanisms; System-level neuroscience; Cortical-subcortical hierarchies; Neuromodulation; Dopamine; Serotonin; Noradrenaline; Acetylcholine; INTERNAL-MODELS; COMPUTATIONAL MODEL; PREFRONTAL CORTEX; SUBCORTICAL LOOPS; ADAPTIVE-CONTROL; ACTION SELECTION; SACCADIC GAIN; NEURAL MODEL; TOOL USE; MOTOR;
D O I
10.1016/j.neubiorev.2019.02.008
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Despite wide evidence suggesting anatomical and functional interactions between cortex, cerebellum and basal ganglia, the learning processes operating within them -often viewed as respectively unsupervised, supervised and reinforcement learning- are studied in isolation, neglecting their strong interdependence. We discuss how those brain areas form a highly integrated system combining different learning mechanisms into an effective super-learning process supporting the acquisition of flexible motor behaviour. The term "super-learning" does not indicate a new learning paradigm. Rather, it refers to the fact that different learning mechanisms act in synergy as they: (a) affect neural structures often relying on the widespread action of neuromodulators; (b) act within various stages of cortical/subcortical pathways that are organised in pipeline to support multiple sensation-toaction mappings operating at different levels of abstraction; (c) interact through the reciprocal influence of the output compartments of different brain structures, most notably in the cerebello-cortical and basal ganglia-cortical loops. Here we articulate this new hypothesis and discuss empirical evidence supporting it by specifically referring to motor adaptation and sequence learning.
引用
收藏
页码:19 / 34
页数:16
相关论文
共 223 条
[91]   QUINPIROLE-INDUCED SENSITIZATION TO NOISY/SPARSE PERIODIC INPUT: TEMPORAL SYNCHRONIZATION AS A COMPONENT OF OBSESSIVE-COMPULSIVE DISORDER [J].
Gu, B. M. ;
Cheng, R. K. ;
Yin, B. ;
Meck, W. H. .
NEUROSCIENCE, 2011, 179 :143-150
[92]   A computational model of action selection in the basal ganglia. I. A new functional anatomy [J].
Gurney, K ;
Prescott, TJ ;
Redgrave, P .
BIOLOGICAL CYBERNETICS, 2001, 84 (06) :401-410
[93]  
Haber SN, 2000, J NEUROSCI, V20, P2369
[94]   The primate basal ganglia: parallel and integrative networks [J].
Haber, SN .
JOURNAL OF CHEMICAL NEUROANATOMY, 2003, 26 (04) :317-330
[95]   Neural Modulation of Temporal Encoding, Maintenance, and Decision Processes [J].
Harrington, Deborah L. ;
Zimbelman, Janice L. ;
Hinton, Sean C. ;
Rao, Stephen M. .
CEREBRAL CORTEX, 2010, 20 (06) :1274-1285
[96]   NEUROMODULATION AND CORTICAL FUNCTION - MODELING THE PHYSIOLOGICAL-BASIS OF BEHAVIOR [J].
HASSELMO, ME .
BEHAVIOURAL BRAIN RESEARCH, 1995, 67 (01) :1-27
[97]   Learning robust cortico-cortical associations with the basal ganglia: An integrative review [J].
Helie, Sebastien ;
Ell, Shawn W. ;
Ashby, F. Gregory .
CORTEX, 2015, 64 :123-135
[98]   LEARNING OF SEQUENTIAL MOVEMENTS IN THE MONKEY - PROCESS OF LEARNING AND RETENTION OF MEMORY [J].
HIKOSAKA, O ;
RAND, MK ;
MIYACHI, S ;
MIYASHITA, K .
JOURNAL OF NEUROPHYSIOLOGY, 1995, 74 (04) :1652-1661
[99]  
HIKOSAKA O, 1993, EXP BRAIN RES, V95, P457
[100]   Central mechanisms of motor skill learning [J].
Hikosaka, O ;
Nakamura, K ;
Sakai, K ;
Nakahara, H .
CURRENT OPINION IN NEUROBIOLOGY, 2002, 12 (02) :217-222