Dissociable Neural Systems Support the Learning and Transfer of Hierarchical Control Structure

被引:6
作者
Eichenbaum, Adam [1 ]
Scimeca, Jason M. [1 ]
D'Esposito, Mark [1 ]
机构
[1] Univ Calif Berkeley, Helen Wills Neurosci Inst, Berkeley, CA 94720 USA
基金
美国国家卫生研究院;
关键词
fMRI; hierarchy; learning; learning to learn; reinforcement learning; transfer; COGNITIVE CONTROL; FRONTAL-CORTEX; ANTERIOR CINGULATE; BRAIN NETWORKS; TASK-SET; REGISTRATION; OSCILLATIONS; ARCHITECTURE; MECHANISMS; ACCURATE;
D O I
10.1523/JNEUROSCI.0847-20.2020
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Humans can draw insight from previous experiences to quickly adapt to novel environments that share a common underlying structure. Here we combine functional imaging and computational modeling to identify the neural systems that support the discovery and transfer of hierarchical task structure. Human subjects (male and female) completed multiple blocks of a reinforcement learning task that contained a global hierarchical structure governing stimulus-response action mapping. First, behavioral and computational evidence showed that humans successfully discover and transfer the hierarchical rule structure embedded within the task. Next, analysis of fMRI BOLD data revealed activity across a frontoparietal network that was specifically associated with the discovery of this embedded structure. Finally, activity throughout a cingulo-opercular network supported the transfer and implementation of this discovered structure. Together, these results reveal a division of labor in which dissociable neural systems support the learning and transfer of abstract control structures.
引用
收藏
页码:6624 / 6637
页数:14
相关论文
共 47 条
[21]  
Esteban O., 2018, poldracklab/fmriprep: 1.0.8
[22]   Mechanisms of Hierarchical Reinforcement Learning in Corticostriatal Circuits 1: Computational Analysis [J].
Frank, Michael J. ;
Badre, David .
CEREBRAL CORTEX, 2012, 22 (03) :509-526
[23]  
Gorgolewski Krzysztof, 2011, Front Neuroinform, V5, P13, DOI 10.3389/fninf.2011.00013
[24]   Accurate and robust brain image alignment using boundary-based registration [J].
Greve, Douglas N. ;
Fischl, Bruce .
NEUROIMAGE, 2009, 48 (01) :63-72
[25]   THE FORMATION OF LEARNING SETS [J].
HARLOW, HF .
PSYCHOLOGICAL REVIEW, 1949, 56 (01) :51-65
[26]   Forward inference using functional neuroimaging: dissociations versus associations [J].
Henson, R .
TRENDS IN COGNITIVE SCIENCES, 2006, 10 (02) :64-69
[27]   Improved optimization for the robust and accurate linear registration and motion correction of brain images [J].
Jenkinson, M ;
Bannister, P ;
Brady, M ;
Smith, S .
NEUROIMAGE, 2002, 17 (02) :825-841
[28]   Abstract Rule Learning: The Differential Effects of Lesions in Frontal Cortex [J].
Kayser, Andrew S. ;
D'Esposito, Mark .
CEREBRAL CORTEX, 2013, 23 (01) :230-240
[29]   Learning to Learn Causal Models [J].
Kemp, Charles ;
Goodman, Noah D. ;
Tenenbaum, Joshua B. .
COGNITIVE SCIENCE, 2010, 34 (07) :1185-1243
[30]   The architecture of cognitive control in the human prefrontal cortex [J].
Koechlin, E ;
Ody, C ;
Kouneiher, F .
SCIENCE, 2003, 302 (5648) :1181-1185