Dissociable Neural Systems Support the Learning and Transfer of Hierarchical Control Structure

被引:6
作者
Eichenbaum, Adam [1 ]
Scimeca, Jason M. [1 ]
D'Esposito, Mark [1 ]
机构
[1] Univ Calif Berkeley, Helen Wills Neurosci Inst, Berkeley, CA 94720 USA
基金
美国国家卫生研究院;
关键词
fMRI; hierarchy; learning; learning to learn; reinforcement learning; transfer; COGNITIVE CONTROL; FRONTAL-CORTEX; ANTERIOR CINGULATE; BRAIN NETWORKS; TASK-SET; REGISTRATION; OSCILLATIONS; ARCHITECTURE; MECHANISMS; ACCURATE;
D O I
10.1523/JNEUROSCI.0847-20.2020
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Humans can draw insight from previous experiences to quickly adapt to novel environments that share a common underlying structure. Here we combine functional imaging and computational modeling to identify the neural systems that support the discovery and transfer of hierarchical task structure. Human subjects (male and female) completed multiple blocks of a reinforcement learning task that contained a global hierarchical structure governing stimulus-response action mapping. First, behavioral and computational evidence showed that humans successfully discover and transfer the hierarchical rule structure embedded within the task. Next, analysis of fMRI BOLD data revealed activity across a frontoparietal network that was specifically associated with the discovery of this embedded structure. Finally, activity throughout a cingulo-opercular network supported the transfer and implementation of this discovered structure. Together, these results reveal a division of labor in which dissociable neural systems support the learning and transfer of abstract control structures.
引用
收藏
页码:6624 / 6637
页数:14
相关论文
共 47 条
[1]  
Abdelmounaime Safia, 2013, ISRN Machine Vision, DOI 10.1155/2013/876386
[2]   Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain [J].
Avants, B. B. ;
Epstein, C. L. ;
Grossman, M. ;
Gee, J. C. .
MEDICAL IMAGE ANALYSIS, 2008, 12 (01) :26-41
[3]   Functional magnetic resonance imaging evidence for a hierarchical organization of the prefrontal cortex [J].
Badre, David ;
D'Esposito, Mark .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2007, 19 (12) :2082-2099
[4]   Frontal Cortex and the Hierarchical Control of Behavior [J].
Badre, David ;
Nee, Derek Evan .
TRENDS IN COGNITIVE SCIENCES, 2018, 22 (02) :170-188
[5]   Mechanisms of Hierarchical Reinforcement Learning in Cortico-Striatal Circuits 2: Evidence from fMRI [J].
Badre, David ;
Frank, Michael J. .
CEREBRAL CORTEX, 2012, 22 (03) :527-536
[6]   Frontal Cortex and the Discovery of Abstract Action Rules [J].
Badre, David ;
Kayser, Andrew S. ;
D'Esposito, Mark .
NEURON, 2010, 66 (02) :315-326
[7]   Hierarchical cognitive control deficits following damage to the human frontal lobe [J].
Badre, David ;
Hoffman, Joshua ;
Cooney, Jeffrey W. ;
D'Esposito, Mark .
NATURE NEUROSCIENCE, 2009, 12 (04) :515-522
[8]   Brain Plasticity Through the Life Span: Learning to Learn and Action Video Games [J].
Bavelier, Daphne ;
Green, C. Shawn ;
Pouget, Alexandre ;
Schrater, Paul .
ANNUAL REVIEW OF NEUROSCIENCE, VOL 35, 2012, 35 :391-416
[9]   Learning the value of information in an uncertain world [J].
Behrens, Timothy E. J. ;
Woolrich, Mark W. ;
Walton, Mark E. ;
Rushworth, Matthew F. S. .
NATURE NEUROSCIENCE, 2007, 10 (09) :1214-1221
[10]   Reinforcement Learning, Fast and Slow [J].
Botvinick, Matthew ;
Ritter, Sam ;
Wang, Jane X. ;
Kurth-Nelson, Zeb ;
Blundell, Charles ;
Hassabis, Demis .
TRENDS IN COGNITIVE SCIENCES, 2019, 23 (05) :408-422