Neural Computations Underlying Causal Structure Learning

被引:40
作者
Tomov, Momchil S. [1 ,2 ]
Dorfman, Hayley M.
Gershman, Samuel J.
机构
[1] Harvard Univ, Dept Psychol, 52 Oxford St,Room 295-06, Cambridge, MA 02138 USA
[2] Harvard Univ, Ctr Brain Sci, 52 Oxford St,Room 295-06, Cambridge, MA 02138 USA
基金
美国国家卫生研究院;
关键词
associative learning; Bayesian modeling; causal reasoning; context; fMRI; structure learning; ORBITOFRONTAL CORTEX; PREFRONTAL CORTEX; CONTEXT SPECIFICITY; LATENT INHIBITION; COGNITIVE CONTROL; REINFORCEMENT; EXTINCTION; MODEL; BRAIN; REPRESENTATIONS;
D O I
10.1523/JNEUROSCI.3336-17.2018
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Behavioral evidence suggests that beliefs about causal structure constrain associative learning, determining which stimuli can enter into association, as well as the functional form of that association. Bayesian learning theory provides one mechanism by which structural beliefs can be acquired from experience, but the neural basis of this mechanism is poorly understood. We studied this question with a combination of behavioral, computational, and neuroimaging techniques. Male and female human subjects learned to predict an outcome based on cue and context stimuli while being scanned using fMRI. Using a model-based analysis of the fMRI data, we show that structure learning signals are encoded in posterior parietal cortex, lateral prefrontal cortex, and the frontal pole. These structure learning signals are distinct from associative learning signals. Moreover, representational similarity analysis and information mapping revealed that the multivariate patterns of activity in posterior parietal cortex and anterior insula encode the full posterior distribution over causal structures. Variability in the encoding of the posterior across subjects predicted variability in their subsequent behavioral performance. These results provide evidence for a neural architecture in which structure learning guides the formation of associations.
引用
收藏
页码:7143 / 7157
页数:15
相关论文
共 74 条
[1]  
Alink A, 2015, BIORXIV, DOI DOI 10.1101/032391
[2]  
[Anonymous], 2016, Proc.Adv. Neural Inf. Process. Syst.
[3]   Functional magnetic resonance imaging evidence for a hierarchical organization of the prefrontal cortex [J].
Badre, David ;
D'Esposito, Mark .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2007, 19 (12) :2082-2099
[4]   Frontal Cortex and the Discovery of Abstract Action Rules [J].
Badre, David ;
Kayser, Andrew S. ;
D'Esposito, Mark .
NEURON, 2010, 66 (02) :315-326
[5]   CONTEXTUAL POTENTIATION OF ACQUIRED BEHAVIOR AFTER DEVALUING DIRECT CONTEXT-US ASSOCIATIONS [J].
BALAZ, MA ;
CAPRA, S ;
HARTL, P ;
MILLER, RR .
LEARNING AND MOTIVATION, 1981, 12 (04) :383-397
[6]   How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action [J].
Boorman, Erie D. ;
Behrens, Timothy E. J. ;
Woolrich, Mark W. ;
Rushworth, Matthew F. S. .
NEURON, 2009, 62 (05) :733-743
[7]   ANALYSIS OF THE ASSOCIATIVE AND OCCASION-SETTING PROPERTIES OF CONTEXTS PARTICIPATING IN A PAVLOVIAN DISCRIMINATION [J].
BOUTON, ME ;
SWARTZENTRUBER, D .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIOR PROCESSES, 1986, 12 (04) :333-350
[8]   CONTEXT EFFECTS ON CONDITIONING, EXTINCTION, AND REINSTATEMENT IN AN APPETITIVE CONDITIONING PREPARATION [J].
BOUTON, ME ;
PECK, CA .
ANIMAL LEARNING & BEHAVIOR, 1989, 17 (02) :188-198
[9]   CONTEXTUAL CONTROL OF THE EXTINCTION OF CONDITIONED FEAR - TESTS FOR THE ASSOCIATIVE VALUE OF THE CONTEXT [J].
BOUTON, ME ;
KING, DA .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIOR PROCESSES, 1983, 9 (03) :248-265
[10]  
Bouton ME, 1993, LEARN MOTIV, V10, P445