Human reversal learning under conditions of certain versus uncertain outcomes

被引:45
作者
D'Cruz, Anna-Maria [1 ,2 ]
Ragozzino, Michael E. [1 ,2 ]
Mosconi, Matthew W. [1 ]
Pavuluri, Mani N. [1 ,3 ]
Sweeney, John A. [1 ,2 ]
机构
[1] Ctr Cognit Med, Chicago, IL 60612 USA
[2] Dept Psychol, Chicago, IL 60607 USA
[3] Pediat Brain Res & Intervent Ctr, Chicago, IL 60608 USA
关键词
Reversal learning; Human; fMRI; Cognitive flexibility; Reinforcement learning; Reward processing; ANTERIOR CINGULATE CORTEX; FRONTAL EYE FIELDS; DECISION-MAKING; PREFRONTAL CORTEX; BEHAVIORAL FLEXIBILITY; ORBITOFRONTAL CORTEX; EXCITOTOXIC LESIONS; RESPONSE SELECTION; FUNCTIONAL MRI; REWARD;
D O I
10.1016/j.neuroimage.2011.01.068
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Reversal learning tasks assess behavioral flexibility by requiring subjects to switch from one learned response choice to a different response choice when task contingencies change. This requires both the processing of negative feedback once a learned response is no longer reinforced, and the capacity for flexible response selection. In 2-choice reversal learning tasks, subjects switch between only two responses. Multiple choice reversal learning is qualitatively different in that at reversal, it requires subjects to respond to non-reinforcement of a learned response by selecting a new response from among several alternatives that have uncertain consequences. While activity in brain regions responsible for processing unexpected negative feedback is known to increase in relation to the hedonic value of the reward itself, it is not known whether the uncertainty of reinforcement for future response choices also modulates these responses. In an fMRI study, 15 participants performed 2- and 4-choice reversal learning tasks. Upon reversal in both tasks, activation was observed in brain regions associated with processing changing reinforcement contingencies (midbrain, ventral striatum, insula), as well as in neocortical regions that support cognitive control and behavioral planning (prefrontal, premotor, posterior parietal, and anterior cingulate cortices). Activation in both systems was greater in the 4- than in the 2-choice task. Therefore, reinforcement uncertainty for future responses enhanced activity in brain systems that process performance feedback, as well as in areas supporting behavioral planning of future response choices. A mutually facilitative integration of responses in motivational and cognitive brain systems might enhance behavioral flexibility and decision making in conditions for which outcomes for future response choices are uncertain. (C) 2011 Elsevier Inc. All rights reserved.
引用
收藏
页码:315 / 322
页数:8
相关论文
共 55 条
[1]   Competition between learned reward and error outcome predictions in anterior cingulate cortex [J].
Alexander, William H. ;
Brown, Joshua W. .
NEUROIMAGE, 2010, 49 (04) :3210-3218
[2]   Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning [J].
Aron, AR ;
Shohamy, D ;
Clark, J ;
Myers, C ;
Gluck, MA ;
Poldrack, RA .
JOURNAL OF NEUROPHYSIOLOGY, 2004, 92 (02) :1144-1152
[3]   Which Way Do I Go? Neural Activation in Response to Feedback and Spatial Processing in a Virtual T-Maze [J].
Baker, Travis E. ;
Holroyd, Clay B. .
CEREBRAL CORTEX, 2009, 19 (08) :1708-1722
[4]   The role of the dorsal striatum in reward and decision-making [J].
Balleine, Bernard W. ;
Delgado, Mauricio R. ;
Hikosaka, Okihide .
JOURNAL OF NEUROSCIENCE, 2007, 27 (31) :8161-8165
[5]   Dissociable effects of selective 5-HT2A and 5-HT2C receptor antagonists on serial spatial reversal learning in rats [J].
Boulougouris, Vasileios ;
Glennon, Jeffrey C. ;
Robbins, Trevor W. .
NEUROPSYCHOPHARMACOLOGY, 2008, 33 (08) :2007-2019
[6]   Pre-surgical training ameliorates orbitofrontal-mediated impairments in spatial reversal learning [J].
Boulougouris, Vasileios ;
Robbins, Trevor W. .
BEHAVIOURAL BRAIN RESEARCH, 2009, 197 (02) :469-475
[7]   Neural correlates of response reversal: Considering acquisition [J].
Budhani, S. ;
Marsh, A. A. ;
Pine, D. S. ;
Blair, R. J. R. .
NEUROIMAGE, 2007, 34 (04) :1754-1765
[8]   The precuneus: a review of its functional anatomy and behavioural correlates [J].
Cavanna, AE ;
Trimble, MR .
BRAIN, 2006, 129 :564-583
[9]   Lesions of the Medial Striatum in Monkeys Produce Perseverative Impairments during Reversal Learning Similar to Those Produced by Lesions of the Orbitofrontal Cortex [J].
Clarke, Hannah F. ;
Robbins, Trevor W. ;
Roberts, Angela C. .
JOURNAL OF NEUROSCIENCE, 2008, 28 (43) :10972-10982
[10]   L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease [J].
Cools, Roshan ;
Lewis, Simon J. G. ;
Clark, Luke ;
Barker, Roger A. ;
Robbins, Trevor W. .
NEUROPSYCHOPHARMACOLOGY, 2007, 32 (01) :180-189