Effort and Valuation in the Brain: The Effects of Anticipation and Execution

被引:128
作者
Kurniawan, Irma T. [1 ,2 ]
Guitart-Masip, Marc [1 ]
Dayan, Peter [3 ]
Dolan, Raymond J. [1 ]
机构
[1] UCL, Wellcome Trust Ctr Neuroimaging, London WC1N 3BG, England
[2] UCL, Dept Cognit Perceptual & Brain Sci, London WC1E 6BT, England
[3] UCL, Gatsby Computat Neurosci Unit, London WC1N 3AR, England
基金
英国惠康基金;
关键词
TEMPORAL DIFFERENCE MODELS; PREDICTION ERRORS; DECISION-MAKING; 1.5; T; REWARD; STRIATUM; PUNISHMENT; DOPAMINE; HUMANS; AVOIDANCE;
D O I
10.1523/JNEUROSCI.4777-12.2013
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Neural representations of the effort deployed in performing actions, and the valence of the outcomes they yield, form the foundation of action choice. To discover whether brain areas represent effort and outcome valence together or if they represent one but not the other, we examined these variables in an explicitly orthogonal way. We did this by asking human subjects to exert one of two levels of effort to improve their chances of either winning or avoiding the loss of money. Subjects responded faster both when exerting greater effort and when exerting effort in anticipation of winning money. Using fMRI, we inspected BOLD responses during anticipation (before any action was executed) and when the outcome was delivered. In this way, we indexed BOLD signals associated with an anticipated need to exert effort and its affective consequences, as well as the effect of executed effort on the representation of outcomes. Anterior cingulate cortex and dorsal striatum (dorsal putamen) signaled the anticipation of effort independently of the prospect of winning or losing. Activity in ventral striatum (ventral putamen) was greater for better-than-expected outcomes compared with worse-than-expected outcomes, an effect attenuated in the context of having exerted greater effort. Our findings provide evidence that neural representations of anticipated actions are sensitive to the expected demands, but not to the expected value of their consequence, whereas representations of outcome value are discounted by exertion, commensurate with an integration of cost and benefit so as to approximate net value.
引用
收藏
页码:6160 / 6169
页数:10
相关论文
共 50 条
[1]  
[Anonymous], 1960, LEARNING THEORY BEHA, DOI DOI 10.1037/10802-000
[2]   How costs affect preferences: experiments on state dependence, hedonic state and within-trial contrast in starlings [J].
Aw, Justine M. ;
Vasconcelos, Marco ;
Kacelnik, Alex .
ANIMAL BEHAVIOUR, 2011, 81 (06) :1117-1128
[3]   Predictability modulates human brain response to reward [J].
Berns, GS ;
McClure, SM ;
Pagnoni, G ;
Montague, PR .
JOURNAL OF NEUROSCIENCE, 2001, 21 (08) :2793-2798
[4]   SPECIES-SPECIFIC DEFENSE REACTIONS AND AVOIDANCE LEARNING [J].
BOLLES, RC .
PSYCHOLOGICAL REVIEW, 1970, 77 (01) :32-48
[5]   Opponency Revisited: Competition and Cooperation Between Dopamine and Serotonin [J].
Boureau, Y-Lan ;
Dayan, Peter .
NEUROPSYCHOPHARMACOLOGY, 2011, 36 (01) :74-97
[6]   The dorsomedial striatum mediates flexible choice behavior in spatial tasks [J].
Braun, Stephanie ;
Hauber, Wolfgang .
BEHAVIOURAL BRAIN RESEARCH, 2011, 220 (02) :288-293
[7]   Work ethic in pigeons: Reward value is directly related to the effort or time required to obtain the reward [J].
Clement, TS ;
Feltus, JR ;
Kaiser, DN ;
Zentall, TR .
PSYCHONOMIC BULLETIN & REVIEW, 2000, 7 (01) :100-106
[8]   Serotonin and Dopamine: Unifying Affective, Activational, and Decision Functions [J].
Cools, Roshan ;
Nakamura, Kae ;
Daw, Nathaniel D. .
NEUROPSYCHOPHARMACOLOGY, 2011, 36 (01) :98-113
[9]   Reconciling the Role of Serotonin in Behavioral Inhibition and Aversion: Acute Tryptophan Depletion Abolishes Punishment-Induced Inhibition in Humans [J].
Crockett, Molly J. ;
Clark, Luke ;
Robbins, Trevor W. .
JOURNAL OF NEUROSCIENCE, 2009, 29 (38) :11993-11999
[10]   Effort-Based Cost-Benefit Valuation and the Human Brain [J].
Croxson, Paula L. ;
Walton, Mark E. ;
O'Reilly, Jill X. ;
Behrens, Timothy E. J. ;
Rushworth, Matthew F. S. .
JOURNAL OF NEUROSCIENCE, 2009, 29 (14) :4531-4541