Behavioral Modeling of Human Choices Reveals Dissociable Effects of Physical Effort and Temporal Delay on Reward Devaluation

被引:94
作者
Klein-Fluegge, Miriam C. [1 ,2 ,3 ]
Kennerley, Steven W. [1 ]
Saraiva, Ana C. [1 ]
Penny, Will D. [2 ]
Bestmann, Sven [1 ]
机构
[1] UCL, Sobell Dept Motor Neurosci & Movement Disorders, UCL Inst Neurol, London, England
[2] UCL, Wellcome Trust Ctr Neuroimaging, London, England
[3] Univ Oxford, Dept Expt Psychol, Oxford OX1 3UD, England
基金
英国惠康基金; 英国生物技术与生命科学研究理事会; 欧洲研究理事会;
关键词
NUCLEUS-ACCUMBENS DOPAMINE; ANTERIOR CINGULATE CORTEX; COST-BENEFIT-ANALYSIS; DECISION-MAKING; ORBITOFRONTAL CORTEX; PREFRONTAL CORTEX; IMPULSIVE CHOICE; PROSPECT-THEORY; SELF-CONTROL; PREFERENCE;
D O I
10.1371/journal.pcbi.1004116
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
There has been considerable interest from the fields of biology, economics, psychology, and ecology about how decision costs decrease the value of rewarding outcomes. For example, formal descriptions of how reward value changes with increasing temporal delays allow for quantifying individual decision preferences, as in animal species populating different habitats, or normal and clinical human populations. Strikingly, it remains largely unclear how humans evaluate rewards when these are tied to energetic costs, despite the surge of interest in the neural basis of effort-guided decision-making and the prevalence of disorders showing a diminished willingness to exert effort (e.g., depression). One common assumption is that effort discounts reward in a similar way to delay. Here we challenge this assumption by formally comparing competing hypotheses about effort and delay discounting. We used a design specifically optimized to compare discounting behavior for both effort and delay over a wide range of decision costs (Experiment 1). We then additionally characterized the profile of effort discounting free of model assumptions (Experiment 2). Contrary to previous reports, in both experiments effort costs devalued reward in a manner opposite to delay, with small devaluations for lower efforts, and progressively larger devaluations for higher effort-levels (concave shape). Bayesian model comparison confirmed that delay-choices were best predicted by a hyperbolic model, with the largest reward devaluations occurring at shorter delays. In contrast, an altogether different relationship was observed for effort-choices, which were best described by a model of inverse sigmoidal shape that is initially concave. Our results provide a novel characterization of human effort discounting behavior and its first dissociation from delay discounting. This enables accurate modelling of cost-benefit decisions, a prerequisite for the investigation of the neural underpinnings of effort-guided choice and for understanding the deficits in clinical disorders characterized by behavioral inactivity.
引用
收藏
页数:31
相关论文
共 102 条
  • [1] Reconciling introspective utility with revealed preference: Experimental arguments based on prospect theory
    Abdellaoui, Mohammed
    Barrios, Carolina
    Wakker, Peter P.
    [J]. JOURNAL OF ECONOMETRICS, 2007, 138 (01) : 356 - 378
  • [2] Delay and probability discounting in pathological gamblers with and without a history of substance use problems
    Andrade, Leonardo F.
    Petry, Nancy M.
    [J]. PSYCHOPHARMACOLOGY, 2012, 219 (02) : 491 - 499
  • [3] Rate currencies and the foraging starling: The fallacy of the averages revisited
    Bateson, M
    Kacelnik, A
    [J]. BEHAVIORAL ECOLOGY, 1996, 7 (03) : 341 - 352
  • [4] To walk or to fly? How birds choose among foraging modes
    Bautista, LM
    Tinbergen, J
    Kacelnik, A
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2001, 98 (03) : 1089 - 1094
  • [5] Learning the value of information in an uncertain world
    Behrens, Timothy E. J.
    Woolrich, Mark W.
    Walton, Mark E.
    Rushworth, Matthew F. S.
    [J]. NATURE NEUROSCIENCE, 2007, 10 (09) : 1214 - 1221
  • [6] Benzion U, 1989, DISCOUNT RATES INFER
  • [7] Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers
    Bickel, WK
    Odum, AL
    Madden, GJ
    [J]. PSYCHOPHARMACOLOGY, 1999, 146 (04) : 447 - 454
  • [8] Neural Integration of Risk and Effort Costs by the Frontal Pole: Only upon Request
    Burke, Christopher J.
    Brunger, Christian
    Kahnt, Thorsten
    Park, Soyoung Q.
    Tobler, Philippe N.
    [J]. JOURNAL OF NEUROSCIENCE, 2013, 33 (04) : 1706 - +
  • [9] Discounting in pigeons when the choice is between two delayed rewards: implications for species comparisons
    Calvert, Amanda L.
    Green, Leonard
    Myerson, Joel
    [J]. FRONTIERS IN NEUROSCIENCE, 2011, 5
  • [10] Individual laboratory-measured discount rates predict field behavior
    Chabris, Christopher F.
    Laibson, David
    Morris, Carrie L.
    Schuldt, Jonathon P.
    Taubinsky, Dmitry
    [J]. JOURNAL OF RISK AND UNCERTAINTY, 2008, 37 (2-3) : 237 - 269