You don't want to know what you're missing: When information about forgone rewards impedes dynamic decision making

被引:0
作者
Otto, A. Ross [1 ]
Love, Bradley C. [1 ]
机构
[1] Univ Texas Austin, Dept Psychol, Austin, TX 78712 USA
关键词
decision-making; delay of gratification; learning; self-control; dynamic environments; reinforcement learning; SELF-CONTROL; CHOICE; GRATIFICATION; DELAY; MELIORATION; EXPERIENCE; CHILDREN; SYSTEM;
D O I
暂无
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
When people learn to make decisions from experience, a reasonable intuition is that additional relevant information should improve their performance. In contrast, we find that additional information about foregone rewards (i.e., what could have gained at each point by making a different choice) severely hinders participants' ability to repeatedly make choices that maximize long-term gains. We conclude that foregone reward information accentuates the local superiority of short-term options (e.g., consumption) and consequently biases choice away from productive long-term options (e.g., exercise). These conclusions are consistent with a standard reinforcement-learning mechanism that processes information about experienced and forgone rewards. In contrast to related contributions using delay-of-gratification paradigms, we do not posit separate top-down and emotion-driven systems to explain performance. We find that individual and group data are well characterized by a single reinforcement-learning mechanism that combines information about experienced and foregone rewards.
引用
收藏
页码:1 / 10
页数:10
相关论文
共 23 条
[1]   Short-term memory traces for action bias in human reinforcement learning [J].
Bogacz, Rafal ;
McClure, Samuel M. ;
Li, Jian ;
Cohen, Jonathan D. ;
Montague, P. Read .
BRAIN RESEARCH, 2007, 1153 :111-121
[2]   How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action [J].
Boorman, Erie D. ;
Behrens, Timothy E. J. ;
Woolrich, Mark W. ;
Rushworth, Matthew F. S. .
NEURON, 2009, 62 (05) :733-743
[3]  
Busemeyer J., 2002, INT ENCY SOCIAL BEHA, V6, P3903, DOI [DOI 10.4135/9781412971980.N, 10.4135/9781412971980.n]
[4]   Experience-weighted attraction learning in normal form games [J].
Camerer, C ;
Ho, TH .
ECONOMETRICA, 1999, 67 (04) :827-874
[5]   The spread of obesity in a large social network over 32 years [J].
Christakis, Nicholas A. ;
Fowler, James H. .
NEW ENGLAND JOURNAL OF MEDICINE, 2007, 357 (04) :370-379
[6]   Cortical substrates for exploratory decisions in humans [J].
Daw, Nathaniel D. ;
O'Doherty, John P. ;
Dayan, Peter ;
Seymour, Ben ;
Dolan, Raymond J. .
NATURE, 2006, 441 (7095) :876-879
[7]   Adaptation as information restriction: The hot stove effect [J].
Denrell, J ;
March, JG .
ORGANIZATION SCIENCE, 2001, 12 (05) :523-538
[8]   Replicated alternatives and the role of confusion, chasing, and regret in decisions from experience [J].
Ert, Eyal ;
Erev, Ido .
JOURNAL OF BEHAVIORAL DECISION MAKING, 2007, 20 (03) :305-322
[9]   Foregone with the wind: Indirect payoff information and its implications for choice [J].
Grosskopf, Brit ;
Erev, Ido ;
Yechiam, Eldad .
INTERNATIONAL JOURNAL OF GAME THEORY, 2006, 34 (02) :285-302
[10]   Short-term gains, long-term pains: How cues about state aid learning in dynamic environments [J].
Gureckis, Todd M. ;
Love, Bradley C. .
COGNITION, 2009, 113 (03) :293-313