The Effect of Foregone Outcomes on Choices From Experience An Individual-Level Modeling Analysis

被引:18
作者
Yechiam, Eldad [1 ]
Rakow, Tim [2 ]
机构
[1] Technion Israel Inst Technol, Fac Ind Engn & Management, IL-32000 Haifa, Israel
[2] Univ Essex, Colchester CO4 3SQ, Essex, England
关键词
decision making; learning; counterfactual; forgone payoffs; cognitive modeling; reinforcement learning; repeated choice; LEARNING-MODELS; DECISION-MAKING; REGRET; INFORMATION; PERFORMANCE; CONSISTENCY; STRATEGIES; AVERSION; PAYOFFS; EVENTS;
D O I
10.1027/1618-3169/a000126
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
We examined the relative weight given to obtained and foregone outcomes (i.e., outcomes from the non-chosen options) in repeated choices using cognitive modeling. Previous modeling studies have yielded mixed results. When participants' choices are analyzed by models that predict the next choice ahead in a sequence of decisions, the results imply that people give less weight to foregone than to obtained outcomes. In contrast, in simulation models of n trials ahead, the results imply that, on average, people give equal weight to foregone and obtained outcomes. Using datasets of experience-based binary choices with fixed (stationary) payoff distributions (Erev & Haruvy, in press) and dynamic (nonstationary) payoff distributions (Rakow & Miler, 2009), we employed generalization tests at the individual level to examine whether the findings derived from the one-step-ahead method are due to overfitting. The results of trial-ahead model fitting implied that for the nonstationary tasks only, foregone outcomes received lower weight. However, when this dataset was assessed via generalization criteria at the individual level, equal weighting of foregone and obtained outcomes was the best assumption. This implies that overfitting is implicated in the superior fit of models that assume discounting of foregone outcomes.
引用
收藏
页码:55 / 67
页数:13
相关论文
共 36 条
[1]   Comparison of Decision Learning Models Using the Generalization Criterion Method [J].
Ahn, Woo-Young ;
Busemeyer, Jerome R. ;
Wagenmakers, Eric-Jan ;
Stout, Julie C. .
COGNITIVE SCIENCE, 2008, 32 (08) :1376-1402
[2]  
[Anonymous], 1959, INDIVIDUAL CHOICE BE
[3]  
[Anonymous], J EXPT PSYCHOL GEN
[4]  
Barron G, 2009, JUDGM DECIS MAK, V4, P447
[5]   Model comparisons and model selections based on generalization criterion methodology [J].
Busemeyer, JR ;
Wang, YM .
JOURNAL OF MATHEMATICAL PSYCHOLOGY, 2000, 44 (01) :171-189
[6]   AN ADAPTIVE APPROACH TO HUMAN DECISION-MAKING - LEARNING-THEORY, DECISION-THEORY, AND HUMAN-PERFORMANCE [J].
BUSEMEYER, JR ;
MYUNG, IJ .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 1992, 121 (02) :177-194
[7]   A contribution of cognitive decision models to clinical assessment: Decomposing performance on the bechara gambling task [J].
Busemeyer, JR ;
Stout, JC .
PSYCHOLOGICAL ASSESSMENT, 2002, 14 (03) :253-262
[8]   Experience-weighted attraction learning in normal form games [J].
Camerer, C ;
Ho, TH .
ECONOMETRICA, 1999, 67 (04) :827-874
[9]   When and why rare events are underweighted: A direct comparison of the sampling, partial feedback, full feedback and description choice paradigms [J].
Camilleri, Adrian R. ;
Newell, Ben R. .
PSYCHONOMIC BULLETIN & REVIEW, 2011, 18 (02) :377-384
[10]   On adaptation, maximization, and reinforcement learning among cognitive strategies [J].
Erev, I ;
Barron, G .
PSYCHOLOGICAL REVIEW, 2005, 112 (04) :912-931