Prospect theory analysis of guessing in multiple choice tests

被引:33
作者
Bereby-Meyer, Y
Meyer, J
Flascher, OM
机构
[1] Ben Gurion Univ Negev, Dept Educ, IL-84105 Beer Sheva, Israel
[2] Ben Gurion Univ Negev, Dept Ind Engn & Management, IL-84105 Beer Sheva, Israel
[3] Coll Holy Cross, Worcester, MA USA
关键词
multiple choice tests; framing effect; decision making; scoring rules;
D O I
10.1002/bdm.417
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
The guessing of answers in multiple choice tests adds random error to the variance of the test scores, lowering their reliability. Formula scoring rules that penalize for wrong guesses are frequently used to solve this problem. This paper uses prospect theory to analyze scoring rules from a decision-making perspective and focuses on the effects of framing on the tendency to guess. In three experiments participants were presented with hypothetical test situations and were asked to indicate the degree of certainty that they thought was required for them to answer a question. In accordance with the framing hypothesis, participants tended to guess more when they anticipated a low grade and therefore considered themselves to be in the loss domain, or when the scoring rule caused the situation to be framed as entailing potential losses. The last experiment replicated these results with a task that resembles an actual test. Copyright (C) 2002 John Wiley Sons, Ltd.
引用
收藏
页码:313 / 327
页数:15
相关论文
共 27 条
[1]   DOES GUESSING REALLY HELP [J].
ANGOFF, WH .
JOURNAL OF EDUCATIONAL MEASUREMENT, 1989, 26 (04) :323-336
[2]   THE EFFECTS OF RESOURCE DISTRIBUTION, VOICE, AND DECISION FRAMING ON THE PROVISION OF PUBLIC-GOODS [J].
AQUINO, K ;
STEISEL, V ;
KAY, A .
JOURNAL OF CONFLICT RESOLUTION, 1992, 36 (04) :665-687
[3]   A comparative study of measures of partial knowledge in multiple-choice tests [J].
BenSimon, A ;
Budescu, DV ;
Nevo, B .
APPLIED PSYCHOLOGICAL MEASUREMENT, 1997, 21 (01) :65-88
[5]   CHOICE BEHAVIOR IN SOCIAL DILEMMAS - EFFECTS OF SOCIAL IDENTITY, GROUP-SIZE, AND DECISION FRAMING [J].
BREWER, MB ;
KRAMER, RM .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 1986, 50 (03) :543-549
[6]   TO GUESS OR NOT TO GUESS - A DECISION-THEORETIC VIEW OF FORMULA SCORING [J].
BUDESCU, D ;
BARHILLEL, M .
JOURNAL OF EDUCATIONAL MEASUREMENT, 1993, 30 (04) :277-291
[7]   EMPIRICAL-TEST OF LORDS THEORETICAL RESULTS REGARDING FORMULA SCORING OF MULTIPLE-CHOICE TESTS [J].
CROSS, LH ;
FRARY, RB .
JOURNAL OF EDUCATIONAL MEASUREMENT, 1977, 14 (04) :313-321
[8]   CORRECTION FOR GUESSING [J].
DIAMOND, J ;
EVANS, W .
REVIEW OF EDUCATIONAL RESEARCH, 1973, 43 (02) :181-191
[9]  
Frary R.B., 1982, J ED STAT, V7, P333, DOI DOI 10.3102/10769986007004333
[10]   BAYES RULE AS A DESCRIPTIVE MODEL - THE REPRESENTATIVENESS HEURISTIC [J].
GRETHER, DM .
QUARTERLY JOURNAL OF ECONOMICS, 1980, 95 (03) :537-557