The effect of question order on evaluations of test performance: Can the bias dissolve?

被引:8
作者
Bard, Gabriele [1 ]
Weinstein, Yana [1 ]
机构
[1] Univ Massachusetts, Dept Psychol, Lowell, MA USA
关键词
Anchoring; Bias; Impression formation; Metacognition; CALIBRATION ACCURACY; EXPLANATORY STYLE; COMPREHENSION; ACHIEVEMENT;
D O I
10.1080/17470218.2016.1225108
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Question difficulty order has been shown to affect students' global postdictions of test performance. We attempted to eliminate the bias by letting participants experience the question order manipulation multiple times. In all three experiments, participants answered general knowledge questions and self-evaluated their performance. In Experiment 1, participants studied questions and answers in easyhard or hard-easy question order prior to taking a test in the same order. In Experiment 2, participants took the same test twice in the opposite question order (easy-hard then hard-easy, or hard-easy then easy-hard). In Experiment 3, participants took two different tests in the opposite question order (easy-hard then hard-easy, or hard-easy then easy-hard). In all three experiments, we were unable to eliminate the bias, which suggests that repeated exposure is insufficient to overcome a strong initial anchor.
引用
收藏
页码:2130 / 2140
页数:11
相关论文
共 26 条
[1]  
[Anonymous], EXPT PSYCHOL, DOI DOI 10.1037/0096-3445.125.4.387
[2]  
Bard G., 2016, HARD EASY IS N UNPUB
[3]   Self-Regulated Learning: Beliefs, Techniques, and Illusions [J].
Bjork, Robert A. ;
Dunlosky, John ;
Kornell, Nate .
ANNUAL REVIEW OF PSYCHOLOGY, VOL 64, 2013, 64 :417-+
[4]   OVERCONFIDENCE IN ESTIMATION - TESTING THE ANCHORING-AND-ADJUSTMENT HYPOTHESIS [J].
BLOCK, RA ;
HARPER, DR .
ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, 1991, 49 (02) :188-207
[5]   The influence of overt practice, achievement level, and explanatory style on calibration accuracy and performance [J].
Bol, L ;
Hacker, DJ ;
O'Shea, P ;
Allen, D .
JOURNAL OF EXPERIMENTAL EDUCATION, 2005, 73 (04) :269-290
[6]   A comparison of the effects of practice tests and traditional review on performance and calibration [J].
Bol, L ;
Hacker, DJ .
JOURNAL OF EXPERIMENTAL EDUCATION, 2001, 69 (02) :133-151
[7]   TEST STRUCTURE, HUMAN-CAPITAL, AND STUDENT PERFORMANCE ON ECONOMICS EXAMS [J].
CAUDILL, SB ;
GROPPER, DM .
JOURNAL OF ECONOMIC EDUCATION, 1991, 22 (04) :303-306
[8]  
Chapman G.B., 2002, Heuristics and Biases: The Psychology of Intuitive Judgment, P120
[9]   THE ILLUSION OF KNOWING - FAILURE IN THE SELF-ASSESSMENT OF COMPREHENSION [J].
GLENBERG, AM ;
WILKINSON, AC ;
EPSTEIN, W .
MEMORY & COGNITION, 1982, 10 (06) :597-602
[10]   CALIBRATION OF COMPREHENSION [J].
GLENBERG, AM ;
EPSTEIN, W .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 1985, 11 (04) :702-718