Effort in Low-Stakes Assessments: What Does It Take to Perform as Well as in a High-Stakes Setting?

被引:23
作者
Attali, Yigal [1 ]
机构
[1] Educ Testing Serv, Rosedale Rd,MS-10-R, Princeton, NJ 08541 USA
关键词
low-stakes assessment; motivation; filtering; LOCALLY WEIGHTED REGRESSION; TEST MOTIVATION; INCENTIVES; CONSEQUENCE; PRESSURE; CHOKING; TIME;
D O I
10.1177/0013164416634789
中图分类号
G44 [教育心理学];
学科分类号
0402 ; 040202 ;
摘要
Performance of students in low-stakes testing situations has been a concern and focus of recent research. However, researchers who have examined the effect of stakes on performance have not been able to compare low-stakes performance to truly high-stakes performance of the same students. Results of such a comparison are reported in this article. GRE test takers volunteered to take an additional low-stakes test, of either verbal or quantitative reasoning as part of a research study immediately following their operational high-stakes test. Analyses of performance under the high- and low-stakes situations revealed that the level of effort in the low-stakes situation (as measured by the amount of time on task) strongly predicted the stakes effect on performance (difference between test scores in low- and high-stakes situations). Moreover, the stakes effect virtually disappeared for participants who spent at least one-third of the allotted time in the low-stakes situation. For this group of test takers (more than 80% of the total sample), the correlations between the low- and high-stakes scores approached the upper bound possible considering the reliability of the test.
引用
收藏
页码:1045 / 1058
页数:14
相关论文
共 25 条
[2]   Test motivation in the assessment of student skills: The effects of incentives on motivation and performance [J].
Baumert, J ;
Demmrich, A .
EUROPEAN JOURNAL OF PSYCHOLOGY OF EDUCATION, 2001, 16 (03) :441-462
[3]   On the fragility of skilled performance: What governs choking under pressure? [J].
Beilock, SL ;
Carr, TH .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2001, 130 (04) :701-725
[4]  
Braun H, 2011, TEACH COLL REC, V113, P2309
[5]   Effect of extra time on verbal and quantitative GRE scores [J].
Bridgeman, B ;
Cline, F ;
Hessinger, J .
APPLIED MEASUREMENT IN EDUCATION, 2004, 17 (01) :25-37
[6]   ROBUST LOCALLY WEIGHTED REGRESSION AND SMOOTHING SCATTERPLOTS [J].
CLEVELAND, WS .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1979, 74 (368) :829-836
[7]   LOCALLY WEIGHTED REGRESSION - AN APPROACH TO REGRESSION-ANALYSIS BY LOCAL FITTING [J].
CLEVELAND, WS ;
DEVLIN, SJ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1988, 83 (403) :596-610
[8]   A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation [J].
Deci, EL ;
Koestner, R ;
Ryan, RM .
PSYCHOLOGICAL BULLETIN, 1999, 125 (06) :627-668
[9]  
Educational Testing Service, 2008, GRE GUID US SCOR 200
[10]   Measuring Learning Outcomes in Higher Education: Motivation Matters [J].
Liu, Ou Lydia ;
Bridgeman, Brent ;
Adler, Rachel M. .
EDUCATIONAL RESEARCHER, 2012, 41 (09) :352-362