Off the mark: Repetitive marking undermines essay evaluations due to boredom

被引:9
作者
Erturk, Sinan [1 ]
van Tilburg, Wijnand A. P. [2 ]
Igou, Eric R. [3 ]
机构
[1] Kings Coll London, Inst Psychiat Psychol & Neurosci, Psychol Dept, 16 De Crespigny Pk, London, England
[2] Univ Essex, Psychol Dept, Colchester, Essex, England
[3] Univ Limerick, Psychol Dept, Limerick, Ireland
关键词
Boredom; Negativity bias; Assessments; Marking; Education; Emotion; ASSESSING PROFESSIONAL COMPETENCE; JUDGMENT; MOOD; PATTERNS; CHOICE; BIAS;
D O I
10.1007/s11031-022-09929-2
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Essay-style assessment is widespread in education. Nonetheless, research shows that this tool can suffer from low reliability and validity. We attribute this problem partly to the boredom that marking multiple essays causes. Specifically, we propose that boredom in markers is associated with systematically lower marks on essays. To test this, we asked participants (N = 100) with an undergraduate degree to mark essays. The majority of these participants had at least some experience with marking. After marking each essay, participants indicated how bored they were. We found an increase in boredom over time and that higher boredom was associated with lower marks. Furthermore, offering a marking rubric did not prevent this problematic impact of boredom. These findings have implications for the validity of essays as an assessment tool and raise concerns about repetitive marking practices in general.
引用
收藏
页码:264 / 275
页数:12
相关论文
共 66 条
[1]   A COMPARISON OF THE INFORMATION PROVIDED BY ESSAY, MULTIPLE-CHOICE, AND FREE-RESPONSE WRITING TESTS [J].
ACKERMAN, TA ;
SMITH, PL .
APPLIED PSYCHOLOGICAL MEASUREMENT, 1988, 12 (02) :117-128
[2]   How good gets better and bad gets worse: Understanding the impact of affect on evaluations of known brands [J].
Adaval, R .
JOURNAL OF CONSUMER RESEARCH, 2003, 30 (03) :352-367
[3]  
Alfonso VC., 2018, Essentials of specific learning disability Identification, V2nd
[4]  
[Anonymous], 2013, IBM SPSS Statistics for Windows
[5]  
[Anonymous], 2005, A Review of the Literature on Marking Reliability
[6]  
Bell R.C., 1980, Assessment and Evaluation in Higher Education, V5, P254, DOI [10.1080/0260293800050303, DOI 10.1080/0260293800050303]
[7]  
Biggs J.B., 1988, Learning strategies and learning styles, P185
[8]   Patients don't come with multiple choice options: essay-based assessment in UME [J].
Bird, Jeffrey B. ;
Olvet, Doreen M. ;
Willey, Joanne M. ;
Brenner, Judith .
MEDICAL EDUCATION ONLINE, 2019, 24 (01)
[9]   Let's stop the pretence of consistent marking: exploring the multiple limitations of assessment criteria [J].
Bloxham, Sue ;
den-Outer, Birgit ;
Hudson, Jane ;
Price, Margaret .
ASSESSMENT & EVALUATION IN HIGHER EDUCATION, 2016, 41 (03) :466-481
[10]   Marking and moderation in the UK: false assumptions and wasted resources [J].
Bloxham, Sue .
ASSESSMENT & EVALUATION IN HIGHER EDUCATION, 2009, 34 (02) :209-220