Effects of rubric quality on marker variation in higher education

被引:3
作者
Chakraborty, Subrata [1 ]
Dann, Christopher [2 ]
Mandal, Anuradha [1 ]
Dann, Beverly [3 ]
Paul, Manoranjan [4 ]
Hafeez-Baig, Abdul [5 ]
机构
[1] Univ Technol Sydney, Fac Engn & IT, Ctr Adv Modelling & Geospatial Informat Syst CAMG, Sch Informat Syst & Modelling, Sydney, NSW, Australia
[2] Univ Southern Queensland, Sch Educ, Toowoomba, Qld, Australia
[3] Univ Sunshine Coast, Sch Educ, Sunshine Coast, Qld, Australia
[4] Charles Sturt Univ, Sch Comp & Math, Machine Vis & Digital Hlth MaViDH, Bathurst, NSW, Australia
[5] Univ Southern Queensland, Sch Business, Toowoomba, Qld, Australia
关键词
Higher education; Assessment bias; Marker bias reduction; Assessment reliability; Assessment validity; Rubric analysis; RELIABILITY; MARKING; FEEDBACK; VALIDITY;
D O I
10.1016/j.stueduc.2021.100997
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Variation among markers has the potential to disadvantage students by contributing to a discrepancy in assessments in higher education settings. In this study, we extended a previous study that analyzed first-year students' results in a Business Faculty within an Australian university to understand the extent of variation within and between multiple markers and across multiple courses. The study investigated the potential influence of quality of rubrics and associated documentation provided as marker guidance. Results indicated that specific features of rubrics, such as the inclusion of clear indicators of quality, had an observable effect on marker variation.
引用
收藏
页数:12
相关论文
共 72 条
[1]   A Closer Look at the Differences Between Graders in Introductory Computer Science Exams [J].
Albluwi, Ibrahim .
IEEE TRANSACTIONS ON EDUCATION, 2018, 61 (03) :253-260
[2]  
Allen Deborah, 2006, CBE Life Sci Educ, V5, P197, DOI 10.1187/cbe.06-06-0168
[3]  
Andrade H.G., 2005, College Teaching, V53, P27, DOI DOI 10.3200/CTCH.53.1.27-31
[4]  
[Anonymous], 2006, Innovative assessment in higher education
[5]  
[Anonymous], 2012, Measuring and Promoting of Teacher and Principal
[6]  
[Anonymous], 2001, Scoring Rubrics in the Classroom: Using Performance Criteria for Assessing and Improving Student Performance
[7]   Improving Students With Rubric-Based Self-Assessment and Oral Feedback [J].
Barney, Sebastian ;
Khurum, Mahvish ;
Petersen, Kai ;
Unterkalmsteiner, Michael ;
Jabangwe, Ronald .
IEEE TRANSACTIONS ON EDUCATION, 2012, 55 (03) :319-325
[8]  
Barrie S., 1999, P AARE NZARE C
[9]  
Biggs J., 2009, Teaching for quality learning at university: What the student does, V3rd
[10]   Improving marking reliability of scientific writing with the Developing Understanding of Assessment for Learning programme [J].
Bird, Fiona L. ;
Yucel, Robyn .
ASSESSMENT & EVALUATION IN HIGHER EDUCATION, 2013, 38 (05) :536-553