Increasing Peer Review Quality in Online Learning Systems

被引:2
作者
Luckner, Naemi [1 ]
Purgathofer, Peter [1 ]
Fitzpatrick, Geraldine [1 ]
机构
[1] Inst Visual Comp & Human Ctr Technol, Human Comp Interact Grp, Vienna, Austria
来源
4TH INTERNATIONAL CONFERENCE ON HIGHER EDUCATION ADVANCES (HEAD'18) | 2018年
关键词
Peer Review; Review Quality; Peer Feedback; Peer Evaluation;
D O I
10.4995/HEAd18.2018.7987
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Lecturers face an on-going struggle to keep up-to-date with their students' learning progress in large university courses. This hurts especially when it comes to identifying and supporting the diverse needs of each individual student. One way to approach this challenge is to introduce peer reviewing as a means to provide students with individual feedback throughout the semester. However, the quality of feedback written by peers can vary immensely and some students intentionally avoid putting work into writing reviews. We addressed these issues by calculating a Review Karma (RK), a value indicating how helpful students are in giving feedback to their colleagues and in helping them improve. While this approach shows much promise, especially in identifying different groups of students and enhancing their learning experience, we also identified trends that negatively impact the way students approach reviewing and provide their honest opinions of their colleagues work. The main contributions of this paper are the design of and lessons learned from the introduction of the RK and its initial evaluation via a survey.
引用
收藏
页码:321 / 328
页数:8
相关论文
共 19 条
[1]  
Basnet B, 2010, PROC FRONT EDUC CONF
[2]  
Bauer C, 2009, ITICSE 2009: PROCEEDING OF THE 2009 ACM SIGSE ANNUAL CONFERENCE ON INNOVATION AND TECHNOLOGY IN COMPUTER SCIENCE EDUCATION, P26, DOI 10.1145/1595496.1562892
[3]  
Farmer K, 2010, INTERTEMPORAL RESOURCE ECONOMICS, P1, DOI 10.1007/978-3-642-13229-2
[4]   Applying Peer Reviews in Software Engineering Education: An Experiment and Lessons Learned [J].
Garousi, Vahid .
IEEE TRANSACTIONS ON EDUCATION, 2010, 53 (02) :182-193
[5]   Improving the effectiveness of peer feedback for learning [J].
Gielen, Sarah ;
Peeters, Elien ;
Dochy, Filip ;
Onghena, Patrick ;
Struyven, Katrien .
LEARNING AND INSTRUCTION, 2010, 20 (04) :304-315
[6]   Framing Feedback: Choosing Review Environment Features that Support High Quality Peer Assessment [J].
Hicks, Catherine M. ;
Pandey, Vineet ;
Fraser, C. Ailie ;
Klemmer, Scott .
34TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2016, 2016, :458-469
[7]   Graders as Meta-Reviewers: Simultaneously Scaling and Improving Expert Evaluation for Large Online Classrooms [J].
Joyner, David A. ;
Ashby, Wade ;
Irish, Liam ;
Lam, Yeeling ;
Langston, Jacob ;
Lupiani, Isabel ;
Lustig, Mike ;
Pettoruto, Paige ;
Sheahen, Dana ;
Smiley, Angela ;
Bruckman, Amy ;
Goel, Ashok .
PROCEEDINGS OF THE THIRD (2016) ACM CONFERENCE ON LEARNING @ SCALE (L@S 2016), 2016, :399-408
[8]  
Kim S.M., 2006, P 2006 C EMPIRICAL M, P423, DOI DOI 10.3115/1610075.1610135
[9]  
Kulkarni C, 2015, UNDERST INNOV, P131, DOI 10.1007/978-3-319-06823-7_9
[10]  
Kulkarni NR, 2015, PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON POWER AND ADVANCED CONTROL ENGINEERING (ICPACE), P75, DOI 10.1109/ICPACE.2015.7274920