EFL classroom peer assessment: Training effects on rating and commenting

被引:47
作者
Saito, Hidetoshi [1 ]
机构
[1] Ibaraki Univ, Dept English, Coll Educ, Mito, Ibaraki 3108512, Japan
关键词
comments; effect sizes; peer assessment; rater training;
D O I
10.1177/0265532208094276
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
This study examined the effects of training on peer assessment and comments provided regarding oral presentations in EFL ( English as a Foreign Language) classrooms. In Study 1, both the treatment and control groups received instruction on skill aspects, but only the treatment group was given an additional 40-minute training on how to rate performances. The results of the correlation difference analyses show no significant differences between the treatment and control groups, but the three instructors are misfitting, presumably because the frame of reference is set by the majority of student data. In the second study, the treatment groups received long training. Again, there are no significant correlation differences between the treatment and control groups; however, all the instructors are not misfitting, which indicates that the frame of reference in the data improved in Study 2. Analyses of comments reveal that the treatment groups are superior in both quality and quantity of comments. Along with a meta-analytic summary, it is argued that peer assessment is a robust system in which instruction on skill aspects may suffice to achieve a certain level of correlation with the criterion variable (instructor), but training may enhance student comments and reduce misfitting raters.
引用
收藏
页码:553 / 581
页数:29
相关论文
共 44 条
[1]  
[Anonymous], 1991, EVALUATION RES ED, DOI DOI 10.1080/09500799109533306
[2]  
[Anonymous], STUDIES 2 LANGUAGE A
[3]  
[Anonymous], TESL CANADA J
[4]  
[Anonymous], 2002, PEER RESPONSE 2 LANG
[5]  
[Anonymous], 1988, STAT POWER ANAL BEHA
[6]  
[Anonymous], 1999, INT REV IND ORG PSYC
[7]  
[Anonymous], LANGUAGE TESTING
[8]  
Berg E. C., 1999, J SECOND LANG WRIT, V8, P225
[9]  
Black P., 1998, Assessment in Education, V5, P7, DOI DOI 10.1080/0969595980050102
[10]  
Cheng W., 2005, LANG TEST, V22, P93, DOI 10.1191/0265532205lt298oa