Construction and analysis of c-tests with rating-scale Rasch models

被引:8
作者
Eckes, Thomas [1 ]
机构
[1] Fern Univ Hagen, D-58085 Hagen, Germany
来源
DIAGNOSTICA | 2007年 / 53卷 / 02期
关键词
item response theory; Rasch model; rating scales; C-test; language testing;
D O I
10.1026/0012-1924.53.2.68
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
C-tests are written tests of general language proficiency. They consist of a small number of mutilated texts. Test-takers have to restore the original words in each text. In the present study, 476 examinees worked on 10 texts with 20 blanks each. Two polytomous Rasch models provided fine-grained analyses of these texts: (a) the discrete rating scale model (Andrich, 1978, 1982) and (b) the continuous rating scale model (Muller, 1987, 1999). Various model tests unanimously showed that 5 out of the 10 texts failed to satisfy strict psychometric requirements. The remaining texts, however, proved to be Rasch-homogeneous. They differentiated very well between examinee ability measures, with the test reliability being as high as .96. Taken together, the findings demonstrate that rating scale Rasch models are well-suited to constructing and evaluating C-tests in a sound and efficient way.
引用
收藏
页码:68 / 82
页数:15
相关论文
共 63 条
[11]   Evaluation of ratings: Psychometric quality assurance via many-facet Rasch measurement [J].
Eckes, T .
ZEITSCHRIFT FUR PSYCHOLOGIE-JOURNAL OF PSYCHOLOGY, 2005, 213 (02) :77-96
[12]   Rater agreement and rater severity: A many-faceted Rasch analysis of performance assessments in the "Test Deutsch als Fremdsprache" (TestDaF) [J].
Eckes, T .
DIAGNOSTICA, 2004, 50 (02) :65-77
[13]  
ECKES T, 2006, C TEST THEORIE EMPIR, pS167
[14]  
ECKES T, 2006, C TEST THEORIE EMPIR, pS1
[15]  
Embretson S. E., 2000, ITEM RESPONSE THEORY, Vxi, P371
[16]  
Europarat, 2021, GEMEINSAMER EUROPAIS
[17]  
Fischer GH, 1974, EINFUHRUNG THEORIE P
[18]  
GOBEL S, 1999, UBERPRUFUNG NEO FFI
[19]  
GROTJAHN R, 2002, C TEST THEORETISCHE, V4, pS211
[20]  
Grotjahn R., 1987, TAKING THEIR MEASURE, P219