IRT-Estimated Reliability for Tests Containing Mixed Item Formats

被引:4
作者
Shu, Lianghua [1 ]
Schwarz, Richard D. [2 ]
机构
[1] CTB McGraw Hill, Res Dept, Monterey, CA 93940 USA
[2] Educ Testing Serv, Princeton, NJ 08541 USA
关键词
PARAMETER-ESTIMATION; COEFFICIENT; MODEL;
D O I
10.1111/jedm.12040
中图分类号
G44 [教育心理学];
学科分类号
0402 ; 040202 ;
摘要
As a global measure of precision, item response theory (IRT) estimated reliability is derived for four coefficients (Cronbach's , Feldt-Raju, stratified , and marginal reliability). Models with different underlying assumptions concerning test-part similarity are discussed. A detailed computational example is presented for the targeted coefficients. A comparison of the IRT model-derived coefficients is made and the impact of varying ability distributions is evaluated. The advantages of IRT-derived reliability coefficients for problems such as automated test form assembly and vertical scaling are discussed.
引用
收藏
页码:163 / 177
页数:15
相关论文
共 39 条
[21]  
Lawley D., 1943, P ROY SOC EDINB, V61, P273, DOI DOI 10.1017/S0080454100006282
[22]  
Lord FM., 1968, STAT THEORIES MENTAL
[23]   A GENERALIZED PARTIAL CREDIT MODEL - APPLICATION OF AN EM ALGORITHM [J].
MURAKI, E .
APPLIED PSYCHOLOGICAL MEASUREMENT, 1992, 16 (02) :159-176
[24]   Some reliability estimates for computerized adaptive tests [J].
Nicewander, WA ;
Thomasson, GL .
APPLIED PSYCHOLOGICAL MEASUREMENT, 1999, 23 (03) :239-247
[25]   COEFFICIENT ALPHA AND RELIABILITY OF COMPOSITE MEASUREMENTS [J].
NOVICK, MR ;
LEWIS, C .
PSYCHOMETRIKA, 1967, 32 (01) :1-1
[26]   ESTIMATING THE RELIABILITY OF A TEST CONTAINING MULTIPLE ITEM FORMATS [J].
QUALLS, AL .
APPLIED MEASUREMENT IN EDUCATION, 1995, 8 (02) :111-120
[27]   GENERALIZATION OF COEFFICIENT ALPHA [J].
RAJU, NS .
PSYCHOMETRIKA, 1977, 42 (04) :549-565
[28]   Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma [J].
Revelle, William ;
Zinbarg, Richard E. .
PSYCHOMETRIKA, 2009, 74 (01) :145-154
[29]  
Samejima F., 1977, APPL PSYCH MEAS, V1, P233, DOI [10.1177/014662167700100209, DOI 10.1177/014662167700100209]
[30]  
Shu L., 2009, INT M PSYCH SOC