IRT-Estimated Reliability for Tests Containing Mixed Item Formats

被引:4
作者
Shu, Lianghua [1 ]
Schwarz, Richard D. [2 ]
机构
[1] CTB McGraw Hill, Res Dept, Monterey, CA 93940 USA
[2] Educ Testing Serv, Princeton, NJ 08541 USA
关键词
PARAMETER-ESTIMATION; COEFFICIENT; MODEL;
D O I
10.1111/jedm.12040
中图分类号
G44 [教育心理学];
学科分类号
0402 ; 040202 ;
摘要
As a global measure of precision, item response theory (IRT) estimated reliability is derived for four coefficients (Cronbach's , Feldt-Raju, stratified , and marginal reliability). Models with different underlying assumptions concerning test-part similarity are discussed. A detailed computational example is presented for the targeted coefficients. A comparison of the IRT model-derived coefficients is made and the impact of varying ability distributions is evaluated. The advantages of IRT-derived reliability coefficients for problems such as automated test form assembly and vertical scaling are discussed.
引用
收藏
页码:163 / 177
页数:15
相关论文
共 39 条
[1]  
[Anonymous], 1972, The dependability of behavioural measurements: Theory of generalizability for scores and profiles
[2]  
[Anonymous], 2012, Applications of item response theory to practical testing problems
[3]  
[Anonymous], 1999, Measurement essentials
[4]   The information in multiple ratings [J].
Bock, RD ;
Brennan, RL ;
Muraki, E .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2002, 26 (04) :364-375
[5]   Generalizability in item response modeling [J].
Briggs, Derek C. ;
Wilson, Mark .
JOURNAL OF EDUCATIONAL MEASUREMENT, 2007, 44 (02) :131-155
[6]   SOME EXPERIMENTAL RESULTS IN THE CORRELATION OF MENTAL ABILITIES [J].
Brown, William .
BRITISH JOURNAL OF PSYCHOLOGY, 1910, 3 :296-322
[7]  
Cronbach L. J., 1965, EDUC PSYCHOL MEAS, V25, P191
[8]  
Cronbach LJ, 1951, PSYCHOMETRIKA, V16, P297
[9]   Parameter Estimation With Small Sample Size A Higher-Order IRT Model Approach [J].
de la Torre, Jimmy ;
Hong, Yuan .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2010, 34 (04) :267-285
[10]   Marginal true-score measures and reliability for binary items as a function of their IRT parameters [J].
Dimitrov, DM .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2003, 27 (06) :440-458