Item parameter estimation under conditions of test speededness: Application of a mixture Rasch model with ordinal constraints

被引:136
作者
Bolt, DM
Cohen, AS
Wollack, JA
机构
[1] Univ Wisconsin, Dept Educ Psychol, Madison, WI 53706 USA
[2] Univ Wisconsin, Testing & Evaluat Serv, Madison, WI 53706 USA
关键词
D O I
10.1111/j.1745-3984.2002.tb01146.x
中图分类号
G44 [教育心理学];
学科分类号
0402 ; 040202 ;
摘要
When tests are administered under fixed time constraints, test performances can be affected by speededness. Among other consequences, speededness can result in inaccurate parameter estimates in item response theory (IRT) models, especially for items located near the end of tests (Oshima, 1994). This article presents an IRT strategy for reducing contamination in item difficulty estimates due to speededness. Ordinal constraints are applied to a mixture Rasch model (Rost, 1990) so as to distinguish two latent classes of examinees: (a) a "speeded" class, comprised of examinees that had insufficient time to adequately answer end-of-test items, and (b) a "nonspeeded" class, comprised of examinees that had sufficient time to answer all items. The parameter estimates obtained for end-of-test items in the nonspeeded class are shown to more accurately approximate their difficulties when the items are administered at earlier locations on a different form of the test. A mixture model can also be used to estimate the class memberships of individual examinees. In this way, it can be determined whether membership in the speeded class is associated with other student characteristics. Results are reported for gender and ethnicity.
引用
收藏
页码:331 / 348
页数:18
相关论文
共 35 条
[1]  
[Anonymous], APPL STAT, DOI DOI 10.2307/2347565
[2]  
[Anonymous], 1997, HDB MODERN ITEM RESP
[3]   An investigation of the item parameter recovery characteristics of a Gibbs sampling procedure [J].
Baker, FB .
APPLIED PSYCHOLOGICAL MEASUREMENT, 1998, 22 (02) :153-169
[5]  
Bejar I. I., 1985, ETSRR8511
[6]   A mixture item response model for multiple-choice data [J].
Bolt, DM ;
Cohen, AS ;
Wollack, JA .
JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2001, 26 (04) :381-409
[7]   THE STANDARDIZATION APPROACH TO ASSESSING COMPREHENSIVE DIFFERENTIAL ITEM FUNCTIONING [J].
DORANS, NJ ;
SCHMITT, AP ;
BLEISTEIN, CA .
JOURNAL OF EDUCATIONAL MEASUREMENT, 1992, 29 (04) :309-319
[8]   Investigating local dependence with conditional covariance functions [J].
Douglas, J ;
Kim, HR ;
Habing, B ;
Gao, F .
JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 1998, 23 (02) :129-151
[9]   STUDY OF SPEEDEDNESS AS A SOURCE OF TEST BIAS [J].
EVANS, FR ;
REILLY, RR .
JOURNAL OF EDUCATIONAL MEASUREMENT, 1972, 9 (02) :123-&
[10]   LINEAR LOGISTIC TEST MODEL AS AN INSTRUMENT IN EDUCATIONAL RESEARCH [J].
FISCHER, GH .
ACTA PSYCHOLOGICA, 1973, 37 (06) :359-374