To weight or not to weight? Balancing influence of initial items in adaptive testing

被引:43
作者
Chang, Hua-Hua [1 ]
Ying, Zhiliang [2 ]
机构
[1] Univ Illinois, Urbana, IL 61801 USA
[2] Columbia Univ, New York, NY 10027 USA
基金
美国国家科学基金会;
关键词
computerized adaptive testing; MLE; Fisher information; a-stratified method; item selection algorithm;
D O I
10.1007/s11336-007-9047-7
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
It has been widely reported that in computerized adaptive testing some examinees may get much lower scores than they would normally if an alternative paper-and-pencil version were given. The main purpose of this investigation is to quantitatively reveal the cause for the underestimation phenomenon. The logistic models, including the 1PL, 2PL, and 3PL models, are used to demonstrate our assertions. Our analytical derivation shows that, under the maximum information item selection strategy, if an examinee failed a few items at the beginning of the test, easy but more discriminating items are likely to be administered. Such items are ineffective to move the estimate close to the true theta, unless the test is sufficiently long or a variable-length test is used. Our results also indicate that a certain weighting mechanism is necessary to make the algorithm rely less on the items administered at the beginning of the test.
引用
收藏
页码:441 / 450
页数:10
相关论文
共 7 条
[1]  
Carlson S., 2000, CHRON HIGHER EDUC, V47, pA47
[2]   A global information approach to computerized adoptive testing [J].
Chang, HH ;
Ying, ZL .
APPLIED PSYCHOLOGICAL MEASUREMENT, 1996, 20 (03) :213-229
[3]   a-stratified multistage computerized adaptive testing [J].
Chang, HH ;
Ying, ZL .
APPLIED PSYCHOLOGICAL MEASUREMENT, 1999, 23 (03) :211-222
[4]   Item selection in computerized adaptive testing: Should more discriminating items be used first? [J].
Hau, KT ;
Chang, HH .
JOURNAL OF EDUCATIONAL MEASUREMENT, 2001, 38 (03) :249-266
[5]  
Lord M.F., 1980, APPL ITEM RESPONSE T
[6]  
MERRITT J, 2003, BUSINESS WEEK 1229
[7]  
2004, GRE EXAM, P198