Strategies for controlling item exposure in computerized adaptive testing with the generalized partial credit model

被引:11
作者
Davis, LL [1 ]
机构
[1] Pearson Educ Measurement, Austin, TX 78758 USA
关键词
CAT item selection; Computerized adaptive testing; Exposure control; Generalized partial credit model; Polytomous IRT;
D O I
10.1177/0146621604264133
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
Choosing a strategy for controlling item exposure has become an integral part of test development for computerized adaptive testing (CAT). This study investigated the performance of six procedures for controlling item exposure in a series of simulated CATs under the generalized partial credit model. In addition to a no-exposure control baseline condition, the randomesque, modified-within-.10-logits, Sympson-Hetter, conditional Sympson-Hetter, a-stratified with multiple-stratification, and enhanced a-stratified with multiple-stratification procedures were implemented to control exposure rates. Two variations of the randomesque and modified-within-.10-logits procedures were examined, which varied the size of the item group from which the next item to be administered was randomly selected. The results indicate that although the conditional Sympson-Hetter provides somewhat lower maximum exposure rates, the randomesque and modified-within-.10-logits procedures with the six-item group variation have great utility for controlling overlap rates and increasing pool utilization and should be given further consideration.
引用
收藏
页码:165 / 185
页数:21
相关论文
共 30 条
  • [1] BEJAR II, 1991, J APPL PSYCHOL, V76, P522
  • [2] BURSTEIN JC, 1998, ANN M NAT COUNC MEAS
  • [3] Burt W. M., 2003, ANN M AM ED RES ASS
  • [4] A global information approach to computerized adoptive testing
    Chang, HH
    Ying, ZL
    [J]. APPLIED PSYCHOLOGICAL MEASUREMENT, 1996, 20 (03) : 213 - 229
  • [5] a-stratified multistage computerized adaptive testing
    Chang, HH
    Ying, ZL
    [J]. APPLIED PSYCHOLOGICAL MEASUREMENT, 1999, 23 (03) : 211 - 222
  • [6] CHANG HH, 1999, IN PRESS A STRATIFIE
  • [7] CHEN S, 1998, EDUC PSYCHOL MEAS, V53, P61
  • [8] CHEN S, 1999, ANN M NAT COUNC MEAS
  • [9] Development of automated scoring algorithms for complex performance assessments: A comparison of two approaches
    Clauser, BE
    Margolis, MJ
    Clyman, SG
    Ross, LP
    [J]. JOURNAL OF EDUCATIONAL MEASUREMENT, 1997, 34 (02) : 141 - 161
  • [10] Davey T., 1998, ANN M NAT COUNC MEAS