Controlling item exposure and test overlap in computerized adaptive testing

被引:22
作者
Chen, SY [1 ]
Lei, PW [1 ]
机构
[1] Natl Chung Cheng Univ, Dept Psychol, Chiayi 62107, Taiwan
关键词
Average between-test overlap; Computerized adaptive testing; Item exposure control; Item exposure rate; Test overlap rate; Test security;
D O I
10.1177/0146621604271495
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
This article proposes an item exposure control method, which is the extension of the Sympson and Hetter procedure and can provide item exposure control at both the item and test levels. Item exposure rate and test overlap rate are two indices commonly used to track item exposure in computerized adaptive tests. By considering both indices, item exposure can be monitored at both the item and test levels. To control the item exposure rate and test overlap rate simultaneously, the modified procedure attempted to control not only the maximum value but also the variance of item exposure rates. Results indicated that the item exposure rate and test overlap rate could be controlled simultaneously by implementing the modified procedure. Item exposure control was improved and precision of trait estimation decreased when a prespecified maximum test overlap rate was stringent.
引用
收藏
页码:204 / 217
页数:14
相关论文
共 12 条
[1]   a-stratified multistage computerized adaptive testing [J].
Chang, HH ;
Ying, ZL .
APPLIED PSYCHOLOGICAL MEASUREMENT, 1999, 23 (03) :211-222
[2]   A comparative study of item exposure control methods in computerized adaptive testing [J].
Chang, SW ;
Ansley, TN .
JOURNAL OF EDUCATIONAL MEASUREMENT, 2003, 40 (01) :71-103
[3]   Effects of practical constraints on item selection rules at the early stages of computerized adaptive testing [J].
Chen, SY ;
Ankenmann, RD .
JOURNAL OF EDUCATIONAL MEASUREMENT, 2004, 41 (02) :149-174
[4]   The relationship between item exposure and test overlap in computerized adaptive testing [J].
Chen, SY ;
Ankenmann, RD ;
Spray, JA .
JOURNAL OF EDUCATIONAL MEASUREMENT, 2003, 40 (02) :129-145
[5]  
Davey T., 1995, ANN M AM ED RES ASS
[6]  
Hetter R.D., 1997, COMPUTERIZED ADAPTIV, P141, DOI DOI 10.1037/10244-014
[7]  
McBride J.R., 1983, NEW HORIZONS TESTING, P223, DOI DOI 10.1016/B978-0-12-742780-5.50022-6
[8]   A comparison of item exposure control methods in computerized adaptive testing [J].
Revuelta, J ;
Ponsoda, V .
JOURNAL OF EDUCATIONAL MEASUREMENT, 1998, 35 (04) :311-327
[9]  
Stocking M. L., 2000, COMPUTERIZED ADAPTIV, P163
[10]   Controlling item exposure conditional on ability in computerized adaptive testing [J].
Stocking, ML ;
Lewis, C .
JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 1998, 23 (01) :57-75