Item Selection and Ability Estimation Procedures for a Mixed-Format Adaptive Test

被引:4
作者
Ho, Tsung-Han [1 ]
Dodd, Barbara G. [1 ]
机构
[1] Univ Texas Austin, Austin, TX 78712 USA
关键词
PARTIAL CREDIT MODEL; LIKELIHOOD-ESTIMATION; EXPOSURE; CRITERIA; STRATEGIES;
D O I
10.1080/08957347.2012.714686
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
In this study we compared five item selection procedures using three ability estimation methods in the context of a mixed-format adaptive test based on the generalized partial credit model. The item selection procedures used were maximum posterior weighted information, maximum expected information, maximum posterior weighted Kullback-Leibler information, and maximum expected posterior weighted Kullback-Leibler information procedures. The ability estimation methods investigated were maximum likelihood estimation (MLE), weighted likelihood estimation (WLE), and expected a posteriori (EAP). Results suggested that all item selection procedures, regardless of the information functions on which they were based, performed equally well across ability estimation methods. The principal conclusions drawn about the ability estimation methods are that MLE is a practical choice and WLE should be considered when there is a mismatch between pool information and the population ability distribution. EAP can serve as a viable alternative when an appropriate prior ability distribution is specified. Several implications of the findings for applied measurement are discussed.
引用
收藏
页码:305 / 326
页数:22
相关论文
共 45 条
[11]  
Chen WH, 1997, J EDUC BEHAV STAT, V22, P265, DOI 10.3102/10769986022003265
[12]   Estimation of trait level in computerized adaptive testing [J].
Cheng, PE ;
Liou, M .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2000, 24 (03) :257-265
[13]   Comparison of CAT Item Selection Criteria for Polytomous Items [J].
Choi, Seung W. ;
Swartz, Richard J. .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2009, 33 (06) :419-440
[14]   Strategies for controlling item exposure in computerized adaptive testing with the generalized partial credit model [J].
Davis, LL .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2004, 28 (03) :165-185
[15]   Item exposure constraints for testlets in the verbal reasoning section of the MCAT [J].
Davis, LL ;
Dodd, BG .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2003, 27 (05) :335-356
[16]   Computerized adaptive testing with the partial credit model: Estimation procedures, population distributions, and item pool characteristics [J].
Gorin, JS ;
Dodd, BG ;
Fitzpatrick, SJ ;
Shieh, YY .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2005, 29 (06) :433-456
[17]  
Ho T., 2009, ANN M NAT COUNC MEAS
[18]  
Hou L., 1996, ANN M AM ED RES ASS
[19]   ABILITY ESTIMATION FOR CONVENTIONAL TESTS [J].
KIM, JK ;
NICEWANDER, WA .
PSYCHOMETRIKA, 1993, 58 (04) :587-599
[20]  
Kingsbury G. G., 1989, Applied Measurement in Education, V2, P359, DOI DOI 10.1207/S15324818AME0204_6