Controlling item exposure and test overlap in computerized adaptive testing

被引:22
|
作者
Chen, SY [1 ]
Lei, PW [1 ]
机构
[1] Natl Chung Cheng Univ, Dept Psychol, Chiayi 62107, Taiwan
关键词
Average between-test overlap; Computerized adaptive testing; Item exposure control; Item exposure rate; Test overlap rate; Test security;
D O I
10.1177/0146621604271495
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
This article proposes an item exposure control method, which is the extension of the Sympson and Hetter procedure and can provide item exposure control at both the item and test levels. Item exposure rate and test overlap rate are two indices commonly used to track item exposure in computerized adaptive tests. By considering both indices, item exposure can be monitored at both the item and test levels. To control the item exposure rate and test overlap rate simultaneously, the modified procedure attempted to control not only the maximum value but also the variance of item exposure rates. Results indicated that the item exposure rate and test overlap rate could be controlled simultaneously by implementing the modified procedure. Item exposure control was improved and precision of trait estimation decreased when a prespecified maximum test overlap rate was stringent.
引用
收藏
页码:204 / 217
页数:14
相关论文
共 50 条
  • [21] A Dynamic Stratification Method for Improving Trait Estimation in Computerized Adaptive Testing Under Item Exposure Control
    Chen, Jyun-Hong
    Chao, Hsiu-Yi
    Chen, Shu-Ying
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2020, 44 (03) : 182 - 196
  • [22] Severity of organized item theft in computerized adaptive testing: A simulation study
    Yi, Qing
    Zhang, Jinming
    Chang, Hua-Hua
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2008, 32 (07) : 543 - 558
  • [23] Components of the item selection algorithm in computerized adaptive testing
    Han, Kyung Tyek
    JOURNAL OF EDUCATIONAL EVALUATION FOR HEALTH PROFESSIONS, 2018, 15 : 7
  • [24] Maximin criterion for item selection in computerized adaptive testing
    Jyun-Hong Chen
    Hsiu-Yi Chao
    Behavior Research Methods, 57 (7)
  • [25] A Comparability Approach to Item Reduction in Computerized Adaptive Testing
    Phuvipadawat, Swit
    Gulyanon, Warakorn
    Aimmanee, Pakinee
    Theeramunkong, Thanaruk
    2008 IEEE INTERNATIONAL CONFERENCE ON MANAGEMENT OF INNOVATION AND TECHNOLOGY, VOLS 1-3, 2008, : 1456 - 1460
  • [26] A COMPARISON OF ITEM CALIBRATION MEDIA IN COMPUTERIZED ADAPTIVE TESTING
    HETTER, RD
    SEGALL, DO
    BLOXOM, BM
    APPLIED PSYCHOLOGICAL MEASUREMENT, 1994, 18 (03) : 197 - 204
  • [27] Investigating item response times in computerized adaptive testing
    Hornke, LF
    DIAGNOSTICA, 1997, 43 (01): : 27 - 39
  • [28] Accounting for item calibration error in computerized adaptive testing
    Fink, Aron
    Koenig, Christoph
    Frey, Andreas
    BEHAVIOR RESEARCH METHODS, 2025, 57 (05)
  • [29] Computerized Adaptive Testing Using a Class of High-Order Item Response Theory Models
    Huang, Hung-Yu
    Chen, Po-Hsi
    Wang, Wen-Chung
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2012, 36 (08) : 689 - 706
  • [30] Binary Restrictive Threshold Method for Item Exposure Control in Cognitive Diagnostic Computerized Adaptive Testing
    Sun, Xiaojian
    Gao, Yizhu
    Xin, Tao
    Song, Naiqing
    FRONTIERS IN PSYCHOLOGY, 2021, 12