Controlling item exposure and test overlap in computerized adaptive testing

被引:22
作者
Chen, SY [1 ]
Lei, PW [1 ]
机构
[1] Natl Chung Cheng Univ, Dept Psychol, Chiayi 62107, Taiwan
关键词
Average between-test overlap; Computerized adaptive testing; Item exposure control; Item exposure rate; Test overlap rate; Test security;
D O I
10.1177/0146621604271495
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
This article proposes an item exposure control method, which is the extension of the Sympson and Hetter procedure and can provide item exposure control at both the item and test levels. Item exposure rate and test overlap rate are two indices commonly used to track item exposure in computerized adaptive tests. By considering both indices, item exposure can be monitored at both the item and test levels. To control the item exposure rate and test overlap rate simultaneously, the modified procedure attempted to control not only the maximum value but also the variance of item exposure rates. Results indicated that the item exposure rate and test overlap rate could be controlled simultaneously by implementing the modified procedure. Item exposure control was improved and precision of trait estimation decreased when a prespecified maximum test overlap rate was stringent.
引用
收藏
页码:204 / 217
页数:14
相关论文
共 50 条
  • [41] Multi-Objective Optimization of Item Selection in Computerized Adaptive Testing
    Mujtaba, Dena F.
    Mahapatra, Nihar R.
    PROCEEDINGS OF THE 2021 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'21), 2021, : 1018 - 1026
  • [42] Item Response Theory and Computerized Adaptive Testing for Orthopaedic Outcomes Measures
    Brodke, Dane Jensen
    Hung, Man
    Bozic, Kevin J.
    JOURNAL OF THE AMERICAN ACADEMY OF ORTHOPAEDIC SURGEONS, 2016, 24 (11) : 750 - 754
  • [43] The Block Item Pocket Method for Reviewable Multidimensional Computerized Adaptive Testing
    Lin, Zhe
    Chen, Ping
    Xin, Tao
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2021, 45 (01) : 22 - 36
  • [44] Optimizing the Use of Response Times for Item Selection in Computerized Adaptive Testing
    Choe, Edison M.
    Kern, Justin L.
    Chang, Hua-Hua
    JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2018, 43 (02) : 135 - 158
  • [45] Direct and Inverse Problems of Item Pool Design for Computerized Adaptive Testing
    Belov, Dmitry I.
    Armstrong, Ronald D.
    EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2009, 69 (04) : 533 - 547
  • [46] A comparison of item selection rules at the early stages of computerized adaptive testing
    Chen, SY
    Ankenmann, RD
    Chang, HH
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2000, 24 (03) : 241 - 255
  • [47] Improving the Item Selection Process with Reinforcement Learning in Computerized Adaptive Testing
    Pian, Yang
    Chen, Penghe
    Lu, Yu
    Song, Guangchen
    Chen, Pengtao
    ARTIFICIAL INTELLIGENCE IN EDUCATION. POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS, DOCTORAL CONSORTIUM AND BLUE SKY, AIED 2023, 2023, 1831 : 230 - 235
  • [48] Optimal stratification of item pools in a-stratified computerized adaptive testing
    Chang, HH
    van der Linden, WJ
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2003, 27 (04) : 262 - 274
  • [49] Assembling a computerized adaptive testing item pool as a set of linear tests
    van der Linden, Wirn J.
    Ariel, Adelaide
    Veldkamp, Bernard P.
    JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2006, 31 (01) : 81 - 99
  • [50] New Item Selection Methods for Cognitive Diagnosis Computerized Adaptive Testing
    Kaplan, Mehmet
    de la Torre, Jimmy
    Ramon Barrada, Juan
    APPLIED PSYCHOLOGICAL MEASUREMENT, 2015, 39 (03) : 167 - 188