Advances in CD-CAT: The General Nonparametric Item Selection Method

被引:0
|
作者
Chia-Yi Chiu
Yuan-Pei Chang
机构
[1] Rutgers,
[2] The State University of New Jersey,undefined
来源
Psychometrika | 2021年 / 86卷
关键词
Cognitive diagnosis; General nonparametric classification method; Computerized adaptive testing; CD-CAT; Nonparametric item selection;
D O I
暂无
中图分类号
学科分类号
摘要
Computerized adaptive testing (CAT) is characterized by its high estimation efficiency and accuracy, in contrast to the traditional paper-and-pencil format. CAT specifically for cognitive diagnosis (CD-CAT) carries the same advantages and has been seen as a tool for advancing the use of cognitive diagnosis (CD) assessment for educational practice. A powerful item selection method is the key to the success of a CD-CAT program, and to date, various parametric item selection methods have been proposed and well-researched. However, these parametric methods all require large samples, to secure high-precision calibration of the items in the item bank. Thus, at present, implementation of parametric methods in small-scale educational settings, such as classroom, remains challenging. In response to this issue, Chang, Chiu, and Tsai (Appl Psychol Meas 43:543–561, 2019) proposed the nonparametric item selection (NPS) method that does not require parameter calibration and outperforms the parametric methods for settings with only small or no calibration samples. Nevertheless, the NPS method is not without limitations; extra assumptions are required to guarantee a consistent estimator of the attribute profiles when data conform to complex models. To remedy this shortcoming, the general nonparametric item selection (GNPS) method that incorporates the newly developed general NPC (GNPC) method (Chiu et al. in Psychometrika 83:355–375, 2018) as the classification vehicle is proposed in this study. The inclusion of the GNPC method in the GNPS method relaxes the assumptions imposed on the NPS method. As a result, the GNPS method can be used with any model or multiple models without abandoning the advantage of being a small-sample technique. The legitimacy of using the GNPS method in the CD-CAT system is supported by Theorem 1 proposed in the study. The efficiency and effectiveness of the GNPS method are confirmed by the simulation study that shows the outperformance of the GNPS method over the compared parametric methods when the calibration samples are small.
引用
收藏
页码:1039 / 1057
页数:18
相关论文
共 50 条
  • [31] Utilizing Response Time Distributions for Item Selection in CAT
    Fan, Zhewen
    Wang, Chun
    Chang, Hua-Hua
    Douglas, Jeffrey
    JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2012, 37 (05) : 655 - 670
  • [32] 基于称名反应模型的CD-CAT选题方法比较研究
    张杰
    罗照盛
    喻晓锋
    秦春影
    心理科学, 2023, 46 (06) : 1495 - 1503
  • [33] 可以兼顾策略、认知状态和能力的CD-CAT选题方法
    戴步云
    张敏强
    黎光明
    汪新光
    胡姗
    心理科学, 2018, 41 (02) : 459 - 465
  • [34] 基于理想作答反应构建的非参CD-CAT选题策略
    李俊杰
    马丽华
    曾平飞
    康春花
    心理科学, 2022, 45 (02) : 470 - 480
  • [35] 定长CD-CAT中两种新的题目曝光控制方法
    孙小坚
    毛秀珍
    宋乃庆
    辛涛
    心理科学, 2021, 44 (01) : 205 - 213
  • [36] Combining CAT with cognitive diagnosis: A weighted item selection approach
    Chun Wang
    Hua-Hua Chang
    Jeffery Douglas
    Behavior Research Methods, 2012, 44 : 95 - 109
  • [37] Combining CAT with cognitive diagnosis: A weighted item selection approach
    Wang, Chun
    Chang, Hua-Hua
    Douglas, Jeffery
    BEHAVIOR RESEARCH METHODS, 2012, 44 (01) : 95 - 109
  • [38] Two efficient selection methods for high-dimensional CD-CAT utilizing max-marginals factor from MAP query and ensemble learning approach
    Luo, Fen
    Wang, Xiaoqing
    Cai, Yan
    Tu, Dongbo
    BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2023, 76 (02) : 283 - 311
  • [39] 兼顾能力与知识状态的Higher-Order CD-CAT选题方法
    席崇钦
    涂冬波
    蔡艳
    江西师范大学学报(自然科学版), 2022, 46 (02) : 111 - 117
  • [40] 兼顾测验效率和题库使用率的CD-CAT选题策略
    汪文义
    丁树良
    宋丽红
    心理科学, 2014, 37 (01) : 212 - 216