Attribute continuity in cognitive diagnosis models: impact on parameter estimation and its detection

被引：0
作者：
Ma W. [1 ]
Chen J. [2 ]
Jiang Z. [3 ]
机构：
[1] The University of Alabama, Box 870231, Tuscaloosa, 35487, AL
[2] The University of Hong Kong, Room 420, Meng Wah Complex, Pok Fu Lam
[3] Institute of Medical Education, Peking University, 38 Xueyuan Rd, Haidian District, Beijing
来源：
Behaviormetrika | 2023年 / 50卷 / 1期
关键词：
Binary attribute; Cognitive diagnosis; Continuity; Diagnostic classification; Model misspecification;
D O I：
10.1007/s41237-022-00174-y
中图分类号：
学科分类号：
摘要：
Most cognitive diagnosis models assume that skills or attributes are binary latent variables, which greatly simplifies the interpretation of model parameters. However, the assumption may be violated in practice, especially when some attributes are coarser-grained. This study investigates the impact of the violation of this assumption on parameter estimation and whether the violation can be detected empirically. Simulation study showed that when the binary attribute assumption was violated, item parameter estimates were biased but person classification may still be useful unless the conditions were very unfavorable. In addition, the univariate attribute mastery probability plot and a newly proposed uncertainty index may be used for detecting the violation of the binary attribute assumption when items were of moderate or high quality. © 2022, The Behaviormetric Society.
引用
收藏
页码：217 / 240
页数：23
相关论文
共 68 条
  • [1] Bolt D.M., Kim J.-S., Parameter invariance and skill attribute continuity in the Dina model, J Educ Meas, 55, pp. 264-280, (2018)
  • [2] Bradshaw L., Izsak A., Templin J., Jacobson E., Diagnosing teachers’ understandings of rational numbers: building a multidimensional test within the diagnostic classification framework, Educ Meas Issues Pract, 33, pp. 2-14, (2014)
  • [3] Modeling and generating random vectors with arbitrary marginal distributions and correlation matrix (Tech. Rep.), Department of Industrial Engineering and Management Sciences, (1997)
  • [4] Chalmers R.P., Partially and fully noncompensatory response models for dichotomous and polytomous items, Appl Psychol Meas, 44, 6, pp. 415-430, (2020)
  • [5] Chen H., Initialization for norta: generation of random vectors with specified marginals and correlations, INFORMS J Comput, 13, pp. 312-331, (2001)
  • [6] Chen J., A residual-based approach to validate Q-matrix specifications, Appl Psychol Meas, 41, pp. 277-293, (2017)
  • [7] Chen J., de la Torre J., A general cognitive diagnosis model for expert-defined polytomous attributes, Appl Psychol Meas, 37, pp. 419-437, (2013)
  • [8] Chen J., de la Torre J., Zhang Z., Relative and absolute fit evaluation in cognitive diagnosis modeling, J Educ Meas, 50, pp. 123-140, (2013)
  • [9] Chen Y., Culpepper S.A., Chen Y., Douglas J., Bayesian estimation of the DINA Q matrix, Psychometrika, 83, pp. 89-108, (2018)
  • [10] Chiu C.Y., Statistical refinement of the Q-matrix in cognitive diagnosis, Appl Psychol Meas, 37, pp. 598-618, (2013)
1234567