A Family of Generalized Diagnostic Classification Models for Multiple Choice Option-Based Scoring

被引:23
作者
DiBello, Louis V. [1 ]
Henson, Robert A. [2 ]
Stout, William F. [1 ,3 ]
机构
[1] Univ Illinois, Chicago, IL 60607 USA
[2] Univ N Carolina, Greensboro, NC 27412 USA
[3] Univ Illinois, Urbana, IL 61801 USA
基金
美国国家科学基金会;
关键词
diagnostic testing; latent class models; psychometric theory;
D O I
10.1177/0146621614561315
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
This article proposes a new family of diagnostic classification models (DCM) called the Generalized Diagnostic Classification Models for Multiple Choice Option-Based Scoring (GDCM-MC). The GDCM-MC is created for multiple choice assessments with response options designed to attract particular kinds of student thinking and understanding, both desired (correct) thinking and problematic (incorrect or partially correct) thinking. Key features that combine to distinguish GDCM-MC are: (a) an expanded latent space that can include both desirable and problematic facets of thinking, (b) an expanded Q matrix that includes a row for each response option and that uses a three-valued coding scheme to specify which latent states are strongly attracted to that option, (c) a guessing component that responds to the forced choice aspect of multiple choice questions, and (d) a general modeling framework that can incorporate the diagnostic modeling functionality of almost any dichotomous DCM, such as deterministic input, noisy ``and'' gate (DINA), reparameterized unified model (RUM), loglinear cognitive diagnosis model (LCDM), or general diagnostic model (GDM). The article discusses these four components and presents the GDCM-MC model equation as a mixture of cognitive and guessing components. Two identifiability theorems are presented. A Bayesian Markov Chain Monte Carlo (MCMC) model estimation algorithm is discussed, and real and simulated data studies are reported.
引用
收藏
页码:62 / 79
页数:18
相关论文
共 29 条
[21]  
Miller R.L., 2006, P AM SOC ENG ED ANN
[22]  
Minstrell J., 1992, Research in physics learning: Theoretical issues and empirical studies, P110
[23]  
Minstrell J., 2001, DESIGNING SCI IMPLIC, P369
[24]  
Pellegrino J.W., 2013, EVALUATING VALIDITY
[25]  
Pellegrino J. W., 2011, P RES ENG ED S MADR
[26]  
Roussos LA, 2007, COGNITIVE DIAGNOSTIC ASSESSMENT FOR EDUCATION: THEORY AND APPLICATIONS, P275, DOI 10.1017/CBO9780511611186.010
[27]   A statics concept inventory: Development and psychometric analysis [J].
Steif, PS ;
Dantzler, JA .
JOURNAL OF ENGINEERING EDUCATION, 2005, 94 (04) :363-371
[28]  
Templin J. L., 2004, Unpublished doctoral dissertation.
[29]   A general diagnostic model applied to language testing data [J].
von Davier, Matthias .
BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2008, 61 :287-307