Performance of Missing Data Approaches Under Non ignorable Missing Data Conditions

被引:13
作者
Pohl, Steffi [1 ]
Becker, Benjamin [2 ]
机构
[1] Free Univ Berlin, Berlin, Germany
[2] Inst Educ Qual Improvement, Berlin, Germany
关键词
missing data; nonignorability; item response theory; item nonresponse; large-scale assessment; ITEM NONRESPONSE; MULTIPLE IMPUTATION; MODELS; PARAMETERS; MECHANISMS; RESPONSES; ABILITY; IMPACT;
D O I
10.5964/meth.2805
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
Approaches for dealing with item omission include incorrect scoring, ignoring missing values, and approaches for nonignorable missing values and have only been evaluated for certain forms of nonignorability. In this paper we investigate the performance of these approaches for various conditions of nonignorability, that is, when the missing response depends on i) the item response, ii) a latent missing propensity, or iii) both. No approach results in unbiased parameter estimates of the Rasch model under all missing data mechanisms. Incorrect scoring only results in unbiased estimates under very specific data constellations of missing mechanisms i) and iii). The approach for nonignorable missing values only results in unbiased estimates under condition ii). Ignoring results in slightly more biased estimates than the approach for nonignorable missing values, while the latter also indicates the presence of nonignorablity under all simulated conditions. We illustrate the results in an empirical example on PISA data.
引用
收藏
页码:147 / 165
页数:19
相关论文
共 27 条
[1]  
[Anonymous], 2010, ETS Research Report Series, DOI [DOI 10.1002/J.2333-8504.2010.TB02218.X, 10.1002/j.2333-8504.2010.tb02218.x]
[2]  
Culbertson M.J., 2011, Is it wrong? Handling missing responses in IRT
[3]  
De Ayala RJ, 2001, J EDUC MEAS, V38, P213
[5]  
Glas C. A. W., 2015, PSYCHOL TEST ASSESSM, V57, P523
[6]   Modeling Nonignorable Missing Data in Speeded Tests [J].
Glas, Cees A. W. ;
Pimentel, Jonald L. .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2008, 68 (06) :907-922
[7]  
Holman R, 2005, BRIT J MATH STAT PSY, V58, P1
[8]   Multiple Imputation by Predictive Mean Matching When Sample Size Is Small [J].
Kleinke, Kristian .
METHODOLOGY-EUROPEAN JOURNAL OF RESEARCH METHODS FOR THE BEHAVIORAL AND SOCIAL SCIENCES, 2018, 14 (01) :3-15
[9]   Dealing With Item Nonresponse in Large-Scale Cognitive Assessments: The Impact of Missing Data Methods on Estimated Explanatory Relationships [J].
Koehler, Carmen ;
Pohl, Steffi ;
Carstensen, Claus H. .
JOURNAL OF EDUCATIONAL MEASUREMENT, 2017, 54 (04) :397-419
[10]   Taking the Missing Propensity Into Account When Estimating Competence Scores: Evaluation of Item Response Theory Models for Nonignorable Omissions [J].
Koehler, Carmen ;
Pohl, Steffi ;
Carstensen, Claus H. .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2015, 75 (05) :850-874