Improving the Assessment of Differential Item Functioning in Large-Scale Programs With Dual-Scale Purification of Rasch Models: The PISA Example

被引:5
作者
Chen, Cheng-Te [1 ]
Hwu, Bo-Sien [2 ]
机构
[1] Natl Tsing Hua Univ, Hsinchu, Taiwan
[2] Natl Sun Yat Sen Univ, Kaohsiung, Taiwan
关键词
differential item functioning; item response theory; scale purification; large-scale testing programs; missingness; balanced incomplete block design; MANTEL-HAENSZEL PROCEDURE; MISSING DATA; SELECTION; DESIGNS; IMPACT; POWER; BIAS;
D O I
10.1177/0146621617726786
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
By design, large-scale educational testing programs often have a large proportion of missing data. Since the effect of missing data on differential item functioning (DIF) assessment has been investigated in recent years and it has been found that Type I error rates tend to be inflated, it is of great importance to adapt existing DIF assessment methods to the inflation. The DIF-free-then-DIF (DFTD) strategy, which originally involved one single-scale purification procedure to identify DIF-free items, has been extended to involve another scale purification procedure for the DIF assessment in this study, and this new method is called the dual-scale purification (DSP) procedure. The performance of the DSP procedure in assessing DIF in large-scale programs, such as Program for International Student Assessment (PISA), was compared with the DFTD strategy through a series of simulation studies. Results showed the superiority of the DSP procedure over the DFTD strategy when tests consisted of many DIF items and when data were missing by design as in large-scale programs. Moreover, an empirical study of the PISA 2009 Taiwan sample was provided to show the implications of the DSP procedure. The applications as well as further studies of DSP procedure are also discussed.
引用
收藏
页码:206 / 220
页数:15
相关论文
共 35 条
[1]  
Adams R. J., 2012, ACER CONQUEST GENERA
[2]   Applying the Mantel-Haenszel procedure to complex samples of items [J].
Allen, NL ;
Donoghue, JR .
JOURNAL OF EDUCATIONAL MEASUREMENT, 1996, 33 (02) :231-251
[3]  
[Anonymous], 1988, Test validity
[4]  
[Anonymous], 2012, PISA 2009 TECHN REP
[5]  
[Anonymous], 2012, Applications of item response theory to practical testing problems
[6]  
Awuor R. A., 2008, THESIS VIRGINIA POLY
[7]   AN ITERATIVE PROCEDURE FOR LINKING METRICS AND ASSESSING ITEM BIAS IN ITEM RESPONSE THEORY [J].
CANDELL, GL ;
DRASGOW, F .
APPLIED PSYCHOLOGICAL MEASUREMENT, 1988, 12 (03) :253-260
[8]  
Chen C.-T., 2012, 77 ANN M PSYCH SOC L
[9]   Improving the Control of Type I Error Rate in Assessing Differential Item Functioning for Hierarchical Generalized Linear Model When Impact Is Presented [J].
Chen, Jyun-Hong ;
Chen, Cheng-Te ;
Shih, Ching-Lin .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2014, 38 (01) :18-36
[10]  
Cuevas M., 2012, MATH MATIQUES SCI HU, P45, DOI DOI 10.4000/MSH.12274