Mitigating Omitted Variable Bias in Exploratory Differential Item Functioning Assessment: A Propensity Score Adjustment Approach

被引:0
作者
Chao, Hsiu-Yi [1 ]
Chen, Jyun-Hong [2 ]
Chen, Chi-Chen [3 ]
机构
[1] Soochow Univ, Dept Psychol, 70 Linhsi Rd, Taipei 111002, Taiwan
[2] Natl Cheng Kung Univ, Dept Psychol, 1 Univ Rd, Tainan 701401, Taiwan
[3] Natl Acad Educ Res, Res Ctr Testing & Assessment, 2 Sanshu Rd, New Taipei 237201, Taiwan
关键词
differential item functioning; omitted variable bias; propensity score method; DIF-free-then-DIF strategy; I ERROR; LOGISTIC-REGRESSION; PHANTOM MENACE; DETECTING DIF; MIMIC METHODS; PURIFICATION; MODEL; RATES;
D O I
10.3102/10769986241280308
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Omitted variable bias (OVB) in differential item functioning (DIF) assessment can lead to biased estimates of DIF effects, increasing type I error rates and reducing statistical power. Methodologies for addressing OVB, particularly under exploratory conditions where DIF is assessed without prior information, remain underdeveloped. This study addresses these challenges by applying the propensity score (PS) method to enhance the parsimony of the DIF model. Furthermore, this study incorporated the DIF-free-then-DIF (DFTD) strategy into the PS method, establishing the PS.DFTD method for exploratory DIF assessment. The simulation results reveal that the PS.DFTD method appears promising for mitigating OVB in DIF assessment, demonstrating its potential for practical applications.
引用
收藏
页数:35
相关论文
共 51 条
[1]   RATING FORMULATION FOR ORDERED RESPONSE CATEGORIES [J].
ANDRICH, D .
PSYCHOMETRIKA, 1978, 43 (04) :561-573
[2]  
Birnbaum A., 1968, Statistical theories of mental test scores, P397
[3]   A Monte Carlo comparison of parametric and nonparametric polytomous DIF detection methods [J].
Bolt, DM .
APPLIED MEASUREMENT IN EDUCATION, 2002, 15 (02) :113-141
[4]   Some practical guidance for the implementation of propensity score matching [J].
Caliendo, Marco ;
Kopeinig, Sabine .
JOURNAL OF ECONOMIC SURVEYS, 2008, 22 (01) :31-72
[5]  
Chao H. Y., 2018, Chinese Journal of Psychology., V60, P233, DOI [10.6129/CJP.20181260(4).0001, DOI 10.6129/CJP.20181260(4).0001]
[6]   Improving the Assessment of Differential Item Functioning in Large-Scale Programs With Dual-Scale Purification of Rasch Models: The PISA Example [J].
Chen, Cheng-Te ;
Hwu, Bo-Sien .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2018, 42 (03) :206-220
[7]   Improving the Control of Type I Error Rate in Assessing Differential Item Functioning for Hierarchical Generalized Linear Model When Impact Is Presented [J].
Chen, Jyun-Hong ;
Chen, Cheng-Te ;
Shih, Ching-Lin .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2014, 38 (01) :18-36
[8]   A Propensity Score Method for Investigating Differential Item Functioning in Performance Assessment [J].
Chen, Michelle Y. ;
Liu, Yan ;
Zumbo, Bruno D. .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2020, 80 (03) :476-498
[9]   The Mediated MIMIC Model for Understanding the Underlying Mechanism of DIF [J].
Cheng, Ying ;
Shao, Can ;
Lathrop, Quinn N. .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2016, 76 (01) :43-63
[10]   MIMIC Methods for Detecting DIF Among Multiple Groups: Exploring a New Sequential-Free Baseline Procedure [J].
Chun, Seokjoon ;
Stark, Stephen ;
Kim, Eun Sook ;
Chernyshenko, Oleksandr S. .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2016, 40 (07) :486-499