Detecting DIF in Multidimensional Forced Choice Measures Using the Thurstonian Item Response Theory Model

被引:18
|
作者
Lee, Philseok [1 ]
Joo, Seang-Hwane [2 ]
Stark, Stephen [3 ]
机构
[1] George Mason Univ, David King Hall,Room 3056,4400 Univ Dr MSN 3F5, Fairfax, VA 22030 USA
[2] Univ S Florida, Tampa, FL 33620 USA
[3] Univ S Florida, Psychol Dept, Tampa, FL 33620 USA
关键词
noncognitive testing; multidimensional forced choice measures; measurement invariance; differential item functioning; Thurstonian item response theory; Monte Carlo simulation; PAIRWISE-PREFERENCE; GENDER-DIFFERENCES; PERSONALITY INVENTORIES; PSYCHOMETRIC PROPERTIES; APPLICANT FAKING; IRT; VALIDITY; INVARIANCE; SELECTION; ISSUES;
D O I
10.1177/1094428120959822
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
Although modern item response theory (IRT) methods of test construction and scoring have overcome ipsativity problems historically associated with multidimensional forced choice (MFC) formats, there has been little research on MFC differential item functioning (DIF) detection, whereitemrefers to a block, or group, of statements presented for an examinee's consideration. This research investigated DIF detection with three-alternative MFC items based on the Thurstonian IRT (TIRT) model, using omnibus Wald tests on loadings and thresholds. We examined constrained and free baseline model comparisons strategies with different types and magnitudes of DIF, latent trait correlations, sample sizes, and levels of impact in an extensive Monte Carlo study. Results indicated the free baseline strategy was highly effective in detecting DIF, with power approaching 1.0 in the large sample size and large magnitude of DIF conditions, and similar effectiveness in the impact and no-impact conditions. This research also included an empirical example to demonstrate the viability of the best performing method with real examinees and showed how a DIF and a DTF effect size measure can be used to assess the practical significance of MFC DIF findings.
引用
收藏
页码:739 / 771
页数:33
相关论文
共 50 条
  • [31] An Investigation of Emotional Intelligence Measures Using Item Response Theory
    Cho, Seonghee
    Drasgow, Fritz
    Cao, Mengyang
    PSYCHOLOGICAL ASSESSMENT, 2015, 27 (04) : 1241 - 1252
  • [33] Exploring the Robustness of a Unidimensional Item Response Theory Model With Empirically Multidimensional Data
    Anderson, Daniel
    Kahn, Joshua D.
    Tindal, Gerald
    APPLIED MEASUREMENT IN EDUCATION, 2017, 30 (03) : 163 - 177
  • [34] Using Item Response Theory to Compare Irritability Measures in Early Adolescent and Childhood Samples
    Dougherty, Lea R.
    Galano, Maria M.
    Chad-Friedman, Emma
    Olino, Thomas M.
    Bufferd, Sara J.
    Klein, Daniel N.
    ASSESSMENT, 2021, 28 (03) : 918 - 927
  • [35] An NCME Instructional Module on Latent DIF Analysis Using Mixture Item Response Models
    Cho, Sun-Joo
    Suh, Youngsuk
    Lee, Woo-yeol
    EDUCATIONAL MEASUREMENT-ISSUES AND PRACTICE, 2016, 35 (01) : 48 - 61
  • [36] Examining Internal Structures of a Developmental Measure Using Multidimensional Item Response Theory
    Chen, Chieh-Yu
    Xie, Huichao
    Clifford, Jantina
    Chen, Ching-I
    Squires, Jane
    JOURNAL OF EARLY INTERVENTION, 2018, 40 (04) : 287 - 303
  • [37] Detecting Differential Item Functioning Using Response Time
    Duan, Qizhou
    Cheng, Ying
    EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2025, 85 (02) : 291 - 312
  • [38] Synthesizing the Ability in Multidimensional Item Response Theory Models
    Montenegro Diaz, Alvaro Mauricio
    Cepeda, Edilberto
    REVISTA COLOMBIANA DE ESTADISTICA, 2010, 33 (01): : 127 - 147
  • [39] Gaussian variational estimation for multidimensional item response theory
    Cho, April E.
    Wang, Chun
    Zhang, Xue
    Xu, Gongjun
    BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2021, 74 : 52 - 85
  • [40] Multidimensional item response theory and the Force Concept Inventory
    Stewart, John
    Zabriskie, Cabot
    DeVore, Seth
    Stewar, Gay
    PHYSICAL REVIEW PHYSICS EDUCATION RESEARCH, 2018, 14 (01):