Examining of Internal Consistency Coefficients in Mixed-Format Tests in Different Simulation Conditions

被引:0
作者
Gurdil Ege, Hatice [1 ]
Demir, Ergul [2 ]
机构
[1] Atam Primary Sch, Ankara, Turkey
[2] Ankara Univ, Educ Sci Fac, Ankara, Turkey
来源
EURASIAN JOURNAL OF EDUCATIONAL RESEARCH | 2020年 / 87期
关键词
mixed format test; reliability; stratified alpha; angoff-feldt; feldt-raju; RELIABILITY; ALPHA;
D O I
10.14689/ejer.2020.87.5
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Purpose: The present study aims to evaluate how the reliabilities computed using alpha, Stratified alpha, Angoff-Feldt, and Feldt-Raju estimators may differ when sample size (500, 1000, and 2000) and item type ratio of dichotomous to polytomous items (2:1; 1:1, 1:2) included in the scale are varied. Research Methods: In this study, Cronbach's alpha, Stratified alpha, Angoff-Feldt, and Feldt-Raju reliability coefficients were estimated on simulated datasets (sample sizes 500, 1000, 2000) and the number of dichotomous versus polytomous item ratios (2:1, 1:1, 1:2). Findings: In the simulation conditions of this research, in all sample size conditions, estimated Angoff-Feldt, and Feldt-Raju reliability coefficients were higher when the number of dichotomous items in the item-type ratio was higher than that of polytomous items. This was also the case for the estimated alpha and Stratified alpha reliability coefficients when the item-type ratio was reversed. While all different reliability estimators gave similar results in the large samples (n >= 1000), there were some differences in reliability estimates depending on the item-type ratio in the small samples (n=500). Implications for Research and Practice: In the light of the findings and conclusions obtained in this study, it may be advisable to use alpha and Stratified a for mixed-type scales when the number of polytomously scored items in the scale is higher than that of the dichotomously scored items. On the other hand, the coefficients Angoff-Feldt and Feldt-Raju are recommended when the number of items scored dichotomously is higher. (C) 2020 Ani Publishing Ltd. All rights reserved
引用
收藏
页码:101 / 118
页数:18
相关论文
共 54 条
  • [21] Gultekin S., 2011, THESIS
  • [22] Guttman L., 1945, PSYCHOMETRIKA, V10, P255, DOI DOI 10.1007/BF02288892
  • [23] Hambleton R. K., 1991, FUNDAMENTALS ITEM RE, V2
  • [24] Monte Carlo studies in item response theory
    Harwell, M
    Stone, CA
    Hsu, TC
    Kirisci, L
    [J]. APPLIED PSYCHOLOGICAL MEASUREMENT, 1996, 20 (02) : 101 - 125
  • [25] He Q., 2009, Estimating the reliability of composite scores
  • [26] Hu Bo, 2018, J Appl Meas, V19, P41
  • [27] An extension of four IRT linking methods for mixed-format tests
    Kim, S
    Lee, WC
    [J]. JOURNAL OF EDUCATIONAL MEASUREMENT, 2006, 43 (01) : 53 - 76
  • [28] Kim S. Y., 2018, MIXED FORMAT TESTS P, V5, P127
  • [29] Classification Consistency and Accuracy for Mixed-Format Tests
    Kim, Stella Y.
    Lee, Won-Chan
    [J]. APPLIED MEASUREMENT IN EDUCATION, 2019, 32 (02) : 97 - 115
  • [30] Kinsey T. L., 2003, THESIS