Test score equating of multiple-choice mathematics items: techniques from characteristic curve of modern psychometric theory

被引:0
作者
Musa Adekunle Ayanwale
机构
[1] Department of Science and Technology Education, Faculty of Education, University of Johannesburg, Johannesburg
来源
Discover Education | / 2卷 / 1期
关键词
EquateIRT; Haebara; National Business and Technical Examinations Board; Stocking-Lord; Supplementary item response theory; Test equating; West African Examinations Council;
D O I
10.1007/s44217-023-00052-z
中图分类号
学科分类号
摘要
Examination scores obtained by students from the West African Examinations Council (WAEC), and National Business and Technical Examinations Board (NABTEB) may not be directly comparable due to differences in examination administration, item characteristics of the subject in question, and student abilities. For more accurate comparisons, scores from different assessments or examibations must be equated. In the literature, little is known about using Stocking-Lord and Haebara Item Response Theory (IRT) methods to equalize WAEC and NABTEB mathematics multiple-choice items. The study used a counterbalanced quantitative design for a single group. As a method for dealing with order effects, counterbalancing was used to assess 50 multiple-choice four-option items developed by WAEC and NABTEB for Grade 12 mathematics. The study selected 1210 Grade 12 students who were divided into groups A (647), and B (563). The IRT equating methods were employed to compare the two test forms based on the obtained data. The findings indicate that WAEC and NABTEB have similar construct domains, though WAEC is more difficult, and discriminates better. Further, when placed on the same scale, both tests are comparable. These findings have implications for curriculum redesign, academic performance assessment, and policymaking in the education sector, as well as refuting public perceptions of the credibility and value of these certificates awarded by the testing organizations in Nigeria. © The Author(s) 2023.
引用
收藏
相关论文
共 95 条
[1]  
Cook L.L., Practical problems in equating test scores: a practitioner’s perspective, Linking and aligning scores and scales, pp. 73-87, (2007)
[2]  
Tian F., A comparison of equating/linking using the Stocking-Lord method and concurrent calibration with mixed-format tests in the non-equivalent groups’ common-item design under IRT., (2011)
[3]  
Clark L.A., Watson D., Constructing validity: Basic issues in objective scale development, Methodological issues and strategies in clinical research, pp. 187-203, (2016)
[4]  
Kline P., A handbook of test construction (psychology revivals): introduction to psychometric design, (2015)
[5]  
Atsua T.G., Uzoeshi I.V., Oludi P., Wagbara E.S., Equating 2015 and 2016 basic education certificate examination on civic education using classical test theory and item response theory in Oyo State, . J Pristine., 14, 1, (2018)
[6]  
Adewale J.G., Equating two-year BECE results in Basic Science and Technology in Oyo State, (2015)
[7]  
Fakayode O., Comparison of classical test theory and item response theory approaches in equating test scores from West Africa Examinations Council mathematics objective test., (2018)
[8]  
Babatimehin T., Determination of the equivalence of WAEC and NECO SSCE chemistry items using linear equating approaches of classical test theory and item response theory, Bulgarian J Sci Educ Policy, 15, 1, (2021)
[9]  
Zannu B.G., Equating 2012 and 2013 Physics test of unified tertiary matriculation examination of the Joint Admission and Matriculation Board, Public examining in subSaharan Africa: Issues, challenges and prospects, pp. 197-212, (2016)
[10]  
Kolen M.J., Comparison of traditional and item response theory methods for equating tests, J Educ Meas, 18, pp. 1-11, (1981)