Effects of multimedia on psychometric characteristics of cognitive tests: A comparison between technology-based and paper-based modalities

被引：1
作者：
Van Vo, De [1 ,2 ,3 ]
Csapo, Beno [4 ,5 ]
机构：
[1] An Giang Univ VNU HCM, Fac Educ, 18 Ung Van Khiem St, Long Xuyen City, An Giang Provin, Vietnam
[2] Univ Szeged, Doctoral Sch Educ, 32-34 Petofi S Sgt, H-6722 Szeged, Hungary
[3] Univ Limerick, Epi STEM Natl Ctr STEM Educ, Sch Educ, Plassey Pk Rd, Limerick, Ireland
[4] Univ Szeged, Inst Educ, 32-34 Petofi S Sgt, H-6722 Szeged, Hungary
[5] MTA SZTE Res Grp Dev Competencies, Szeged, Hungary
来源：
STUDIES IN EDUCATIONAL EVALUATION | 2023年 / 77卷
关键词：
Test equivalence; DBF; DIF; Inductive reasoning; Control -of -variables strategy; Technology -based assessment; Paper -and -pencil test; FORMATIVE ASSESSMENT; ONLINE; STUDENTS; SKILLS; ACHIEVEMENT; PACKAGE; ABILITY; IMPACT;
D O I：
10.1016/j.stueduc.2023.101254
中图分类号：
G40 [教育学];
学科分类号：
040101 ; 120403 ;
摘要：
The study aims to investigate the effects of delivery modalities on psychometric characteristics and student performance on cognitive tests. A first study assessed the inductive reasoning ability of 715 students under the supervision of teachers. A second study examined 731 students' performance on the application of the control-ofvariables strategy in basic physics but without teacher supervision due to the COVID-19 pandemic. Rasch measurement showed that the online format fitted to the data better in the unidimensional model across two conditions. Under teacher supervision, paper-based testing was better than online testing in terms of reliability and total scores, but contradictory findings were found in turn without teacher supervision. Although measurement invariance was confirmed between two versions at item level, the differential bundle functioning analysis supported the online groups on the item bundles constructed of figure-related materials. Response time was also discussed as an advantage of technology-based assessment for test development.
引用
收藏
页数：12
相关论文
共 54 条
  • [1] Adey P., 2007, EDUC RES REV-NETH, V2, P75, DOI DOI 10.1016/J.EDUREV.2007.05.001
  • [2] Adey P., 2012, Framework for diagnostic assessment of science, P17
  • [3] American Association for the Advancement of Science (AAAS), 2012, AAAS SCI ASS PROJECT
  • [4] [Anonymous], 1982, Handbook of methods for detecting item bias
  • [5] Establishing Measurement Equivalence Across Computer- and Paper-Based Tests of Spatial Cognition
    Bailey, Shannon K. T.
    Neigel, Alexis R.
    Dhanani, Lindsay Y.
    Sims, Valerie K.
    [J]. HUMAN FACTORS, 2018, 60 (03) : 340 - 350
  • [6] What makes the difference? The impact of item properties on mode effects in reading assessments
    Buerger, Sarah
    Kroehne, Ulf
    Koehler, Carmen
    Goldhammer, Frank
    [J]. STUDIES IN EDUCATIONAL EVALUATION, 2019, 62 : 1 - 9
  • [7] Chalmers RP, 2012, J STAT SOFTW, V48, P1
  • [8] All other things being equal: Acquisition and transfer of the control of variables strategy
    Chen, Z
    Klahr, D
    [J]. CHILD DEVELOPMENT, 1999, 70 (05) : 1098 - 1120
  • [9] Cronbach L.J., 1990, ESSENTIALS PSYCHOL T, VFifth
  • [10] Csapo B., 2019, NEVELESTUDOMANY
123456