Validation of a High-Stakes Test: GA IESOL Listening Unit

被引:0
作者
Mitrovic, Snezana [1 ]
Botta, Emanuela [1 ]
Castellana, Giusi [2 ]
机构
[1] Sapienza Univ Rome, Dept Med & Psychol, Rome, Italy
[2] Roma Tre Univ, Dept Educ, Rome, Italy
来源
8TH INTERNATIONAL CONFERENCE ON HIGHER EDUCATION ADVANCES (HEAD '22) | 2022年
关键词
listening ability; language assessment; international examinations; validity; reliability;
D O I
10.4995/HEAd22.2022.14514
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
The purpose of this study is the validation of the GA Classic IESOL examination at CEFR level B2 (Reading, Listening, Writing and Speaking), as a criterion-referenced achievement test, using the multi-trait, multi-method approach. The data analysed at the moment pertain to the Listening unit and have been studied to examine the content validity, reliability of the scores and unidimensionality of the construct. The Listening unit consists of three tasks (22 items) in four different versions (D-E-F-G). Four separate statistical analyses were performed and all revealed excellent values of internal consistency. As for unidimensionality of the construct, excellent values were revealed for versions E, F and G and acceptable for version D. Similar analyses on the reading test are planned, with the aim of reaching a multitraitmultimethod analysis of the examination as a whole.Further steps of the study will be the IRT equating procedure of the four versions.
引用
收藏
页码:1001 / 1008
页数:8
相关论文
共 50 条
  • [31] Science Teacher Motivation and Evaluation Policy in a High-Stakes Testing State
    Mintz, Jessica A.
    Kelly, Angela M.
    EDUCATIONAL POLICY, 2021, 35 (01) : 3 - 40
  • [32] Rater Training to Support High-Stakes Simulation-Based Assessments
    Feldman, Moshe
    Lazzara, Elizabeth H.
    Vanderbilt, Allison A.
    DiazGranados, Deborah
    JOURNAL OF CONTINUING EDUCATION IN THE HEALTH PROFESSIONS, 2012, 32 (04) : 279 - 286
  • [33] Fair high-stakes assessment in the long shadow of Covid-19
    Nisbet, Isabel
    Shaw, Stuart
    ASSESSMENT IN EDUCATION-PRINCIPLES POLICY & PRACTICE, 2022, 29 (05) : 518 - 533
  • [34] Reliability of a procedural checklist as a high-stakes measurement of advanced technical skill
    Peyre, Sarah E.
    Peyre, Christian G.
    Hagen, Jeffrey A.
    Sullivan, Maura E.
    AMERICAN JOURNAL OF SURGERY, 2010, 199 (01) : 110 - 114
  • [35] A comparison of physician examiners and trained assessors in a high-stakes OSCE setting
    Humphrey-Murto, S
    Smee, S
    Touchie, C
    Wood, TJ
    Blackmore, DE
    ACADEMIC MEDICINE, 2005, 80 (10) : S59 - S62
  • [36] Uses and consequences in the theory of action of high-stakes teacher evaluation in Chile
    Contreras, Johana
    Martin, Constanza San
    Munoz, Solange
    EDUCATIONAL ASSESSMENT EVALUATION AND ACCOUNTABILITY, 2024,
  • [37] Policy in Practice: Teachers' Conceptualizations of L2 English Oral Proficiency as Operationalized in High-Stakes Test Assessment
    Byman Frisen, Liliann
    Sundqvist, Pia
    Sandlund, Erica
    LANGUAGES, 2021, 6 (04)
  • [38] Power of the policy: how the announcement of high-stakes clinical examination altered OSCE implementation at institutional level
    Lin, Chi-Wei
    Tsai, Tsuen-Chiuan
    Sun, Cheuk-Kwan
    Chen, Der-Fang
    Liu, Keh-Min
    BMC MEDICAL EDUCATION, 2013, 13 : 8
  • [39] Standardizing nurse practitioner student evaluation during high-stakes clinical examinations
    Keiffer, Melanie
    Anderson, Mindi
    Eckhoff, Dawn O.
    Blackwell, Christopher W.
    Talbert, Steven
    Parker, Ann Marie
    JOURNAL OF THE AMERICAN ASSOCIATION OF NURSE PRACTITIONERS, 2021, 33 (12) : 1240 - 1246
  • [40] "Be a Machine": International Graduate Students' Narratives around High-Stakes English Tests
    Sinclair, Jeanne
    Larson, Elizabeth Jean
    Rajendram, Shakina
    LANGUAGE ASSESSMENT QUARTERLY, 2019, 16 (02) : 236 - 252