Validation of a High-Stakes Test: GA IESOL Listening Unit

被引:0
|
作者
Mitrovic, Snezana [1 ]
Botta, Emanuela [1 ]
Castellana, Giusi [2 ]
机构
[1] Sapienza Univ Rome, Dept Med & Psychol, Rome, Italy
[2] Roma Tre Univ, Dept Educ, Rome, Italy
来源
8TH INTERNATIONAL CONFERENCE ON HIGHER EDUCATION ADVANCES (HEAD '22) | 2022年
关键词
listening ability; language assessment; international examinations; validity; reliability;
D O I
10.4995/HEAd22.2022.14514
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
The purpose of this study is the validation of the GA Classic IESOL examination at CEFR level B2 (Reading, Listening, Writing and Speaking), as a criterion-referenced achievement test, using the multi-trait, multi-method approach. The data analysed at the moment pertain to the Listening unit and have been studied to examine the content validity, reliability of the scores and unidimensionality of the construct. The Listening unit consists of three tasks (22 items) in four different versions (D-E-F-G). Four separate statistical analyses were performed and all revealed excellent values of internal consistency. As for unidimensionality of the construct, excellent values were revealed for versions E, F and G and acceptable for version D. Similar analyses on the reading test are planned, with the aim of reaching a multitraitmultimethod analysis of the examination as a whole.Further steps of the study will be the IRT equating procedure of the four versions.
引用
收藏
页码:1001 / 1008
页数:8
相关论文
共 50 条
  • [1] Evaluating the Explanation Inference of a High-Stakes French Listening Test: An Argument-Based Perspective
    Arias, Angel
    Blais, Jean-Guy
    CANADIAN MODERN LANGUAGE REVIEW-REVUE CANADIENNE DES LANGUES VIVANTES, 2023, 79 (02): : 77 - 100
  • [2] Rethinking validation in complex high-stakes assessment contexts
    Koch, Martha J.
    DeLuca, Christopher
    ASSESSMENT IN EDUCATION-PRINCIPLES POLICY & PRACTICE, 2012, 19 (01) : 99 - 116
  • [3] On the validity of repeated assessments in the UMAT, a high-stakes admissions test
    David Andrich
    Irene Styles
    Annette Mercer
    Ian B. Puddey
    Advances in Health Sciences Education, 2017, 22 : 1245 - 1262
  • [4] On the validity of repeated assessments in the UMAT, a high-stakes admissions test
    Andrich, David
    Styles, Irene
    Mercer, Annette
    Puddey, Ian B.
    ADVANCES IN HEALTH SCIENCES EDUCATION, 2017, 22 (05) : 1245 - 1262
  • [5] The differences among three-, four-, and five-option-item formats in the context of a high-stakes English-language listening test
    Lee, HyeSun
    Winke, Paula
    LANGUAGE TESTING, 2013, 30 (01) : 99 - 123
  • [6] Designing and validating a scale for evaluating the sources of unreliability of a high-stakes test
    Fateme Nikmard
    Kobra Tavassoli
    Natasha Pourdana
    Language Testing in Asia, 13
  • [7] Designing and validating a scale for evaluating the sources of unreliability of a high-stakes test
    Nikmard, Fateme
    Tavassoli, Kobra
    Pourdana, Natasha
    LANGUAGE TESTING IN ASIA, 2023, 13 (01)
  • [8] Evaluating a high-stakes EFL speaking test: Teachers' practices and views
    Borger, Linda
    MODERNA SPRAK, 2019, 113 (01): : 25 - 57
  • [9] The role of simulation in high-stakes assessment
    Dupre, J.
    Naik, V. N.
    BJA EDUCATION, 2021, 21 (04) : 148 - 153
  • [10] On the reliability of high-stakes teacher assessment
    Johnson, Sandra
    RESEARCH PAPERS IN EDUCATION, 2013, 28 (01) : 91 - 105