The validation of parallel test forms: 'Mountain' and 'beach' picture series for assessment of language skills

被引:8
作者
Bae, Jungok [1 ]
Lee, Yae-Sheik [1 ]
机构
[1] Kyungpook Natl Univ, Dept English Educ, Taegu 702701, South Korea
关键词
beach; equivalence; factor structures; means; mountain; narration; parallel forms; picture series; prompt; variances; writing; MEASUREMENT INVARIANCE; SELECTION;
D O I
10.1177/0265532210382446
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
Pictures are widely used to elicit expressive language skills, and pictures must be established as parallel before changes in ability can be demonstrated by assessment using pictures prompts. Why parallel prompts are required and what it is necessary to do to ensure that prompts are in fact parallel is not widely known. To date, evidence of equivalence has been documented for only a handful of picture instruments. The present study aims to demonstrate that two picture series, one describing hiking on a mountain, the other a picnic at a beach, designed to elicit narrative writing from children, are statistically parallel. To verify their being parallel, a random group design and a covariate were used. MANCOVA and confirmatory factor analysis confirmed that the two alternate picture forms were parallel in terms of means, variances, and factor structures with regard to multiple writing components. This study makes a unique contribution to picture-based assessment, first by publishing this parallel picture set and making it available as a tool for assessing children's productive skills using longitudinal designs, and second by demonstrating a process by which any other test forms, pictorial or otherwise, can be validated as parallel.
引用
收藏
页码:155 / 177
页数:23
相关论文
共 34 条
[1]  
[Anonymous], 1999, STAND ED PSYCH TEST
[2]  
[Anonymous], 2004, TOEFL RES REPORTS
[3]  
Bachman L. F., 1990, FUNDAMENTAL CONSIDER
[4]  
BAE J, 2010, LONGITUDINAL I UNPUB
[5]  
BAE J, 2000, THESIS U CALIFORNIA
[6]   An investigation of four writing traits and two tasks across two languages [J].
Bae, Jungok ;
Bachman, Lyle F. .
LANGUAGE TESTING, 2010, 27 (02) :213-234
[8]   Modeling of intervention effects [J].
Bentler, PM .
SUBSTANCE USE & MISUSE, 1997, 32 (12-13) :1661-1666
[9]  
Berman R.A., 1994, Relating events in narrative: A crosslinguistic developmental study
[10]   ESSAY PROMPTS AND TOPICS - MINIMIZING THE EFFECT OF MEAN DIFFERENCES [J].
BROWN, JD ;
HILGERS, T ;
MARSELLA, J .
WRITTEN COMMUNICATION, 1991, 8 (04) :533-556