Evaluating Pretest Effects in Pre-Post Studies

被引:24
作者
Kim, Eun Sook [1 ]
Willson, Victor L. [1 ]
机构
[1] Texas A&M Univ, Dept Educ Psychol, College Stn, TX 77843 USA
关键词
pretest sensitization effects; pretest-posttest control design; meta-analysis; EXPERIMENTAL-DESIGN; META-ANALYSIS; RELIABILITY; KNOWLEDGE; SCORES;
D O I
10.1177/0013164410366687
中图分类号
G44 [教育心理学];
学科分类号
0402 ; 040202 ;
摘要
This article presents a method to evaluate pretest effects on posttest scores in the absence of an un-pretested control group using published results of pretesting effects due to Willson and Putnam. Confidence intervals around the expected theoretical gain due to pretesting are computed, and observed gains or differential gains are compared with the original reported results. Examples from the American Educational Research Journal and the Journal of Educational Psychology are presented that illustrate both support for the original interpretation and evidence for reinterpretation of the results as statistically significant or nonsignificant opposite to the original conclusion. Implications for using the results of meta-analyses in substantive research are discussed.
引用
收藏
页码:744 / 759
页数:16
相关论文
共 23 条
[1]  
[Anonymous], 1976, Educational Researcher, DOI [DOI 10.3102/0013189X005010003, DOI 10.2307/1174772, 10.3102/0013189x005010003, 10.2307/1174772ISSN0536-1036]
[2]  
[Anonymous], 1986, Introduction to classical and modern test theory
[3]  
Campbell D. T., 1963, Experimental and Quasi-Experimental Designs for Research
[4]   Impact of experimental design on effect size: Findings from the research literature on training [J].
Carlson, KD ;
Schmidt, FL .
JOURNAL OF APPLIED PSYCHOLOGY, 1999, 84 (06) :851-862
[5]  
Dugard P., 1995, Educ. Psychol. Int. J. Exp. Educ. Psychol, V15, P181, DOI [DOI 10.1080/0144341950150207, 10.1080/0144341950150207]
[6]  
Glass GV., 1981, Meta-analysis in social research
[7]  
GUNASEKERA TW, 1997, DISS ABSTR INT A, V58, P718
[8]   Assignment methods in experimentation: When do nonrandomized experiments approximate answers from randomized experiments? [J].
Heinsman, DT ;
Shadish, WR .
PSYCHOLOGICAL METHODS, 1996, 1 (02) :154-169
[9]  
JAEGER RM, 1975, CEDR Q, V9, P3
[10]   A prospective, longitudinal study of the correlates and consequences of early grade retention [J].
Jimerson, S ;
Carlson, E ;
Rotert, M ;
Egeland, B ;
Sroufe, LA .
JOURNAL OF SCHOOL PSYCHOLOGY, 1997, 35 (01) :3-25