School System Evaluation by Value Added Analysis Under Endogeneity

被引:17
作者
Manzi, Jorge [1 ]
San Martin, Ernesto [2 ,3 ,4 ]
Van Bellegem, Sebastien [4 ]
机构
[1] Pontificia Univ Catolica Chile, Sch Psychol, Santiago, Chile
[2] Pontificia Univ Catolica Chile, Dept Stat, Santiago, Chile
[3] Pontificia Univ Catolica Chile, Fac Educ, Santiago, Chile
[4] Catholic Univ Louvain, Ctr Operat Res & Econometr, Louvain, Belgium
关键词
value added; endogeneity; hierarchical linear mixed model; instrumental variable; school effect; MODELS; VARIABLES; IDENTIFICATION; EDUCATION;
D O I
10.1007/s11336-013-9338-0
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Value added is a common tool in educational research on effectiveness. It is often modeled as a (prediction of a) random effect in a specific hierarchical linear model. This paper shows that this modeling strategy is not valid when endogeneity is present. Endogeneity stems, for instance, from a correlation between the random effect in the hierarchical model and some of its covariates. This paper shows that this phenomenon is far from exceptional and can even be a generic problem when the covariates contain the prior score attainments, a typical situation in value added modeling. Starting from a general, model-free definition of value added, the paper derives an explicit expression of the value added in an endogeneous hierarchical linear Gaussian model. Inference on value added is proposed using an instrumental variable approach. The impact of endogeneity on the value added and the estimated value added is calculated accurately. This is also illustrated on a large data set of individual scores of about 200,000 students in Chile.
引用
收藏
页码:130 / 153
页数:24
相关论文
共 51 条
  • [1] STATISTICAL MODELING ISSUES IN SCHOOL EFFECTIVENESS STUDIES
    AITKIN, M
    LONGFORD, N
    PLEWIS, IF
    WAKEFIELD, WB
    CHATFIELD, C
    GOLDSTEIN, H
    REYNOLDS, D
    COX, D
    ECOB, R
    GRAY, J
    BELL, JF
    BURSTEIN, L
    DAWID, AP
    HEALY, MJR
    HUTCHISON, DA
    KILGORE, S
    PENDLETON, WW
    LAIRD, NM
    LOUIS, TA
    PRAIS, SJ
    RUTTER, M
    MAUGHAN, B
    OUSTON, J
    SHARE, DL
    SMITH, TMF
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-STATISTICS IN SOCIETY, 1986, 149 : 1 - 43
  • [2] A different paradigm for the initial colonisation of Sahul
    Allen, Jim
    O'Connell, James F.
    [J]. ARCHAEOLOGY IN OCEANIA, 2020, 55 (01) : 1 - 14
  • [3] Instrumental variables and the search for identification: From supply and demand to natural experiments
    Angrist, JD
    Krueger, AB
    [J]. JOURNAL OF ECONOMIC PERSPECTIVES, 2001, 15 (04) : 69 - 85
  • [4] [Anonymous], 1950, Measurement and Prediction
  • [5] [Anonymous], 2008, MEASURING IMPROVEMEN, DOI DOI 10.1787/9789264050259-EN
  • [6] Initial conditions and moment restrictions in dynamic panel data models
    Blundell, R
    Bond, S
    [J]. JOURNAL OF ECONOMETRICS, 1998, 87 (01) : 115 - 143
  • [7] Latent variables in psychology and the social sciences
    Bollen, KA
    [J]. ANNUAL REVIEW OF PSYCHOLOGY, 2002, 53 : 605 - 634
  • [8] The Persistence of School-Level Value-Added
    Briggs, Derek C.
    Weeks, Jonathan P.
    [J]. JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2011, 36 (05) : 616 - 637
  • [9] Corvalan J., 2010, Evidencias para politicas publicas en educacion. Seleccion de investigaciones, P11
  • [10] Regressor and random-effects dependencies in multilevel models
    Ebbes, P
    Böckenholt, U
    Wedel, M
    [J]. STATISTICA NEERLANDICA, 2004, 58 (02) : 161 - 178