Effect Size Guidelines for Cross-Lagged Effects

被引:423
作者
Orth, Ulrich [1 ]
Meier, Laurenz L. [2 ]
Buehler, Janina Larissa [3 ,5 ]
Dapp, Laura C. [1 ]
Krauss, Samantha [1 ]
Messerli, Denise [2 ]
Robins, Richard W. [4 ]
机构
[1] Univ Bern, Dept Psychol, Fabrikstr 8, CH-3012 Bern, Switzerland
[2] Univ Neuchatel, Dept Psychol, Neuchatel, Switzerland
[3] Heidelberg Univ, Dept Psychol, Heidelberg, Germany
[4] Univ Calif Davis, Dept Psychol, Davis, CA 95616 USA
[5] Johannes Gutenberg Univ Mainz, Dept Psychol, Mainz, Germany
关键词
cross-lagged panel model; random intercept cross-lagged panel model; effect size; empirical benchmarks; longitudinal research; SELF-ESTEEM; METAANALYSIS; MODELS; PANEL; TIME; DEPRESSION; BIAS;
D O I
10.1037/met0000499
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Cross-lagged models are by far the most commonly used method to test the prospective effect of one construct on another, yet there are no guidelines for interpreting the size of cross-lagged effects. This research aims to establish empirical benchmarks for cross-lagged effects, focusing on the cross-lagged panel model (CLPM) and the random intercept cross-lagged panel model (RI-CLPM). We drew a quasirepresentative sample of studies published in four subfields of psychology (i.e., developmental, social-personality, clinical, and industrial-organizational). The dataset included 1,028 effect sizes for the CLPM and 302 effect sizes for the RI-CLPM, based on data from 174 samples. For the CLPM, the 25th, 50th, and 75th percentiles of the distribution corresponded to cross-lagged effect sizes of .03, .07, and .12, respectively. For the RI-CLPM, the corresponding values were .02, .05, and .11. Effect sizes did not differ significantly between the CLPM and RI-CLPM. Moreover, effect sizes did not differ significantly across subfields and were not moderated by design characteristics. However, effect sizes were moderated by the concurrent correlation between the constructs and the stability of the predictor. Based on the findings, we propose to use .03 (small effect), .07 (medium effect), and .12 (large effect) as benchmark values when interpreting the size of cross-lagged effects, for both the CLPM and RI-CLPM. In addition to aiding in the interpretation of results, the present findings will help researchers plan studies by providing information needed to conduct power analyses and estimate minimally required sample sizes. Translational Abstract Researchers in psychology and related disciplines often use longitudinal data to examine the effect of a construct measured at one point in time on another construct measured at a later time point. This article provides guidelines for interpreting the size of these prospective effects. We focused on two frequently used models: the cross-lagged panel model (CLPM) and the random intercept cross-lagged panel model (RI-CLPM). We examined the range of effect sizes reported for these models in a quasirepresentative sample of published articles drawn from four subfields of psychology (developmental, social-personality, clinical, and industrial-organizational). Average effect sizes were similar for the CLPM and RI-CLPM and did not differ significantly across subfields. Based on the findings, we recommend that researchers use .03 (small effect), .07 (medium effect), and .12 (large effect) as benchmark values when interpreting the size of cross-lagged effects for both the CLPM and RI-CLPM.
引用
收藏
页码:421 / 433
页数:13
相关论文
共 49 条
[1]   Interpreting effect sizes when controlling for stability effects in longitudinal autoregressive models: Implications for psychological science [J].
Adachi, Paul ;
Willoughby, Teena .
EUROPEAN JOURNAL OF DEVELOPMENTAL PSYCHOLOGY, 2015, 12 (01) :116-128
[2]   Journal Article Reporting Standards for Quantitative Research in Psychology: The APA Publications and Communications Board Task Force Report [J].
Appelbaum, Mark ;
Cooper, Harris ;
Kline, Rex B. ;
Mayo-Wilson, Evan ;
Nezu, Arthur M. ;
Rao, Stephen M. .
AMERICAN PSYCHOLOGIST, 2018, 73 (01) :3-25
[3]  
Biesanz JeremyC., 2012, Handbook of Structural Equation Modeling, P459
[4]  
Borenstein M., 2009, Introduction to meta-analysis, DOI DOI 10.1002/9780470743386
[5]   Correlational Effect Size Benchmarks [J].
Bosco, Frank A. ;
Aguinis, Herman ;
Singh, Kulraj ;
Field, James G. ;
Pierce, Charles A. .
JOURNAL OF APPLIED PSYCHOLOGY, 2015, 100 (02) :431-449
[6]   Effect Size Guidelines, Sample Size Calculations, and Statistical Power in Gerontology [J].
Brydges, Christopher R. .
INNOVATION IN AGING, 2019, 3 (04)
[7]   A POWER PRIMER [J].
COHEN, J .
PSYCHOLOGICAL BULLETIN, 1992, 112 (01) :155-159
[8]  
Cohen J. W, 1988, STAT POWER ANAL BEHA, DOI 10.4324/9780203771587
[9]  
Cole DA, 2014, PSYCHOL METHODS, V19, P300, DOI 10.1037/a0033805
[10]  
Cribari-Neto F, 2010, J STAT SOFTW, V34, P1