Detecting Selection Bias in Meta-Analyses with Multiple Outcomes: A Simulation Study

被引:177
作者
Fernandez-Castilla, Belen [1 ,2 ]
Declercq, Lies [1 ,2 ]
Jamshidi, Laleh [1 ,2 ]
Beretvas, S. Natasha [3 ]
Onghena, Patrick [1 ]
Van den Noortgate, Wim [1 ,2 ]
机构
[1] Univ Leuven, KU Leuven, Fac Psychol & Educ Sci, Etienne Sabbelaan 51, B-8500 Kortrijk, Belgium
[2] Univ Leuven, KU Leuven, Imec ITEC, Kortrijk, Belgium
[3] Univ Texas Austin, Austin, TX 78712 USA
关键词
Meta-analysis; multiple effect sizes; publication bias; selective outcome reporting bias; simulation study; ESTIMATING EFFECT SIZE; PUBLICATION BIAS; META-REGRESSION; FILL METHOD; PREVALENCE; TRIM; MODELS; TESTS;
D O I
10.1080/00220973.2019.1582470
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
This study explores the performance of classical methods for detecting publication bias-namely, Egger's regression test, Funnel Plot test, Begg's Rank Correlation and Trim and Fill method-in meta-analysis of studies that report multiple effects. Publication bias, outcome reporting bias, and a combination of these were generated. Egger's regression test and the Funnel Plot test were extended to three-level models, and possible cutoffs for the estimator of the Trim and Fill method were explored. Furthermore, we checked whether the combination of results of several methods yielded a better control of Type I error rates. Results show that no method works well across all conditions and that performance depends mainly on the population effect size value and the total variance.
引用
收藏
页码:125 / 144
页数:20
相关论文
共 47 条
[1]  
[Anonymous], 2006, 14 ANN SE SAS US GRO
[2]   Fitting three-level meta-analytic models in R: A step-by-step tutorial [J].
Assink, Mark ;
Wibbelink, Carlijn J. M. .
QUANTITATIVE METHODS FOR PSYCHOLOGY, 2016, 12 (03) :154-174
[3]   OPERATING CHARACTERISTICS OF A BANK CORRELATION TEST FOR PUBLICATION BIAS [J].
BEGG, CB ;
MAZUMDAR, M .
BIOMETRICS, 1994, 50 (04) :1088-1101
[4]   ROBUSTNESS [J].
BRADLEY, JV .
BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 1978, 31 (NOV) :144-152
[5]   Modeling Dependent Effect Sizes With Three-Level Meta-Analyses: A Structural Equation Modeling Approach [J].
Cheung, Mike W-L .
PSYCHOLOGICAL METHODS, 2014, 19 (02) :211-229
[6]  
Cohen J., 1988, Statistical Power Analysis For The Behavioral Sciences, DOI [10.4324/9780203771587, DOI 10.4324/9780203771587]
[7]   What works?: selectivity models and meta-analysis [J].
Copas, J .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-STATISTICS IN SOCIETY, 1999, 162 :95-109
[8]   Fate of biomedical research protocols and publication bias in France: retrospective cohort study [J].
Decullier, E ;
Lheritier, V ;
Chapuis, F .
BMJ-BRITISH MEDICAL JOURNAL, 2005, 331 (7507) :19-22
[9]   A nonparametric "trim and fill" method of accounting for publication bias in meta-analysis [J].
Duval, S ;
Tweedie, R .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2000, 95 (449) :89-98
[10]   Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis [J].
Duval, S ;
Tweedie, R .
BIOMETRICS, 2000, 56 (02) :455-463