Detecting Selection Bias in Meta-Analyses with Multiple Outcomes: A Simulation Study

被引:177
作者
Fernandez-Castilla, Belen [1 ,2 ]
Declercq, Lies [1 ,2 ]
Jamshidi, Laleh [1 ,2 ]
Beretvas, S. Natasha [3 ]
Onghena, Patrick [1 ]
Van den Noortgate, Wim [1 ,2 ]
机构
[1] Univ Leuven, KU Leuven, Fac Psychol & Educ Sci, Etienne Sabbelaan 51, B-8500 Kortrijk, Belgium
[2] Univ Leuven, KU Leuven, Imec ITEC, Kortrijk, Belgium
[3] Univ Texas Austin, Austin, TX 78712 USA
关键词
Meta-analysis; multiple effect sizes; publication bias; selective outcome reporting bias; simulation study; ESTIMATING EFFECT SIZE; PUBLICATION BIAS; META-REGRESSION; FILL METHOD; PREVALENCE; TRIM; MODELS; TESTS;
D O I
10.1080/00220973.2019.1582470
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
This study explores the performance of classical methods for detecting publication bias-namely, Egger's regression test, Funnel Plot test, Begg's Rank Correlation and Trim and Fill method-in meta-analysis of studies that report multiple effects. Publication bias, outcome reporting bias, and a combination of these were generated. Egger's regression test and the Funnel Plot test were extended to three-level models, and possible cutoffs for the estimator of the Trim and Fill method were explored. Furthermore, we checked whether the combination of results of several methods yielded a better control of Type I error rates. Results show that no method works well across all conditions and that performance depends mainly on the population effect size value and the total variance.
引用
收藏
页码:125 / 144
页数:20
相关论文
共 47 条
[21]   Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials [J].
Ioannidis, JPA .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1998, 279 (04) :281-286
[22]   Issues in comparisons between meta-analyses and large trials [J].
Ioannidis, JPA ;
Cappelleri, JC ;
Lau, J .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1998, 279 (14) :1089-1093
[23]   The implications of publication bias for meta-analysis' other parameter [J].
Jackson, Dan .
STATISTICS IN MEDICINE, 2006, 25 (17) :2911-2921
[24]   Statistical methods for dealing with publication bias in meta-analysis [J].
Jin, Zhi-Chao ;
Zhou, Xiao-Hua ;
He, Jia .
STATISTICS IN MEDICINE, 2015, 34 (02) :343-360
[25]   On knowing what we do not know - An empirical comparison of methods to detect publication bias in meta-analysis [J].
Kromrey, JD ;
Rendina-Gobioff, G .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2006, 66 (03) :357-373
[26]   A comparison of methods to detect publication bias in meta-analysis [J].
Macaskill, P ;
Walter, SD ;
Irwig, L .
STATISTICS IN MEDICINE, 2001, 20 (04) :641-654
[27]   The consequence of ignoring a level of nesting in multilevel analysis [J].
Moerbeek, M .
MULTIVARIATE BEHAVIORAL RESEARCH, 2004, 39 (01) :129-149
[28]   Methods for dealing with multiple outcomes in meta-analysis<bold>:</bold> a comparison between averaging effect sizes, robust variance estimation and multilevel meta-analysis [J].
Moeyaert, Mariola ;
Ugille, Maaike ;
Beretvas, S. Natasha ;
Ferron, John ;
Bunuan, Rommel ;
Van den Noortgate, Wim .
INTERNATIONAL JOURNAL OF SOCIAL RESEARCH METHODOLOGY, 2017, 20 (06) :559-572
[29]   Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study [J].
Moreno, Santiago G. ;
Sutton, Alex J. ;
Ades, A. E. ;
Stanley, Tom D. ;
Abrams, Keith R. ;
Peters, Jaime L. ;
Cooper, Nicola J. .
BMC MEDICAL RESEARCH METHODOLOGY, 2009, 9
[30]   Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity [J].
Peters, Jaime L. ;
Sutton, Alex J. ;
Jones, David R. ;
Abrams, Keith R. ;
Rushton, Lesley .
STATISTICS IN MEDICINE, 2007, 26 (25) :4544-4562