The Meta-Plot A Graphical Tool for Interpreting the Results of a Meta-Analysis

被引：1
作者：
van Assen, Marcel A. L. M. [1 ,2 ]
van den Akker, Olmo R. R. [1 ]
Augusteijn, Hilde E. M. [1 ]
Bakker, Marjan [1 ]
Nuijten, Michele B. [1 ]
Olsson-Collentine, Anton [1 ]
Stoevenbelt, Andrea H. H. [1 ]
Wicherts, Jelte M. M. [1 ]
van Aert, Robbie C. M. [1 ]
机构：
[1] Tilburg Univ, Tilburg Sch Social & Behav Sci, Dept Methodol & Stat, POB 90153, NL-5000 LE Tilburg, Netherlands
[2] Univ Utrecht, Fac Social & Behav Sci, Dept Sociol, Utrecht, Netherlands
来源：
ZEITSCHRIFT FUR PSYCHOLOGIE-JOURNAL OF PSYCHOLOGY | 2023年 / 231卷 / 01期
基金：
欧洲研究理事会;
关键词：
meta-analysis; publication bias; statistical power; cumulative meta-analysis; funnel plot; HETEROGENEITY VARIANCE ESTIMATORS; PUBLICATION BIAS; EFFECT SIZE; FUNNEL-PLOT; CUMULATIVE METAANALYSIS; CONDUCTING METAANALYSES; ODDS RATIO; PREVALENCE; SELECTION; MODELS;
D O I：
10.1027/2151-2604/a000513
中图分类号：
B84 [心理学];
学科分类号：
04 ; 0402 ;
摘要：
The meta-plot is a descriptive visual tool for meta-analysis that provides information on the primary studies in the meta-analysis and the results of the meta-analysis. More precisely, the meta-plot portrays (1) the precision and statistical power of the primary studies in the meta-analysis, (2) the estimate and confidence interval of a random-effects meta-analysis, (3) the results of a cumulative random-effects meta-analysis yielding a robustness check of the meta-analytic effect size with respect to primary studies' precision, and (4) evidence of publication bias. After explaining the underlying logic and theory, the meta-plot is applied to two cherry-picked meta-analyses that appear to be biased and to 10 randomly selected meta-analyses from the psychological literature. We recommend accompanying any meta-analysis of common effect size measures with the meta-plot.
引用
收藏
页码：65 / 78
页数：14
相关论文
共 82 条
  • [1] Estimating the reproducibility of psychological science
    Aarts, Alexander A.
    Anderson, Joanna E.
    Anderson, Christopher J.
    Attridge, Peter R.
    Attwood, Angela
    Axt, Jordan
    Babel, Molly
    Bahnik, Stepan
    Baranski, Erica
    Barnett-Cowan, Michael
    Bartmess, Elizabeth
    Beer, Jennifer
    Bell, Raoul
    Bentley, Heather
    Beyan, Leah
    Binion, Grace
    Borsboom, Denny
    Bosch, Annick
    Bosco, Frank A.
    Bowman, Sara D.
    Brandt, Mark J.
    Braswell, Erin
    Brohmer, Hilmar
    Brown, Benjamin T.
    Brown, Kristina
    Bruening, Jovita
    Calhoun-Sauls, Ann
    Callahan, Shannon P.
    Chagnon, Elizabeth
    Chandler, Jesse
    Chartier, Christopher R.
    Cheung, Felix
    Christopherson, Cody D.
    Cillessen, Linda
    Clay, Russ
    Cleary, Hayley
    Cloud, Mark D.
    Cohn, Michael
    Cohoon, Johanna
    Columbus, Simon
    Cordes, Andreas
    Costantini, Giulio
    Alvarez, Leslie D. Cramblet
    Cremata, Ed
    Crusius, Jan
    DeCoster, Jamie
    DeGaetano, Michelle A.
    Della Penna, Nicolas
    den Bezemer, Bobby
    Deserno, Marie K.
    [J]. SCIENCE, 2015, 349 (6251)
  • [2] Aberson C.L., 2011, Applied power analysis for the behavioral sciences
  • [3] Meta-Analytic Choices and Judgment Calls: Implications for Theory Building and Testing, Obtained Effect Sizes, and Scholarly Impact
    Aguinis, Herman
    Dalton, Dan R.
    Bosco, Frank A.
    Pierce, Charles A.
    Dalton, Catherine M.
    [J]. JOURNAL OF MANAGEMENT, 2011, 37 (01) : 5 - 38
  • [4] Does Discovery-Based Instruction Enhance Learning?
    Alfieri, Louis
    Brooks, Patricia J.
    Aldrich, Naomi J.
    Tenenbaum, Harriet R.
    [J]. JOURNAL OF EDUCATIONAL PSYCHOLOGY, 2011, 103 (01) : 1 - 18
  • [5] [Anonymous], 2014, TEST INSUFFICIENT VA
  • [6] Cumulative meta-analysis by precision as a method to evaluate publication bias
    Atakpo, Paul
    Vassar, Matt
    [J]. JOURNAL OF DERMATOLOGICAL SCIENCE, 2016, 83 (03) : 251 - 253
  • [7] The Effect of Publication Bias on the Q Test and Assessment of Heterogeneity
    Augusteijn, Hilde E. M.
    van Aert, Robbie C. M.
    van Assen, Marcel A. L. M.
    [J]. PSYCHOLOGICAL METHODS, 2019, 24 (01) : 116 - 134
  • [8] The Rules of the Game Called Psychological Science
    Bakker, Marjan
    van Dijk, Annette
    Wicherts, Jelte M.
    [J]. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2012, 7 (06) : 543 - 554
  • [9] OPERATING CHARACTERISTICS OF A BANK CORRELATION TEST FOR PUBLICATION BIAS
    BEGG, CB
    MAZUMDAR, M
    [J]. BIOMETRICS, 1994, 50 (04) : 1088 - 1101
  • [10] Culturally Adapted Psychotherapy and the Legitimacy of Myth: A Direct-Comparison Meta-Analysis
    Benish, Steven G.
    Quintana, Stephen
    Wampold, Bruce E.
    [J]. JOURNAL OF COUNSELING PSYCHOLOGY, 2011, 58 (03) : 279 - 289
123456789