Meta-evaluation of meta-analysis: ten appraisal questions for biologists

被引:363
作者
Nakagawa, Shinichi [1 ,2 ,3 ]
Noble, Daniel W. A. [1 ,2 ]
Senior, Alistair M. [4 ,5 ]
Lagisz, Malgorzata [1 ,2 ]
机构
[1] Univ New South Wales, Evolut & Ecol Res Ctr, Sydney, NSW 2052, Australia
[2] Univ New South Wales, Sch Biol Earth & Environm Sci, Sydney, NSW 2052, Australia
[3] Garvan Inst Med Res, Diabet & Metabol Div, 384 Victoria St, Sydney, NSW 2010, Australia
[4] Univ Sydney, Charles Perkins Ctr, Sydney, NSW 2006, Australia
[5] Univ Sydney, Sch Math & Stat, Sydney, NSW 2006, Australia
基金
澳大利亚研究理事会;
关键词
Effect size; Biological importance; Non-independence; Meta-regression; Meta-research; Publication bias; Quantitative synthesis; Reporting bias; Statistical significance; Systematic review; PUBLICATION BIAS; LIFE EXTENSION; EFFECT SIZE; CUMULATIVE METAANALYSIS; ASSESSING HETEROGENEITY; SYSTEMATIC REVIEWS; RESPONSE RATIOS; TEMPORAL TRENDS; MASS-PRODUCTION; ECOLOGY;
D O I
10.1186/s12915-017-0357-7
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Meta-analysis is a statistical procedure for analyzing the combined data from different studies, and can be a major source of concise up-to-date information. The overall conclusions of a meta-analysis, however, depend heavily on the quality of the meta-analytic process, and an appropriate evaluation of the quality of metaanalysis (meta-evaluation) can be challenging. We outline ten questions biologists can ask to critically appraise a meta-analysis. These questions could also act as simple and accessible guidelines for the authors of meta-analyses. We focus on meta-analyses using nonhuman species, which we term 'biological' metaanalysis. Our ten questions are aimed at enabling a biologist to evaluate whether a biological meta-analysis embodies 'mega-enlightenment', a 'mega-mistake', or something in between.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Meta-analysis and the science of research synthesis
    Gurevitch, Jessica
    Koricheva, Julia
    Nakagawa, Shinichi
    Stewart, Gavin
    NATURE, 2018, 555 (7695) : 175 - 182
  • [22] Psychometric Properties of the Critical Appraisal Tool for Anatomical Meta-Analysis
    D'Antoni, Anthony V.
    Kamel, Nancy
    Tubbs, R. Shane
    Mccartan, Morgan G.
    Strobel, Laine W.
    Bubb, Kathleen C.
    CLINICAL ANATOMY, 2025, : 355 - 361
  • [23] The anatomy of an award-winning meta-analysis: Recommendations for authors, reviewers, and readers of meta-analytic reviews
    Steel, Piers
    Beugelsdijk, Sjoerd
    Aguinis, Herman
    JOURNAL OF INTERNATIONAL BUSINESS STUDIES, 2021, 52 (01) : 23 - 44
  • [24] Reducing plastic waste: A meta-analysis of influences on behaviour and interventions
    Allison, Ayse L.
    Baird, Harriet M.
    Lorencatto, Fabiana
    Webb, Thomas L.
    Michie, Susan
    JOURNAL OF CLEANER PRODUCTION, 2022, 380
  • [25] Herders' willingness-to-participate in the Grassland Ecological Compensation and Award Policy in China: a meta-analysis
    Guan, Shiqi
    Fan, Yubing
    Tang, Zeng
    RANGELAND JOURNAL, 2021, 43 (04) : 267 - 280
  • [26] A meta-analysis of correlated behaviors with implications for behavioral syndromes: relationships between particular behavioral traits
    Garamszegi, Laszlo Zsolt
    Marko, Gabor
    Herczeg, Gabor
    BEHAVIORAL ECOLOGY, 2013, 24 (05) : 1068 - 1080
  • [27] Quantitative evidence synthesis: a practical guide on meta-analysis, meta-regression, and publication bias tests for environmental sciences
    Nakagawa, Shinichi
    Yang, Yefeng
    Macartney, Erin L.
    Spake, Rebecca
    Lagisz, Malgorzata
    ENVIRONMENTAL EVIDENCE, 2023, 12 (01)
  • [28] Formalizing the definition of meta-analysis in Molecular Ecology
    Archmiller, Althea A.
    Bauer, Eric F.
    Koch, Rebecca E.
    Wijayawardena, Bhagya K.
    Anil, Ammu
    Kottwitz, Jack J.
    Munsterman, Amelia S.
    Wilson, Alan E.
    MOLECULAR ECOLOGY, 2015, 24 (16) : 4042 - 4051
  • [29] The validity of situation awareness for performance: a meta-analysis
    Bakdash, Jonathan Z.
    Marusich, Laura R.
    Cox, Katherine R.
    Geuss, Michael N.
    Zaroukian, Erin G.
    Morris, Katelyn M.
    THEORETICAL ISSUES IN ERGONOMICS SCIENCE, 2022, 23 (02) : 223 - 246
  • [30] Reward-Driven Distraction: A Meta-Analysis
    Rusz, Dorottya
    Le Pelley, Mike E.
    Kompier, Michiel A. J.
    Mait, Leon
    Bijleveld, Erik
    PSYCHOLOGICAL BULLETIN, 2020, 146 (10) : 872 - 899