Meta-evaluation of meta-analysis: ten appraisal questions for biologists

被引:388
作者
Nakagawa, Shinichi [1 ,2 ,3 ]
Noble, Daniel W. A. [1 ,2 ]
Senior, Alistair M. [4 ,5 ]
Lagisz, Malgorzata [1 ,2 ]
机构
[1] Univ New South Wales, Evolut & Ecol Res Ctr, Sydney, NSW 2052, Australia
[2] Univ New South Wales, Sch Biol Earth & Environm Sci, Sydney, NSW 2052, Australia
[3] Garvan Inst Med Res, Diabet & Metabol Div, 384 Victoria St, Sydney, NSW 2010, Australia
[4] Univ Sydney, Charles Perkins Ctr, Sydney, NSW 2006, Australia
[5] Univ Sydney, Sch Math & Stat, Sydney, NSW 2006, Australia
基金
澳大利亚研究理事会;
关键词
Effect size; Biological importance; Non-independence; Meta-regression; Meta-research; Publication bias; Quantitative synthesis; Reporting bias; Statistical significance; Systematic review; PUBLICATION BIAS; LIFE EXTENSION; EFFECT SIZE; CUMULATIVE METAANALYSIS; ASSESSING HETEROGENEITY; SYSTEMATIC REVIEWS; RESPONSE RATIOS; TEMPORAL TRENDS; MASS-PRODUCTION; ECOLOGY;
D O I
10.1186/s12915-017-0357-7
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Meta-analysis is a statistical procedure for analyzing the combined data from different studies, and can be a major source of concise up-to-date information. The overall conclusions of a meta-analysis, however, depend heavily on the quality of the meta-analytic process, and an appropriate evaluation of the quality of metaanalysis (meta-evaluation) can be challenging. We outline ten questions biologists can ask to critically appraise a meta-analysis. These questions could also act as simple and accessible guidelines for the authors of meta-analyses. We focus on meta-analyses using nonhuman species, which we term 'biological' metaanalysis. Our ten questions are aimed at enabling a biologist to evaluate whether a biological meta-analysis embodies 'mega-enlightenment', a 'mega-mistake', or something in between.
引用
收藏
页数:14
相关论文
共 50 条
[21]   Meta-analysis and the science of research synthesis [J].
Gurevitch, Jessica ;
Koricheva, Julia ;
Nakagawa, Shinichi ;
Stewart, Gavin .
NATURE, 2018, 555 (7695) :175-182
[22]   Psychometric Properties of the Critical Appraisal Tool for Anatomical Meta-Analysis [J].
D'Antoni, Anthony V. ;
Kamel, Nancy ;
Tubbs, R. Shane ;
Mccartan, Morgan G. ;
Strobel, Laine W. ;
Bubb, Kathleen C. .
CLINICAL ANATOMY, 2025, 38 (03) :355-361
[23]   Reducing plastic waste: A meta-analysis of influences on behaviour and interventions [J].
Allison, Ayse L. ;
Baird, Harriet M. ;
Lorencatto, Fabiana ;
Webb, Thomas L. ;
Michie, Susan .
JOURNAL OF CLEANER PRODUCTION, 2022, 380
[24]   The anatomy of an award-winning meta-analysis: Recommendations for authors, reviewers, and readers of meta-analytic reviews [J].
Steel, Piers ;
Beugelsdijk, Sjoerd ;
Aguinis, Herman .
JOURNAL OF INTERNATIONAL BUSINESS STUDIES, 2021, 52 (01) :23-44
[25]   Herders' willingness-to-participate in the Grassland Ecological Compensation and Award Policy in China: a meta-analysis [J].
Guan, Shiqi ;
Fan, Yubing ;
Tang, Zeng .
RANGELAND JOURNAL, 2021, 43 (04) :267-280
[26]   A meta-analysis of correlated behaviors with implications for behavioral syndromes: relationships between particular behavioral traits [J].
Garamszegi, Laszlo Zsolt ;
Marko, Gabor ;
Herczeg, Gabor .
BEHAVIORAL ECOLOGY, 2013, 24 (05) :1068-1080
[27]   Quantitative evidence synthesis: a practical guide on meta-analysis, meta-regression, and publication bias tests for environmental sciences [J].
Nakagawa, Shinichi ;
Yang, Yefeng ;
Macartney, Erin L. ;
Spake, Rebecca ;
Lagisz, Malgorzata .
ENVIRONMENTAL EVIDENCE, 2023, 12 (01)
[28]   Formalizing the definition of meta-analysis in Molecular Ecology [J].
Archmiller, Althea A. ;
Bauer, Eric F. ;
Koch, Rebecca E. ;
Wijayawardena, Bhagya K. ;
Anil, Ammu ;
Kottwitz, Jack J. ;
Munsterman, Amelia S. ;
Wilson, Alan E. .
MOLECULAR ECOLOGY, 2015, 24 (16) :4042-4051
[29]   The validity of situation awareness for performance: a meta-analysis [J].
Bakdash, Jonathan Z. ;
Marusich, Laura R. ;
Cox, Katherine R. ;
Geuss, Michael N. ;
Zaroukian, Erin G. ;
Morris, Katelyn M. .
THEORETICAL ISSUES IN ERGONOMICS SCIENCE, 2022, 23 (02) :223-246
[30]   Uses and misuses of meta-analysis in plant ecology [J].
Koricheva, Julia ;
Gurevitch, Jessica .
JOURNAL OF ECOLOGY, 2014, 102 (04) :828-844