Meta-evaluation of meta-analysis: ten appraisal questions for biologists

被引:369
作者
Nakagawa, Shinichi [1 ,2 ,3 ]
Noble, Daniel W. A. [1 ,2 ]
Senior, Alistair M. [4 ,5 ]
Lagisz, Malgorzata [1 ,2 ]
机构
[1] Univ New South Wales, Evolut & Ecol Res Ctr, Sydney, NSW 2052, Australia
[2] Univ New South Wales, Sch Biol Earth & Environm Sci, Sydney, NSW 2052, Australia
[3] Garvan Inst Med Res, Diabet & Metabol Div, 384 Victoria St, Sydney, NSW 2010, Australia
[4] Univ Sydney, Charles Perkins Ctr, Sydney, NSW 2006, Australia
[5] Univ Sydney, Sch Math & Stat, Sydney, NSW 2006, Australia
基金
澳大利亚研究理事会;
关键词
Effect size; Biological importance; Non-independence; Meta-regression; Meta-research; Publication bias; Quantitative synthesis; Reporting bias; Statistical significance; Systematic review; PUBLICATION BIAS; LIFE EXTENSION; EFFECT SIZE; CUMULATIVE METAANALYSIS; ASSESSING HETEROGENEITY; SYSTEMATIC REVIEWS; RESPONSE RATIOS; TEMPORAL TRENDS; MASS-PRODUCTION; ECOLOGY;
D O I
10.1186/s12915-017-0357-7
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Meta-analysis is a statistical procedure for analyzing the combined data from different studies, and can be a major source of concise up-to-date information. The overall conclusions of a meta-analysis, however, depend heavily on the quality of the meta-analytic process, and an appropriate evaluation of the quality of metaanalysis (meta-evaluation) can be challenging. We outline ten questions biologists can ask to critically appraise a meta-analysis. These questions could also act as simple and accessible guidelines for the authors of meta-analyses. We focus on meta-analyses using nonhuman species, which we term 'biological' metaanalysis. Our ten questions are aimed at enabling a biologist to evaluate whether a biological meta-analysis embodies 'mega-enlightenment', a 'mega-mistake', or something in between.
引用
收藏
页数:14
相关论文
共 50 条
[31]   Uses and misuses of meta-analysis in plant ecology [J].
Koricheva, Julia ;
Gurevitch, Jessica .
JOURNAL OF ECOLOGY, 2014, 102 (04) :828-844
[32]   Handling effect size dependency in meta-analysis [J].
Gucciardi, Daniel F. ;
Lines, Robin L. J. ;
Ntoumanis, Nikos .
INTERNATIONAL REVIEW OF SPORT AND EXERCISE PSYCHOLOGY, 2022, 15 (01) :152-178
[33]   Reward-Driven Distraction: A Meta-Analysis [J].
Rusz, Dorottya ;
Le Pelley, Mike E. ;
Kompier, Michiel A. J. ;
Mait, Leon ;
Bijleveld, Erik .
PSYCHOLOGICAL BULLETIN, 2020, 146 (10) :872-899
[34]   The Antecedents and Outcomes of Workplace Ostracism: A Meta-Analysis [J].
Howard, Matt C. ;
Cogswell, Joshua E. ;
Smith, Mickey B. .
JOURNAL OF APPLIED PSYCHOLOGY, 2020, 105 (06) :577-596
[35]   Methods for detecting, quantifying, and adjusting for dissemination bias in meta-analysis are described [J].
Mueller, Katharina Felicitas ;
Meerpohl, Joerg J. ;
Briel, Matthias ;
Antes, Gerd ;
von Elm, Erik ;
Lang, Britta ;
Motschall, Edith ;
Schwarzer, Guido ;
Bassler, Dirk .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2016, 80 :25-33
[36]   Meta-analysis [J].
Cleophas, Ton J. ;
Zwinderman, Aeilko H. .
CIRCULATION, 2007, 115 (22) :2870-2875
[37]   Understanding and evaluating meta-analysis [J].
Dawson, Deborah V. ;
Pihlstrom, Bruce L. ;
Blanchette, Derek R. .
JOURNAL OF THE AMERICAN DENTAL ASSOCIATION, 2016, 147 (04) :264-270
[38]   A Guide to Conducting a Meta-Analysis [J].
Cheung, Mike W. -L. ;
Vijayakumar, Ranjith .
NEUROPSYCHOLOGY REVIEW, 2016, 26 (02) :121-128
[39]   Unemployment and health: A meta-analysis [J].
Picchio, Matteo ;
Ubaldi, Michele .
JOURNAL OF ECONOMIC SURVEYS, 2024, 38 (04) :1437-1472
[40]   Systematic review and meta-analysis [J].
Delgado-Rodriguez, M. ;
Sillero-Arenas, M. .
MEDICINA INTENSIVA, 2018, 42 (07) :444-453