Meta-evaluation of meta-analysis: ten appraisal questions for biologists

被引:391
作者
Nakagawa, Shinichi [1 ,2 ,3 ]
Noble, Daniel W. A. [1 ,2 ]
Senior, Alistair M. [4 ,5 ]
Lagisz, Malgorzata [1 ,2 ]
机构
[1] Univ New South Wales, Evolut & Ecol Res Ctr, Sydney, NSW 2052, Australia
[2] Univ New South Wales, Sch Biol Earth & Environm Sci, Sydney, NSW 2052, Australia
[3] Garvan Inst Med Res, Diabet & Metabol Div, 384 Victoria St, Sydney, NSW 2010, Australia
[4] Univ Sydney, Charles Perkins Ctr, Sydney, NSW 2006, Australia
[5] Univ Sydney, Sch Math & Stat, Sydney, NSW 2006, Australia
基金
澳大利亚研究理事会;
关键词
Effect size; Biological importance; Non-independence; Meta-regression; Meta-research; Publication bias; Quantitative synthesis; Reporting bias; Statistical significance; Systematic review; PUBLICATION BIAS; LIFE EXTENSION; EFFECT SIZE; CUMULATIVE METAANALYSIS; ASSESSING HETEROGENEITY; SYSTEMATIC REVIEWS; RESPONSE RATIOS; TEMPORAL TRENDS; MASS-PRODUCTION; ECOLOGY;
D O I
10.1186/s12915-017-0357-7
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Meta-analysis is a statistical procedure for analyzing the combined data from different studies, and can be a major source of concise up-to-date information. The overall conclusions of a meta-analysis, however, depend heavily on the quality of the meta-analytic process, and an appropriate evaluation of the quality of metaanalysis (meta-evaluation) can be challenging. We outline ten questions biologists can ask to critically appraise a meta-analysis. These questions could also act as simple and accessible guidelines for the authors of meta-analyses. We focus on meta-analyses using nonhuman species, which we term 'biological' metaanalysis. Our ten questions are aimed at enabling a biologist to evaluate whether a biological meta-analysis embodies 'mega-enlightenment', a 'mega-mistake', or something in between.
引用
收藏
页数:14
相关论文
共 50 条
[41]   Systematic review and meta-analysis [J].
Delgado-Rodriguez, M. ;
Sillero-Arenas, M. .
MEDICINA INTENSIVA, 2018, 42 (07) :444-453
[42]   Meta-analysis: a critical appraisal of the methodology, benefits and drawbacks [J].
Khan, Shahjahan ;
Memon, Breda ;
Memon, Muhammed A. .
BRITISH JOURNAL OF HOSPITAL MEDICINE, 2019, 80 (11) :636-641
[43]   Systematic review and meta-analysis [J].
Galanis, P. .
ARCHIVES OF HELLENIC MEDICINE, 2009, 26 (06) :826-841
[44]   Ten simple rules for interpreting and evaluating a meta-analysis [J].
Carlson, Rebecca B. ;
Martin, Jennifer R. ;
Beckett, Robert D. .
PLOS COMPUTATIONAL BIOLOGY, 2023, 19 (09)
[45]   Power dressing and meta-analysis: incorporating power analysis into meta-analysis [J].
Muncer, S ;
Taylor, S ;
Craigie, M .
JOURNAL OF ADVANCED NURSING, 2002, 38 (03) :274-280
[46]   Participant characteristics predicting communication outcomes in AAC implementation for individuals with ASD and ;DD: a systematic review and meta-analysis [J].
Ganz, J. B. ;
Pustejovsky, James E. ;
Reichle, Joe ;
Vannest, Kimberly J. ;
Foster, Margaret ;
Pierson, Lauren M. ;
Wattanawongwan, Sanikan ;
Bernal, Armando J. ;
Chen, Man ;
Haas, April N. ;
Liao, Ching-Yi ;
Sallese, Mary Rose ;
Skov, Rachel ;
Smith, S. D. .
AUGMENTATIVE AND ALTERNATIVE COMMUNICATION, 2023, 39 (01) :7-22
[47]   Four Best Practices for Meta-Analysis: A Systematic Review of Methodological Rigor in Mathematics Interventions for Students With or at Risk of Disabilities [J].
Park, Soyoung ;
Lee, Young Ri ;
Nelson, Gena ;
Tipton, Elizabeth .
LEARNING DISABILITY QUARTERLY, 2024, 47 (04) :234-246
[48]   Demographics as predictors of suicidal thoughts and behaviors: A meta-analysis [J].
Huang, Xieyining ;
Ribeiro, Jessica D. ;
Musacchio, Katherine M. ;
Franklin, Joseph C. .
PLOS ONE, 2017, 12 (07)
[49]   The Space-Time Congruency Effect: A Meta-Analysis [J].
von Sobbe, Linda ;
Scheifele, Edith ;
Maienborn, Claudia ;
Ulrich, Rolf .
COGNITIVE SCIENCE, 2019, 43 (01)
[50]   A meta-analysis of mental rotation in the first years of life [J].
Enge, Alexander ;
Kapoor, Shreya ;
Kieslinger, Anne-Sophie ;
Skeide, Michael A. .
DEVELOPMENTAL SCIENCE, 2023, 26 (06)