Don't let spurious accusations of pseudoreplication limit our ability to learn from natural experiments (and other messy kinds of ecological monitoring)

被引:225
作者
Davies, G. Matt [1 ]
Gray, Alan [2 ]
机构
[1] Ohio State Univ, Sch Environm & Nat Resources, Columbus, OH 43210 USA
[2] NERC Ctr Ecol & Hydrol, Penicuik EH26 0QB, Midlothian, Scotland
来源
ECOLOGY AND EVOLUTION | 2015年 / 5卷 / 22期
关键词
Bayesian statistics; confounded effects; hypothesis formation; nesting; peer review; P-values; random effects; scientific publication; statistical population; REGENERATION; FOREST;
D O I
10.1002/ece3.1782
中图分类号
Q14 [生态学(生物生态学)];
学科分类号
071012 ; 0713 ;
摘要
Pseudoreplication is defined as the use of inferential statistics to test for treatment effects where treatments are not replicated and/or replicates are not statistically independent. It is a genuine but controversial issue in ecology particularly in the case of costly landscape-scale manipulations, behavioral studies where ethics or other concerns may limit sample sizes, ad hoc monitoring data, and the analysis of natural experiments where chance events occur at a single site. Here key publications on the topic are reviewed to illustrate the debate that exists about the conceptual validity of pseudoreplication. A survey of ecologists and case studies of experimental design and publication issues are used to explore the extent of the problem, ecologists' solutions, reviewers' attitudes, and the fate of submitted manuscripts. Scientists working across a range of ecological disciplines regularly come across the problem of pseudoreplication and build solutions into their designs and analyses. These include carefully defining hypotheses and the population of interest, acknowledging the limits of statistical inference and using statistical approaches including nesting and random effects. Many ecologists face considerable challenges getting their work published if accusations of pseudoreplication are made - even if the problem has been dealt with. Many reviewers reject papers for pseudoreplication, and this occurs more often if they haven't experienced the issue themselves. The concept of pseudoreplication is being applied too dogmatically and often leads to rejection during review. There is insufficient consideration of the associated philosophical issues and potential statistical solutions. By stopping the publication of ecological studies, reviewers are slowing the pace of ecological research and limiting the scope of management case studies, natural events studies, and valuable data available to form evidence-based solutions. Recommendations for fair and consistent treatment of pseudoreplication during writing and review are given for authors, reviewers, and editors.
引用
收藏
页码:5295 / 5304
页数:10
相关论文
共 29 条
  • [1] A new method for non-parametric multivariate analysis of variance
    Anderson, MJ
    [J]. AUSTRAL ECOLOGY, 2001, 26 (01) : 32 - 46
  • [2] [Anonymous], 2013, HDB META ANAL ECOLOG
  • [3] [Anonymous], AM J BOT
  • [4] [Anonymous], J COMP PSYCHOL
  • [5] Bates D., 2014, lme4: Linear mixedeffects models using Eigen and S4
  • [6] Comment to Oksanen (2001): reconciling Oksanen (2001) and Hurlbert (1984)
    Cottenie, K
    De Meester, L
    [J]. OIKOS, 2003, 100 (02) : 394 - 396
  • [7] Winter desiccation and rapid changes in the live fuel moisture content of Calluna vulgaris
    Davies, G. M.
    Legg, C. J.
    O'Hara, R.
    MacDonald, A. J.
    Smith, A. A.
    [J]. PLANT ECOLOGY & DIVERSITY, 2010, 3 (03) : 289 - 299
  • [8] Changes in vegetation diversity and composition following livestock removal along an upland elevational gradient
    Davies, G. Matt
    Bodart, Julien
    [J]. IFOREST-BIOGEOSCIENCES AND FORESTRY, 2015, 8 : 582 - 589
  • [9] P values, hypothesis testing, and model selection: it's deja vu all over again1
    Ellison, Aaron M.
    Gotelli, Nicholas J.
    Inouye, Brian D.
    Strong, Donald R.
    [J]. ECOLOGY, 2014, 95 (03) : 609 - 610
  • [10] Channel narrowing and vegetation development following a Great Plains flood
    Friedman, JM
    Osterkamp, WR
    Lewis, WM
    [J]. ECOLOGY, 1996, 77 (07) : 2167 - 2181