Species distribution models rarely predict the biology of real populations

Species distribution models (SDMs) are widely used in ecology. In theory, SDMs capture (at least part of) species' ecological niches and can be used to make inferences about the distribution of suitable habitat for species of interest. Because habitat suitability is expected to influence population demography, SDMs have been used to estimate a variety of population parameters, from occurrence to genetic diversity. However, a critical look at the ability of SDMs to predict independent data across different aspects of population biology is lacking. Here, we systematically reviewed the literature, retrieving 201 studies that tested predictions from SDMs against independent assessments of occurrence, abundance, population performance, and genetic diversity. Although there is some support for the ability of SDMs to predict occurrence (similar to 53% of studies depending on how support was assessed), the predictive performance of these models declines progressively from occurrence to abundance, to population mean fitness, to genetic diversity. At the same time, we observed higher success among studies that evaluated performance for single versus multiple species, pointing to a possible publication bias. Thus, the limited accuracy of SDMs reported here may reflect the best-case scenario. We discuss the limitations of these models and provide specific recommendations for their use for different applications going forward. However, we emphasize that predictions from SDMs, especially when used to inform conservation decisions, should be treated as hypotheses to be tested with independent data rather than as stand-ins for the population parameters we seek to know.