A New Method for Assessing the Performance of General Circulation Models Based on Their Ability to Simulate the Response to Observed Forcing

The reliability of general circulation models (GCMs) is commonly associated with their ability to reproduce relevant aspects of observed climate, and thus the evaluation of GCM performance has become a standard practice for climate change studies. As such, there is an ever-growing literature that focuses on developing and evaluating metrics to assess GCM performance. In this paper it is shown that some commonly applied metrics provide little information for discriminating GCMs based on their performance, once uncertainty is included. A new methodology is proposed that differs from common approaches in that it focuses on evaluating GCMs' abilities to reproduce the observed response of surface temperature to changes in external radiative forcing (RF), while controlling for observed and simulated variability. It uses formal statistical tests to evaluate two aspects of the warming trend that are central for climate change studies: 1) if the response to RF produced by a particular GCM is compatible with observations and 2) if the magnitudes of the observed and simulated rates of warming are statistically similar. We illustrate the proposed methodology by evaluating the ability of 21 GCMs to reproduce the observed warming trend at the global scale and for eight subcontinental land domains. Results show that most of the GCMs provide an adequate representation of the observed warming trend for the global scale and for domains located in the Southern Hemisphere. However, GCMs tend to overestimate the warming rate for domains in the Northern Hemisphere, particularly since the mid-1990s.