Benchmarking Performance Changes in the Simulation of Extratropical Modes of Variability across CMIP Generations

We evaluate extratropical modes of variability in the three most recent phases of the Coupled Model Intercomparison Project (CMIP3, CMIP5, and CMIP6) to gauge improvement of climate models over time. A suite of high-level metrics is employed to objectively evaluate how well climate models simulate the observed northern annular mode (NAM), North Atlantic Oscillation (NAO), Pacific-North America pattern (PNA), southern annular mode (SAM), Pacific decadal oscillation (PDO), North Pacific Oscillation (NPO), and North Pacific Gyre Oscillation (NPGO). We apply a common basis function (CBF) approach that projects model anomalies onto observed empirical orthogonal functions (EOFs), together with the traditional EOF approach, to CMIP Historical and AMIP models. We find simulated spatial patterns of those modes have been significantly improved in the newer models, although the skill improvement is sensitive to the mode and season considered. We identify some potential contributions to the pattern improvement of certain modes (e.g., the Southern Hemisphere jet and high-top vertical coordinate); however, the performance changes are likely attributed to gradual improvement of the base climate and multiple relevant processes. Less performance improvement is evident in the mode amplitude of these modes and systematic overestimation of the mode amplitude in spring remains in the newer climate models. We find that the postdominant season amplitude errors in atmospheric modes are not limited to coupled runs but are often already evident in AMIP simulations. This suggests that rectifying the egregious postdominant season amplitude errors found in many models can be addressed in an atmospheric-only framework, making it more tractable to address in the model development process.