Validation of Ensemble-Based Probabilistic Tropical Cyclone Intensity Change

Although there has been substantial improvement to numerical weather prediction models, accurate predictions of tropical cyclone rapid intensification (RI) remain elusive. The processes that govern RI, such as convection, may be inherently less predictable; therefore a probabilistic approach should be adopted. Although there have been numerous studies that have evaluated probabilistic intensity (i.e., maximum wind speed) forecasts from high resolution models, or statistical RI predictions, there has not been a comprehensive analysis of high-resolution ensemble predictions of various intensity change thresholds. Here, ensemble-based probabilities of various intensity changes are computed from experimental Hurricane Weather Research and Forecasting (HWRF) and Hurricanes in a Multi-scale Ocean-coupled Non-hydrostatic (HMON) models that were run for select cases during the 2017-2019 seasons and verified against best track data. Both the HWRF and HMON ensemble systems simulate intensity changes consistent with RI (30 knots 24 h(-1); 15.4 m s(-1) 24 h(-1)) less frequent than observed, do not provide reliable probabilistic predictions, and are less skillful probabilistic forecasts relative to the Statistical Hurricane Intensity Prediction System Rapid Intensification Index (SHIPS-RII) and Deterministic to Probabilistic Statistical (DTOPS) statistical-dynamical systems. This issue is partly alleviated by applying a quantile-based bias correction scheme that preferentially adjusts the model-based intensity change at the upper-end of intensity changes. While such an approach works well for high-resolution models, this bias correction strategy does not substantially improve ECMWF ensemble-based probabilistic predictions. By contrast, both the HWRF and HMON systems provide generally reliable predictions of intensity changes for cases where RI does not take place. Combining the members from the HWRF and HMON ensemble systems into a large multi-model ensemble does not improve upon HMON probablistic forecasts.