Verification and Calibration of Neighborhood and Object-Based Probabilistic Precipitation Forecasts from a Multimodel Convection-Allowing Ensemble

Abstract

Neighborhood and object-based probabilistic precipitation forecasts from a convection-allowing ensemble are verified and calibrated. Calibration methods include logistic regression, one- and two-parameter reliability-based calibration, and cumulative distribution function (CDF)-based bias adjustment. Newly proposed object-based probabilistic forecasts for the occurrence of a forecast object are derived from the percentage of ensemble members with a matching object. Verification and calibration of single- and multimodel subensembles are performed to explore the effect of using multiple models. The uncalibrated neighborhood-based probabilistic forecasts have skill minima during the afternoon convective maximum. Calibration generally improves the skill, especially during the skill minima, resulting in positive skill. In general all calibration methods perform similarly, with a slight advantage of logistic regression (one-parameter reliability based) calibration for 1-h (6 h) accumulations. The uncalibrated object-based probabilistic forecasts are, in general, less skillful than the uncalibrated neighborhood-based probabilistic forecasts. Object-based calibration also results in positive skill at all lead times. For object-based calibration the skill is significantly different among the calibration methods, with the logistic regression performing the best and CDF-based bias adjustment performing the worst. For both the neighborhood and object-based probabilistic forecasts, the impact of using 10 or 25 days of training data for calibration is generally small and is most significant for the two-parameter reliability-based method. An uncalibrated Advanced Research Weather Research and Forecasting Model (ARW-WRF) subensemble is significantly more skillful than an uncalibrated WRF Nonhydrostatic Mesoscale Model (NMM) subensemble. The difference is reduced by calibration. The multimodel subensemble only shows an advantage for the neighborhood-based forecasts beyond 1-day lead time and shows no advantage for the object-based forecasts.