Evaluation of Atmospheric Fields from the ECMWF Seasonal Forecasts over a 15-Year Period

Abstract

Since 1997, the European Centre for Medium-Range Weather Forecasts (ECMWF) has made seasonal forecasts with ensembles of a coupled ocean–atmosphere model, System-1 (S1). In January 2002, a new version, System-2 (S2), was introduced. For the calibration of these models, hindcasts have been performed starting in 1987, so that 15 yr of hindcasts and forecasts are now available for verification. The main cause of seasonal predictability is El Niño and La Niña perturbing the average weather in many regions and seasons throughout the world. As a baseline to compare the dynamical models with, a set of simple statistical models (STAT) is constructed. These are based on persistence and a lagged regression with the first few EOFs of SST from 1901 to 1986 wherever the correlations are significant. The first EOF corresponds to ENSO, and the second corresponds to decadal ENSO. The temperature model uses one EOF, the sea level pressure (SLP) model uses five EOFs, and the precipitation model uses two EOFs but excludes persistence. As the number of verification data points is very low (15), the simplest measure of skill is used: the correlation coefficient of the ensemble mean. To further reduce the sampling uncertainties, we restrict ourselves to areas and seasons of known ENSO teleconnections. The dynamical ECMWF models show better skill in 2-m temperature forecasts over sea and the tropical land areas than STAT, but the modeled ENSO teleconnection pattern to North America is shifted relative to observations, leading to little pointwise skill. Precipitation forecasts of the ECMWF models are very good, better than those of the statistical model, in southeast Asia, the equatorial Pacific, and the Americas in December–February. In March–May the skill is lower. Overall, S1 (S2) shows better skill than STAT at lead time of 2 months in 29 (32) out of 40 regions and seasons of known ENSO teleconnections.