Lagged ensemble vs burst sampling strategy for initializing sub-seasonal forecasts

Author(s):  
Frederic Vitart

<p>The WWRP/WCRP Sub-seasonal to Seasonal Prediction (S2S) database contains real-time and re-forecasts from 11 operational centres. Several S2S models are initialized frequently with a small ensemble size (e.g. 4 ensemble members every day). In order to inflate the ensemble size, real-time forecasts are produced by combining all the forecasts produced over a window of several days to produce a “lagged ensemble” in which ensemble members have different lead times. The other S2S models are initialized less frequently (e.g. once or twice a week) but with a large ensemble size (e.g. 51 members). This initialization strategy is referred to as “burst sampling”. Both strategies have advantages and inconvenience and it is not clear which strategy is optimal for sub-seasonal prediction. <br>The ECMWF sub-seasonal forecasts are produced using the burst-sampling strategy: a 51-member ensemble is run twice a week (every Monday and Thursday). A large set of re-forecasts, run on a daily basis, have been produced to assess the potential benefit of replacing this current ensemble configuration by a lagged-ensemble approach. We are interested in answering the following two questions, if the current 51-member ensemble run twice a week is replaced by a sub-seasonal ensemble run every day with an ensemble size Ne:</p><p>• What is the minimum value of Ne so that there is a lagged ensemble forecast (Nd forecast days combined) which is at least as skilful as the current system on Mondays and Thursdays?</p><p>• For a given value of Ne, what is the optimal number Nd of forecast days to combine? Greater values of Nd produce larger lagged ensemble size, but also reduce the accuracy of the forecasts by adding ensemble members with older start dates. </p><p>Results indicate that:</p><p>1. A lagged ensemble is more beneficial in the Tropics than in the Northern Extratropics particularly for shorter lead times (weeks 1 and 2).  </p><p>2. The minimum daily ensemble size to produce sub-seasonal forecasts (beyond week 1) at least as skilful as the current ECMWF forecasts on Mondays and Thursdays is Ne=20 with an optimal number of lag days Nd=3. The values of Ne (Nd) decrease (increase) with increased lead time. </p><p>These results suggest that a lagged-ensemble could be a viable alternative to the current ensemble extended-range forecasting system at ECMWF. </p>

2009 ◽  
Vol 24 (3) ◽  
pp. 812-828 ◽  
Author(s):  
Young-Mi Min ◽  
Vladimir N. Kryjov ◽  
Chung-Kyu Park

Abstract A probabilistic multimodel ensemble prediction system (PMME) has been developed to provide operational seasonal forecasts at the Asia–Pacific Economic Cooperation (APEC) Climate Center (APCC). This system is based on an uncalibrated multimodel ensemble, with model weights inversely proportional to the errors in forecast probability associated with the model sampling errors, and a parametric Gaussian fitting method for the estimate of tercile-based categorical probabilities. It is shown that the suggested method is the most appropriate for use in an operational global prediction system that combines a large number of models, with individual model ensembles essentially differing in size and model weights in the forecast and hindcast datasets being inconsistent. Justification for the use of a Gaussian approximation of the precipitation probability distribution function for global forecasts is also provided. PMME retrospective and real-time forecasts are assessed. For above normal and below normal categories, temperature forecasts outperform climatology for a large part of the globe. Precipitation forecasts are definitely more skillful than random guessing for the extratropics and climatological forecasts for the tropics. The skill of real-time forecasts lies within the range of the interannual variability of the historical forecasts.


2013 ◽  
Vol 141 (10) ◽  
pp. 3477-3497 ◽  
Author(s):  
Mingyue Chen ◽  
Wanqiu Wang ◽  
Arun Kumar

Abstract An analysis of lagged ensemble seasonal forecasts from the National Centers for Environmental Prediction (NCEP) Climate Forecast System, version 2 (CFSv2), is presented. The focus of the analysis is on the construction of lagged ensemble forecasts with increasing lead time (thus allowing use of larger ensemble sizes) and its influence on seasonal prediction skill. Predictions of seasonal means of sea surface temperature (SST), 200-hPa height (z200), precipitation, and 2-m air temperature (T2m) over land are analyzed. Measures of prediction skill include deterministic (anomaly correlation and mean square error) and probabilistic [rank probability skill score (RPSS)]. The results show that for a fixed lead time, and as one would expect, the skill of seasonal forecast improves as the ensemble size increases, while for a fixed ensemble size the forecast skill decreases as the lead time becomes longer. However, when a forecast is based on a lagged ensemble, there exists an optimal lagged ensemble time (OLET) when positive influence of increasing ensemble size and negative influence due to an increasing lead time result in a maximum in seasonal prediction skill. The OLET is shown to depend on the geographical location and variable. For precipitation and T2m, OLET is relatively longer and skill gain is larger than that for SST and tropical z200. OLET is also dependent on the skill measure with RPSS having the longest OLET. Results of this analysis will be useful in providing guidelines on the design and understanding relative merits for different configuration of seasonal prediction systems.


2012 ◽  
Vol 27 (1) ◽  
pp. 3-27 ◽  
Author(s):  
K. P. Sooraj ◽  
H. Annamalai ◽  
Arun Kumar ◽  
Hui Wang

Abstract The 15-member ensemble hindcasts performed with the National Centers for Environmental Prediction Climate Forecast System (CFS) for the period 1981–2005, as well as real-time forecasts for the period 2006–09, are assessed for seasonal prediction skills over the tropics, from deterministic (anomaly correlation), categorical (Heidke skill score), and probabilistic (rank probability skill score) perspectives. Further, persistence, signal-to-noise ratio, and root-mean-square error analyses are also performed. The CFS demonstrates high skill in forecasting El Niño–Southern Oscillation (ENSO) related sea surface temperature (SST) anomalies during developing and mature phases, including that of different types of El Niño. During ENSO, the space–time evolution of anomalous SST, 850-hPa wind, and rainfall along the equatorial Pacific, as well as the mechanisms involved in the teleconnection to the tropical Indian Ocean, are also well represented. During ENSO phase transition and in the summer, the skill of forecasting Pacific SST anomalies is modest. An examination of CFS ability in forecasting seasonal rainfall anomalies over the U.S. Affiliated Pacific Islands (USAPI) indicates that forecasting the persistence of dryness from El Niño winter into the following spring/summer is skillful at leads > 3 months. During strong El Niño years the persistence is predicted by all members with a 6-month lead time. Also, the model is skillful in predicting regional rainfall responses during different types of El Niño. Since both deterministic and probabilistic skill scores converge, the suggestion is that the forecast is useful. The model’s skill in the real-time forecasts for the period 2006–09 is also discussed. The results suggest the feasibility that a dynamical-system-based seasonal prediction of precipitation over the USAPI can be considered.


Author(s):  
Philip E. Bett ◽  
Gill M. Martin ◽  
Nick Dunstone ◽  
Adam A. Scaife ◽  
Hazel E. Thornton ◽  
...  

AbstractSeasonal forecasts for Yangtze River basin rainfall in June, May–June–July (MJJ), and June–July–August (JJA) 2020 are presented, based on the Met Office GloSea5 system. The three-month forecasts are based on dynamical predictions of an East Asian Summer Monsoon (EASM) index, which is transformed into regional-mean rainfall through linear regression. The June rainfall forecasts for the middle/lower Yangtze River basin are based on linear regression of precipitation. The forecasts verify well in terms of giving strong, consistent predictions of above-average rainfall at lead times of at least three months. However, the Yangtze region was subject to exceptionally heavy rainfall throughout the summer period, leading to observed values that lie outside the 95% prediction intervals of the three-month forecasts. The forecasts presented here are consistent with other studies of the 2020 EASM rainfall, whereby the enhanced mei-yu front in early summer is skillfully forecast, but the impact of midlatitude drivers enhancing the rainfall in later summer is not captured. This case study demonstrates both the utility of probabilistic seasonal forecasts for the Yangtze region and the potential limitations in anticipating complex extreme events driven by a combination of coincident factors.


2020 ◽  
Vol 156 (1) ◽  
Author(s):  
Santiago E. Alvarez ◽  
Sarah M. Lein

Abstract Using online data for prices and real-time debit card transaction data on changes in expenditures for Switzerland allows us to track inflation on a daily basis. While the daily price index fluctuates around the official price index in normal times, it drops immediately after the lockdown related to the COVID19 pandemic. Official statistics reflect this drop only with a lag, specifically because data collection takes time and is impeded by lockdown conditions. Such daily real-time information can be useful to gauge the relative importance of demand and supply shocks and thus inform policymakers who need to determine appropriate policy measures.


2013 ◽  
Vol 141 (3) ◽  
pp. 1099-1117 ◽  
Author(s):  
Andrew Charles ◽  
Bertrand Timbal ◽  
Elodie Fernandez ◽  
Harry Hendon

Abstract Seasonal predictions based on coupled atmosphere–ocean general circulation models (GCMs) provide useful predictions of large-scale circulation but lack the conditioning on topography required for locally relevant prediction. In this study a statistical downscaling model based on meteorological analogs was applied to continental-scale GCM-based seasonal forecasts and high quality historical site observations to generate a set of downscaled precipitation hindcasts at 160 sites in the South Murray Darling Basin region of Australia. Large-scale fields from the Predictive Ocean–Atmosphere Model for Australia (POAMA) 1.5b GCM-based seasonal prediction system are used for analog selection. Correlation analysis indicates modest levels of predictability in the target region for the selected predictor fields. A single best-match analog was found using model sea level pressure, meridional wind, and rainfall fields, with the procedure applied to 3-month-long reforecasts, initialized on the first day of each month from 1980 to 2006, for each model day of 10 ensemble members. Assessment of the total accumulated rainfall and number of rainy days in the 3-month reforecasts shows that the downscaling procedure corrects the local climate variability with no mean effect on predictive skill, resulting in a smaller magnitude error. The amount of total rainfall and number of rain days in the downscaled output is significantly improved over the direct GCM output as measured by the difference in median and tercile thresholds between station observations and downscaled rainfall. Confidence in the downscaled output is enhanced by strong consistency between the large-scale mean of the downscaled and direct GCM precipitation.


2019 ◽  
Vol 32 (3) ◽  
pp. 957-972 ◽  
Author(s):  
Takeshi Doi ◽  
Swadhin K. Behera ◽  
Toshio Yamagata

This paper explores merits of 100-ensemble simulations from a single dynamical seasonal prediction system by evaluating differences in skill scores between ensembles predictions with few (~10) and many (~100) ensemble members. A 100-ensemble retrospective seasonal forecast experiment for 1983–2015 is beyond current operational capability. Prediction of extremely strong ENSO and the Indian Ocean dipole (IOD) events is significantly improved in the larger ensemble. It indicates that the ensemble size of 10 members, used in some operational systems, is not adequate for the occurrence of 15% tails of extreme climate events, because only about 1 or 2 members (approximately 15% of 12) will agree with the observations. We also showed an ensemble size of about 50 members may be adequate for the extreme El Niño and positive IOD predictions at least in the present prediction system. Even if running a large-ensemble prediction system is quite costly, improved prediction of disastrous extreme events is useful for minimizing risks of possible human and economic losses.


2013 ◽  
Vol 17 (6) ◽  
pp. 2359-2373 ◽  
Author(s):  
E. Dutra ◽  
F. Di Giuseppe ◽  
F. Wetterhall ◽  
F. Pappenberger

Abstract. Vast parts of Africa rely on the rainy season for livestock and agriculture. Droughts can have a severe impact in these areas, which often have a very low resilience and limited capabilities to mitigate drought impacts. This paper assesses the predictive capabilities of an integrated drought monitoring and seasonal forecasting system (up to 5 months lead time) based on the Standardized Precipitation Index (SPI). The system is constructed by extending near-real-time monthly precipitation fields (ECMWF ERA-Interim reanalysis and the Climate Anomaly Monitoring System–Outgoing Longwave Radiation Precipitation Index, CAMS-OPI) with monthly forecasted fields as provided by the ECMWF seasonal forecasting system. The forecasts were then evaluated over four basins in Africa: the Blue Nile, Limpopo, Upper Niger, and Upper Zambezi. There are significant differences in the quality of the precipitation between the datasets depending on the catchments, and a general statement regarding the best product is difficult to make. The generally low number of rain gauges and their decrease in the recent years limits the verification and monitoring of droughts in the different basins, reinforcing the need for a strong investment on climate monitoring. All the datasets show similar spatial and temporal patterns in southern and north-western Africa, while there is a low correlation in the equatorial area, which makes it difficult to define ground truth and choose an adequate product for monitoring. The seasonal forecasts have a higher reliability and skill in the Blue Nile, Limpopo and Upper Niger in comparison with the Zambezi. This skill and reliability depend strongly on the SPI timescale, and longer timescales have more skill. The ECMWF seasonal forecasts have predictive skill which is higher than using climatology for most regions. In regions where no reliable near-real-time data is available, the seasonal forecast can be used for monitoring (first month of forecast). Furthermore, poor-quality precipitation monitoring products can reduce the potential skill of SPI seasonal forecasts in 2 to 4 months lead time.


2014 ◽  
Vol 15 (2) ◽  
pp. 529-550 ◽  
Author(s):  
Johnna M. Infanti ◽  
Ben P. Kirtman

Abstract The present study investigates the predictive skill of the North American Multi-Model Ensemble (NMME) system for intraseasonal-to-interannual (ISI) prediction with focus on southeastern U.S. precipitation. The southeastern United States is of particular interest because of the typically short-lived nature of above- and below-normal extended rainfall events allowing for focus on seasonal prediction, as well as the tendency for more predictability in the winter months. Included in this study is analysis of the forecast quality of the NMME system when predicting above- and below-normal rainfall and individual rainfall events, with particular emphasis on results from the 2007 dry period. Both deterministic and probabilistic measures of skill are utilized in order to gain a more complete understanding of how accurately the system predicts precipitation at both short and long lead times and to investigate the multimodel aspect of the system as compared to using an individual predictive model. The NMME system consistently shows low systematic error and relatively high skill in predicting precipitation, particularly in winter months as compared to individual model results.


Sign in / Sign up

Export Citation Format

Share Document