scholarly journals Relative effects of statistical preprocessing and postprocessing on a regional hydrological ensemble prediction system

Author(s):  
Sanjib Sharma ◽  
Ridwan Siddique ◽  
Seann Reed ◽  
Peter Ahnert ◽  
Pablo Mendoza ◽  
...  

Abstract. The relative roles of statistical weather preprocessing and streamflow postprocessing in hydrological ensemble forecasting at short- to medium-range forecast lead times (day 1–7) are investigated. For this purpose, a regional hydrologic ensemble prediction system (RHEPS) is developed and implemented. The RHEPS is comprised by the following components: i) hydrometeorological observations (multisensor precipitation estimates, gridded surface temperature, and gauged streamflow); ii) weather ensemble forecasts (precipitation and near-surface temperature) from the National Centers for Environmental Prediction 11-member Global Ensemble Forecast System Reforecast version 2 (GEFSRv2); iii) NOAA’s Hydrology Laboratory-Research Distributed Hydrologic Model (HL-RDHM); iv) heteroscedastic censored logistic regression (HCLR) as the statistical preprocessor; v) two statistical postprocessors, an autoregressive model with a single exogenous variable (ARX(1,1)) and quantile regression (QR); and vi) a comprehensive verification strategy. To implement the RHEPS, 1 to 7 days weather forecasts from the GEFSRv2 are used to force HL-RDHM and generate raw ensemble streamflow forecasts. Forecasting experiments are conducted in four nested basins in the U.S. middle Atlantic region, ranging in size from 381 to 12,362 km2. Results show that the HCLR preprocessed ensemble precipitation forecasts have greater skill than the raw forecasts. These improvements are more noticeable in the warm season at the longer lead times (> 3 days). Both postprocessors, ARX(1,1) and QR, show gains in skill relative to the raw ensemble flood forecasts but QR outperforms ARX(1,1). Preprocessing alone has little effect on improving the skill of the ensemble flood forecasts. Indeed, postprocessing alone performs similar, in terms of the relative mean error, skill, and reliability, to the more involved scenario that includes both preprocessing and postprocessing. We conclude that statistical preprocessing may not always be a necessary component of the ensemble flood forecasting chain.

2018 ◽  
Vol 22 (3) ◽  
pp. 1831-1849 ◽  
Author(s):  
Sanjib Sharma ◽  
Ridwan Siddique ◽  
Seann Reed ◽  
Peter Ahnert ◽  
Pablo Mendoza ◽  
...  

Abstract. The relative roles of statistical weather preprocessing and streamflow postprocessing in hydrological ensemble forecasting at short- to medium-range forecast lead times (day 1–7) are investigated. For this purpose, a regional hydrologic ensemble prediction system (RHEPS) is developed and implemented. The RHEPS is comprised of the following components: (i) hydrometeorological observations (multisensor precipitation estimates, gridded surface temperature, and gauged streamflow); (ii) weather ensemble forecasts (precipitation and near-surface temperature) from the National Centers for Environmental Prediction 11-member Global Ensemble Forecast System Reforecast version 2 (GEFSRv2); (iii) NOAA's Hydrology Laboratory-Research Distributed Hydrologic Model (HL-RDHM); (iv) heteroscedastic censored logistic regression (HCLR) as the statistical preprocessor; (v) two statistical postprocessors, an autoregressive model with a single exogenous variable (ARX(1,1)) and quantile regression (QR); and (vi) a comprehensive verification strategy. To implement the RHEPS, 1 to 7 days weather forecasts from the GEFSRv2 are used to force HL-RDHM and generate raw ensemble streamflow forecasts. Forecasting experiments are conducted in four nested basins in the US Middle Atlantic region, ranging in size from 381 to 12 362 km2. Results show that the HCLR preprocessed ensemble precipitation forecasts have greater skill than the raw forecasts. These improvements are more noticeable in the warm season at the longer lead times (> 3 days). Both postprocessors, ARX(1,1) and QR, show gains in skill relative to the raw ensemble streamflow forecasts, particularly in the cool season, but QR outperforms ARX(1,1). The scenarios that implement preprocessing and postprocessing separately tend to perform similarly, although the postprocessing-alone scenario is often more effective. The scenario involving both preprocessing and postprocessing consistently outperforms the other scenarios. In some cases, however, the differences between this scenario and the scenario with postprocessing alone are not as significant. We conclude that implementing both preprocessing and postprocessing ensures the most skill improvements, but postprocessing alone can often be a competitive alternative.


2012 ◽  
Vol 27 (3) ◽  
pp. 757-769 ◽  
Author(s):  
James I. Belanger ◽  
Peter J. Webster ◽  
Judith A. Curry ◽  
Mark T. Jelinek

Abstract This analysis examines the predictability of several key forecasting parameters using the ECMWF Variable Ensemble Prediction System (VarEPS) for tropical cyclones (TCs) in the North Indian Ocean (NIO) including tropical cyclone genesis, pregenesis and postgenesis track and intensity projections, and regional outlooks of tropical cyclone activity for the Arabian Sea and the Bay of Bengal. Based on the evaluation period from 2007 to 2010, the VarEPS TC genesis forecasts demonstrate low false-alarm rates and moderate to high probabilities of detection for lead times of 1–7 days. In addition, VarEPS pregenesis track forecasts on average perform better than VarEPS postgenesis forecasts through 120 h and feature a total track error growth of 41 n mi day−1. VarEPS provides superior postgenesis track forecasts for lead times greater than 12 h compared to other models, including the Met Office global model (UKMET), the Navy Operational Global Atmospheric Prediction System (NOGAPS), and the Global Forecasting System (GFS), and slightly lower track errors than the Joint Typhoon Warning Center. This paper concludes with a discussion of how VarEPS can provide much of this extended predictability within a probabilistic framework for the region.


2021 ◽  
Author(s):  
Carlos Velasco-Forero ◽  
Jayaram Pudashine ◽  
Mark Curtis ◽  
Alan Seed

<div> <p>Short-term precipitation forecast plays a vital role for minimizing the adverse effects of heavy precipitation events such as flash flooding.  Radar rainfall nowcasting techniques based on statistical extrapolations are used to overcome current limitations of precipitation forecasts from numerical weather models, as they provide high spatial and temporal resolutions forecasts within minutes of the observation time. Among various algorithms, the Short-Term Ensemble Prediction System (STEPS) provides rainfall fields nowcasts in a probabilistic sense by accounting the uncertainty in the precipitation forecasts by means of ensembles, with spatial and temporal characteristic very similar to those in the observed radar rainfall fields. The Australian Bureau of Meteorology uses STEPS to generate ensembles of forecast rainfall ensembles in real-time from its extensive weather radar network. </p> </div><div> <p>In this study, results of a large probabilistic verification exercise to a new version of STEPS (hereafter named STEPS-3) are reported. An extensive dataset of more than 47000 individual 5-minute radar rainfall fields (the equivalent of more than 163 days of rain) from ten weather radars across Australia (covering tropical to mid-latitude regions) were used to generate (and verify) 96-member rainfall ensembles nowcasts with up to a 90-minute lead time. STEPS-3 was found to be more than 15-times faster in delivering results compared with previous version of STEPS and an open-source algorithm called pySTEPS. Interestingly, significant variations were observed in the quality of predictions and verification results from one radar to other, from one event to other, depending on the characteristics and location of the radar, nature of the rainfall event, accumulation threshold and lead time. For example, CRPS and RMSE of ensembles of 5-min rainfall forecasts for radars located in mid-latitude regions are better (lower) than those ones from radars located in tropical areas for all lead-times. Also, rainfall fields from S-band radars seem to produce rainfall forecasts able to successfully identify extreme rainfall events for lead times up to 10 minutes longer than those produced using C-band radar datasets for the same rain rate thresholds. Some details of the new STEPS-3 version, case studies and examples of the verification results will be presented. </p> </div>


2013 ◽  
Vol 26 (19) ◽  
pp. 7525-7540 ◽  
Author(s):  
Øyvind Breivik ◽  
Ole Johan Aarnes ◽  
Jean-Raymond Bidlot ◽  
Ana Carrasco ◽  
Øyvind Saetra

Abstract A method for estimating return values from ensembles of forecasts at advanced lead times is presented. Return values of significant wave height in the northeast Atlantic, the Norwegian Sea, and the North Sea are computed from archived +240-h forecasts of the ECMWF Ensemble Prediction System (EPS) from 1999 to 2009. Three assumptions are made: First, each forecast is representative of a 6-h interval and collectively the dataset is then comparable to a time period of 226 years. Second, the model climate matches the observed distribution, which is confirmed by comparing with buoy data. Third, the ensemble members are sufficiently uncorrelated to be considered independent realizations of the model climate. Anomaly correlations of 0.20 are found, but peak events (>P97) are entirely uncorrelated. By comparing return values from individual members with return values of subsamples of the dataset it is also found that the estimates follow the same distribution and appear unaffected by correlations in the ensemble. The annual mean and variance over the 11-yr archived period exhibit no significant departures from stationarity compared with a recent reforecast; that is, there is no spurious trend because of model upgrades. The EPS yields significantly higher return values than the 40-yr ECMWF Re-Analysis (ERA-40) and ECMWF Interim Re-Analysis (ERA-Interim) and is in good agreement with the high-resolution 10-km Norwegian Reanalyses (NORA10) hindcast, except in the lee of unresolved islands where EPS overestimates and in enclosed seas where it has low bias. Confidence intervals are half the width of those found for ERA-Interim because of the magnitude of the dataset.


2003 ◽  
Vol 10 (3) ◽  
pp. 261-274 ◽  
Author(s):  
A. Montani ◽  
C. Marsigli ◽  
F. Nerozzi ◽  
T. Paccagnella ◽  
S. Tibaldi ◽  
...  

Abstract. The predictability of the flood event affecting Soverato (Southern Italy) in September 2000 is investigated by considering three different configurations of ECMWF ensemble: the operational Ensemble Prediction System (EPS), the targeted EPS and a high-resolution version of EPS. For each configuration, three successive runs of ECMWF ensemble with the same verification time are grouped together so as to generate a highly-populated "super-ensemble". Then, five members are selected from the super-ensemble and used to provide initial and boundary conditions for the integrations with a limited-area model, whose runs generate a Limited-area Ensemble Prediction System (LEPS). The relative impact of targeting the initial perturbations against increasing the horizontal resolution is assessed for the global ensembles as well as for the properties transferred to LEPS integrations, the attention being focussed on the probabilistic prediction of rainfall over a localised area. At the 108, 84 and 60- hour forecast ranges, the overall performance of the global ensembles is not particularly accurate and the best results are obtained by the high-resolution version of EPS. The LEPS performance is very satisfactory in all configurations and the rainfall maps show probability peaks in the correct regions. LEPS products would have been of great assistance to issue flood risk alerts on the basis of limited-area ensemble forecasts. For the 60-hour forecast range, the sensitivity of the results to the LEPS ensemble size is discussed by comparing a 5-member against a 51-member LEPS, where the limited-area model is nested on all EPS members. Little sensitivity is found as concerns the detection of the regions most likely affected by heavy precipitation, the probability peaks being approximately the same in both configurations.


2010 ◽  
Vol 138 (10) ◽  
pp. 3886-3904 ◽  
Author(s):  
Mark Buehner ◽  
Ahmed Mahidjiba

Abstract This study examines the sensitivity of global ensemble forecasts to the use of different approaches for specifying both the initial ensemble mean and perturbations. The current operational ensemble prediction system of the Meteorological Service of Canada uses the ensemble Kalman filter (EnKF) to define both the ensemble mean and perturbations. To evaluate the impact of different approaches for obtaining the initial ensemble perturbations, the operational EnKF approach is compared with using either no initial perturbations or perturbations obtained using singular vectors (SVs). The SVs are computed using the (dry) total-energy norm with a 48-h optimization time interval. Random linear combinations of 60 SVs are computed for each of three regions. Next, the impact of replacing the initial ensemble mean, currently the EnKF ensemble mean analysis, with the higher-resolution operational four-dimensional variational data assimilation (4D-Var) analysis is evaluated. For this comparison, perturbations are provided by the EnKF. All experiments are performed over two-month periods during both the boreal summer and winter using a system very similar to the global ensemble prediction system that became operational on 10 July 2007. Relative to the operational configuration that relies on the EnKF, the use of SVs to compute initial perturbations produces small, but statistically significant differences in probabilistic forecast scores in favor of the EnKF both in the tropics and, for a limited set of forecast lead times, in the summer hemisphere extratropics, whereas the results are very similar in the winter hemisphere extratropics. Both approaches lead to significantly better ensemble forecasts than with no initial perturbations, though results are quite similar in the tropics when using SVs and no perturbations. The use of an initial-time norm that does not include information on analysis uncertainty and the lack of linearized moist processes in the calculation of the SVs are two factors that limit the quality of the resulting SV-based ensemble forecasts. Relative to the operational configuration, use of the 4D-Var analysis to specify the initial ensemble mean results in improved probabilistic forecast scores during the boreal summer period in the southern extratropics and tropics, but a near-neutral impact otherwise.


2011 ◽  
Vol 8 (2) ◽  
pp. 2739-2782 ◽  
Author(s):  
D. Brochero ◽  
F. Anctil ◽  
C. Gagné

Abstract. Hydrological Ensemble Prediction System (HEPS), obtained by forcing rainfall-runoff models with Meteorological Ensemble Prediction Systems (MEPS), have been recognized as useful approaches to quantify uncertainties of hydrological forecasting systems. This task is complex both in terms of the coupling of information and computational time, which may create an operational barrier. The main objective of the current work is to assess the degree of simplification (reduction of members) of a HEPS configured with 16 lumped hydrological models driven by the 50 weather ensemble forecasts from the European Center for Medium-range Weather Forecasts (ECMWF). Here, the selection of the most relevant members is proposed using a Backward greedy technique with k-fold cross-validation, allowing an optimal use of the information. The methodology draws from a multi-criterion score that represents the combination of resolution, reliability, consistency, and diversity. Results show that the degree of reduction of members can be established in terms of maximum number of members required (complexity of the HEPS) or the maximization of the relationship between the different scores (performance).


2009 ◽  
Vol 6 (4) ◽  
pp. 4891-4917
Author(s):  
J. A. Velázquez ◽  
T. Petit ◽  
A. Lavoie ◽  
M.-A. Boucher ◽  
R. Turcotte ◽  
...  

Abstract. Hydrological forecasting consists in the assessment of future streamflow. Current deterministic forecasts do not give any information concerning the uncertainty, which might be limiting in a decision-making process. Ensemble forecasts are expected to fill this gap. In July 2007, the Meteorological Service of Canada has improved its ensemble prediction system, which has been operational since 1998. It uses the GEM model to generate a 20-member ensemble on a 100 km grid, at mid-latitudes. This improved system is used for the first time for hydrological ensemble predictions. Five watersheds in Quebec (Canada) are studied: Chaudière, Châteauguay, Du Nord, Kénogami and Du Lièvre. An interesting 17-day rainfall event has been selected in October 2007. Forecasts are produced in a 3 h time step for a 3-day forecast horizon. The deterministic forecast is also available and it is compared with the ensemble ones. In order to correct the bias of the ensemble, an updating procedure has been applied to the output data. Results showed that ensemble forecasts are more skilful than the deterministic ones, as measured by the Continuous Ranked Probability Score (CRPS), especially for 72 h forecasts. However, the hydrological ensemble forecasts are under dispersed: a situation that improves with the increasing length of the prediction horizons. We conjecture that this is due in part to the fact that uncertainty in the initial conditions of the hydrological model is not taken into account.


2005 ◽  
Vol 133 (7) ◽  
pp. 1825-1839 ◽  
Author(s):  
A. Arribas ◽  
K. B. Robertson ◽  
K. R. Mylne

Abstract Current operational ensemble prediction systems (EPSs) are designed specifically for medium-range forecasting, but there is also considerable interest in predictability in the short range, particularly for potential severe-weather developments. A possible option is to use a poor man’s ensemble prediction system (PEPS) comprising output from different numerical weather prediction (NWP) centers. By making use of a range of different models and independent analyses, a PEPS provides essentially a random sampling of both the initial condition and model evolution errors. In this paper the authors investigate the ability of a PEPS using up to 14 models from nine operational NWP centers. The ensemble forecasts are verified for a 101-day period and five variables: mean sea level pressure, 500-hPa geopotential height, temperature at 850 hPa, 2-m temperature, and 10-m wind speed. Results are compared with the operational ECMWF EPS, using the ECMWF analysis as the verifying “truth.” It is shown that, despite its smaller size, PEPS is an efficient way of producing ensemble forecasts and can provide competitive performance in the short range. The best relative performance is found to come from hybrid configurations combining output from a small subset of the ECMWF EPS with other different NWP models.


Sign in / Sign up

Export Citation Format

Share Document