scholarly journals Relative effects of statistical preprocessing and postprocessing on a regional hydrological ensemble prediction system

2018 ◽  
Vol 22 (3) ◽  
pp. 1831-1849 ◽  
Author(s):  
Sanjib Sharma ◽  
Ridwan Siddique ◽  
Seann Reed ◽  
Peter Ahnert ◽  
Pablo Mendoza ◽  
...  
Keyword(s):  
Surface Temperature ◽  
Warm Season ◽  
Hydrologic Model ◽  
Laboratory Research ◽  
Ensemble Prediction ◽  
Lead Times ◽  
Prediction System ◽  
Ensemble Prediction System ◽  
Near Surface ◽  
Streamflow Forecasts

Abstract. The relative roles of statistical weather preprocessing and streamflow postprocessing in hydrological ensemble forecasting at short- to medium-range forecast lead times (day 1–7) are investigated. For this purpose, a regional hydrologic ensemble prediction system (RHEPS) is developed and implemented. The RHEPS is comprised of the following components: (i) hydrometeorological observations (multisensor precipitation estimates, gridded surface temperature, and gauged streamflow); (ii) weather ensemble forecasts (precipitation and near-surface temperature) from the National Centers for Environmental Prediction 11-member Global Ensemble Forecast System Reforecast version 2 (GEFSRv2); (iii) NOAA's Hydrology Laboratory-Research Distributed Hydrologic Model (HL-RDHM); (iv) heteroscedastic censored logistic regression (HCLR) as the statistical preprocessor; (v) two statistical postprocessors, an autoregressive model with a single exogenous variable (ARX(1,1)) and quantile regression (QR); and (vi) a comprehensive verification strategy. To implement the RHEPS, 1 to 7 days weather forecasts from the GEFSRv2 are used to force HL-RDHM and generate raw ensemble streamflow forecasts. Forecasting experiments are conducted in four nested basins in the US Middle Atlantic region, ranging in size from 381 to 12 362 km2. Results show that the HCLR preprocessed ensemble precipitation forecasts have greater skill than the raw forecasts. These improvements are more noticeable in the warm season at the longer lead times (> 3 days). Both postprocessors, ARX(1,1) and QR, show gains in skill relative to the raw ensemble streamflow forecasts, particularly in the cool season, but QR outperforms ARX(1,1). The scenarios that implement preprocessing and postprocessing separately tend to perform similarly, although the postprocessing-alone scenario is often more effective. The scenario involving both preprocessing and postprocessing consistently outperforms the other scenarios. In some cases, however, the differences between this scenario and the scenario with postprocessing alone are not as significant. We conclude that implementing both preprocessing and postprocessing ensures the most skill improvements, but postprocessing alone can often be a competitive alternative.

scholarly journals Relative effects of statistical preprocessing and postprocessing on a regional hydrological ensemble prediction system

2017 ◽  
Author(s):  
Sanjib Sharma ◽  
Ridwan Siddique ◽  
Seann Reed ◽  
Peter Ahnert ◽  
Pablo Mendoza ◽  
...  
Keyword(s):  
Surface Temperature ◽  
Warm Season ◽  
Hydrologic Model ◽  
Laboratory Research ◽  
Ensemble Prediction ◽  
Lead Times ◽  
Prediction System ◽  
Ensemble Forecasts ◽  
Ensemble Prediction System ◽  
Near Surface

Abstract. The relative roles of statistical weather preprocessing and streamflow postprocessing in hydrological ensemble forecasting at short- to medium-range forecast lead times (day 1–7) are investigated. For this purpose, a regional hydrologic ensemble prediction system (RHEPS) is developed and implemented. The RHEPS is comprised by the following components: i) hydrometeorological observations (multisensor precipitation estimates, gridded surface temperature, and gauged streamflow); ii) weather ensemble forecasts (precipitation and near-surface temperature) from the National Centers for Environmental Prediction 11-member Global Ensemble Forecast System Reforecast version 2 (GEFSRv2); iii) NOAA’s Hydrology Laboratory-Research Distributed Hydrologic Model (HL-RDHM); iv) heteroscedastic censored logistic regression (HCLR) as the statistical preprocessor; v) two statistical postprocessors, an autoregressive model with a single exogenous variable (ARX(1,1)) and quantile regression (QR); and vi) a comprehensive verification strategy. To implement the RHEPS, 1 to 7 days weather forecasts from the GEFSRv2 are used to force HL-RDHM and generate raw ensemble streamflow forecasts. Forecasting experiments are conducted in four nested basins in the U.S. middle Atlantic region, ranging in size from 381 to 12,362 km2. Results show that the HCLR preprocessed ensemble precipitation forecasts have greater skill than the raw forecasts. These improvements are more noticeable in the warm season at the longer lead times (> 3 days). Both postprocessors, ARX(1,1) and QR, show gains in skill relative to the raw ensemble flood forecasts but QR outperforms ARX(1,1). Preprocessing alone has little effect on improving the skill of the ensemble flood forecasts. Indeed, postprocessing alone performs similar, in terms of the relative mean error, skill, and reliability, to the more involved scenario that includes both preprocessing and postprocessing. We conclude that statistical preprocessing may not always be a necessary component of the ensemble flood forecasting chain.

Extended Prediction of North Indian Ocean Tropical Cyclones

2012 ◽  
Vol 27 (3) ◽  
pp. 757-769 ◽  
Author(s):  
James I. Belanger ◽  
Peter J. Webster ◽  
Judith A. Curry ◽  
Mark T. Jelinek
Keyword(s):  
Tropical Cyclone ◽  
Indian Ocean ◽  
Tropical Cyclones ◽  
North Indian Ocean ◽  
Ensemble Prediction ◽  
Tropical Cyclone Genesis ◽  
Lead Times ◽  
Prediction System ◽  
Ensemble Prediction System ◽  
The North

Abstract This analysis examines the predictability of several key forecasting parameters using the ECMWF Variable Ensemble Prediction System (VarEPS) for tropical cyclones (TCs) in the North Indian Ocean (NIO) including tropical cyclone genesis, pregenesis and postgenesis track and intensity projections, and regional outlooks of tropical cyclone activity for the Arabian Sea and the Bay of Bengal. Based on the evaluation period from 2007 to 2010, the VarEPS TC genesis forecasts demonstrate low false-alarm rates and moderate to high probabilities of detection for lead times of 1–7 days. In addition, VarEPS pregenesis track forecasts on average perform better than VarEPS postgenesis forecasts through 120 h and feature a total track error growth of 41 n mi day−1. VarEPS provides superior postgenesis track forecasts for lead times greater than 12 h compared to other models, including the Met Office global model (UKMET), the Navy Operational Global Atmospheric Prediction System (NOGAPS), and the Global Forecasting System (GFS), and slightly lower track errors than the Joint Typhoon Warning Center. This paper concludes with a discussion of how VarEPS can provide much of this extended predictability within a probabilistic framework for the region.

Probabilistic precipitation nowcast for flash flooding purposes across Australia: verification of a new version of Short-Term Ensemble Prediction System (STEPS)

2021 ◽  
Author(s):  
Carlos Velasco-Forero ◽  
Jayaram Pudashine ◽  
Mark Curtis ◽  
Alan Seed
Keyword(s):  
Lead Time ◽  
Precipitation Forecast ◽  
Ensemble Prediction ◽  
Lead Times ◽  
Prediction System ◽  
Short Term ◽  
Radar Rainfall ◽  
Flash Flooding ◽  
Ensemble Prediction System ◽  
Study Results

<div> <p>Short-term precipitation forecast plays a vital role for minimizing the adverse effects of heavy precipitation events such as flash flooding.  Radar rainfall nowcasting techniques based on statistical extrapolations are used to overcome current limitations of precipitation forecasts from numerical weather models, as they provide high spatial and temporal resolutions forecasts within minutes of the observation time. Among various algorithms, the Short-Term Ensemble Prediction System (STEPS) provides rainfall fields nowcasts in a probabilistic sense by accounting the uncertainty in the precipitation forecasts by means of ensembles, with spatial and temporal characteristic very similar to those in the observed radar rainfall fields. The Australian Bureau of Meteorology uses STEPS to generate ensembles of forecast rainfall ensembles in real-time from its extensive weather radar network. </p> </div><div> <p>In this study, results of a large probabilistic verification exercise to a new version of STEPS (hereafter named STEPS-3) are reported. An extensive dataset of more than 47000 individual 5-minute radar rainfall fields (the equivalent of more than 163 days of rain) from ten weather radars across Australia (covering tropical to mid-latitude regions) were used to generate (and verify) 96-member rainfall ensembles nowcasts with up to a 90-minute lead time. STEPS-3 was found to be more than 15-times faster in delivering results compared with previous version of STEPS and an open-source algorithm called pySTEPS. Interestingly, significant variations were observed in the quality of predictions and verification results from one radar to other, from one event to other, depending on the characteristics and location of the radar, nature of the rainfall event, accumulation threshold and lead time. For example, CRPS and RMSE of ensembles of 5-min rainfall forecasts for radars located in mid-latitude regions are better (lower) than those ones from radars located in tropical areas for all lead-times. Also, rainfall fields from S-band radars seem to produce rainfall forecasts able to successfully identify extreme rainfall events for lead times up to 10 minutes longer than those produced using C-band radar datasets for the same rain rate thresholds. Some details of the new STEPS-3 version, case studies and examples of the verification results will be presented. </p> </div>

scholarly journals Ensemble-Based Forecast Uncertainty Analysis of Diverse Heavy Rainfall Events

2010 ◽  
Vol 25 (4) ◽  
pp. 1103-1122 ◽  
Author(s):  
Russ S. Schumacher ◽  
Christopher A. Davis
Keyword(s):  
United States ◽  
Tropical Cyclones ◽  
Heavy Rainfall ◽  
Warm Season ◽  
The United States ◽  
Forecast Skill ◽  
Ensemble Prediction ◽  
Lead Times ◽  
Cool Season ◽  
Ensemble Prediction System

Abstract This study examines widespread heavy rainfall over 5-day periods in the central and eastern United States. First, a climatology is presented that identifies events in which more than 100 mm of precipitation fell over more than 800 000 km2 in 5 days. This climatology shows that such events are most common in the cool season near the Gulf of Mexico coast and are rare in the warm season. Then, the focus turns to the years 2007 and 2008, when nine such events occurred in the United States, all of them leading to flooding. Three of these were associated with warm-season convection, three took place in the cool season, and three were caused by landfalling tropical cyclones. Global ensemble forecasts from the European Centre for Medium-Range Weather Forecasts Ensemble Prediction System are used to assess forecast skill and uncertainty for these nine events, and to identify the types of weather systems associated with their relative levels of skill and uncertainty. Objective verification metrics and subjective examination are used to determine how far in advance the ensemble identified the threat of widespread heavy rains. Specific conclusions depend on the rainfall threshold and the metric chosen, but, in general, predictive skill was highest for rainfall associated with tropical cyclones and lowest for the warm-season cases. In almost all cases, the ensemble provides very skillful 5-day forecasts when initialized at the beginning of the event. In some of the events—particularly the tropical cyclones and strong baroclinic cyclones—the ensemble still shows considerable skill in 96–216-h precipitation forecasts. In other cases, however, the skill drops off much more rapidly as lead time increases. In particular, forecast skill at long lead times was the lowest and spread was the largest in the two cases associated with meso-α-scale to synoptic-scale vortices that were cut off from the primary upper-level jet. In these cases, it appears that when the vortex is present in the initial conditions, the resulting precipitation forecasts are quite accurate and certain, but at longer lead times when the model is required to both develop and correctly evolve the vortex, forecast quality is low and uncertainty is large. These results motivate further investigation of the events that were poorly predicted.

Application and Verification of the ECMWF Precipitation Type Forecast Product (PTYPE) in China

2020 ◽  
Author(s):  
Quan Dong ◽  
Feng Zhang ◽  
Ning Hu ◽  
Zhiping Zong
Keyword(s):  
High Resolution ◽  
Ensemble Prediction ◽  
Lead Times ◽  
Prediction System ◽  
Probability Forecast ◽  
Freezing Rain ◽  
Ensemble Prediction System ◽  
Optimal Probability ◽  
Probability Threshold ◽  
Precipitation Type

<p>The ECMWF (European Centre for Medium-Range Weather Forecasts) precipitation type forecast products—PTYPE are verified using the weather observations of more than 2000 stations in China of the past three winter half years (October to next March). The products include the deterministic forecast from High-resolution model (HRE) and the probability forecast from ensemble prediction system (EPS). Based on the verification results, optimal probability thresholds approaches under criteria of TS maximization (TSmax), frequency match (Bias1) and HSS maximization (HSSmax) are used to improve the deterministic precipitation type forecast skill. The researched precipitation types include rain, sleet, snow and freezing rain.</p><p>The verification results show that the proportion correct of deterministic forecast of ECMWF high-resolution model is mostly larger than 90% and the TSs of rain and snow are high, next is freezing rain, and the TS of sleet is small indicating that the forecast skill of sleet is limited. The rain and snow separating line of deterministic forecasts show errors of a little south in short-range and more and more significant north following elongating lead times in medium-range. The area of sleet forecasts is smaller than observations and the freezing rain is bigger for the high-resolution deterministic forecast. The ensemble prediction system offsets these errors partly by probability forecast. The probability forecast of rain from the ensemble prediction system is smaller than the observation frequency and the probability forecast of snow is larger in short-range and smaller in medium-range than the observation frequency. However, there are some forecast skills for all of these probability forecasts. There are advantages of ensemble prediction system compared to the high-resolution deterministic model. For rain and snow, for some special cost/loss ratio events the EPS is better than the HRD. For sleet and freezing rain, the EPS is better than the HRD significantly, especially for the freezing rain.</p><p>The optimal thresholds of snow and freezing rain are largest which are about 50%~90%, decreasing with elongating lead times. The thresholds of rain are small which are about 10%~20%, increasing with elongating lead times. The thresholds of sleet are the smallest which are under 10%. The verifications show that the approach of optimal probability threshold based on EPS can improve the forecast skill of precipitation type. The proportion correct of HRD is about 92%. Bias1 and TSmax improve it and the improvement of HSSmax is the most significant which is about 94%. The HSS of HRD is about 0.77~0.65. Bias1 increases 0.02 and TSmax increases more. The improvement of HSSmax is the biggest which is about 0.81~0.68 and the increasing rate is around 4%. From the verifications of every kinds of precipitation types, it is demonstrated that the approach of optimal probability threshold improves the performance of rain and snow forecasts significantly compared to the HRD and decreases the forecast area and missing of freezing rain and sleet which are forecasted more areas and false alarms by the HRD.</p><p><strong>Key words: </strong>ECMWF; ensemble prediction system；precipitation type forecast; approach of optimal probability threshold; verification</p>

scholarly journals Representation of model error in a convective-scale ensemble prediction system

2014 ◽  
Vol 21 (1) ◽  
pp. 19-39 ◽  
Author(s):  
L. H. Baker ◽  
A. C. Rudd ◽  
S. Migliorini ◽  
R. N. Bannister
Keyword(s):  
Model Error ◽  
Ensemble Prediction ◽  
Initial Condition ◽  
Prediction System ◽  
Ensemble Prediction System ◽  
Near Surface ◽  
Skill Scores ◽  
The Uk ◽  
Parameter Values ◽  
The Impact

Abstract. In this paper ensembles of forecasts (of up to six hours) are studied from a convection-permitting model with a representation of model error due to unresolved processes. The ensemble prediction system (EPS) used is an experimental convection-permitting version of the UK Met Office's 24-member Global and Regional Ensemble Prediction System (MOGREPS). The method of representing model error variability, which perturbs parameters within the model's parameterisation schemes, has been modified and we investigate the impact of applying this scheme in different ways. These are: a control ensemble where all ensemble members have the same parameter values; an ensemble where the parameters are different between members, but fixed in time; and ensembles where the parameters are updated randomly every 30 or 60 min. The choice of parameters and their ranges of variability have been determined from expert opinion and parameter sensitivity tests. A case of frontal rain over the southern UK has been chosen, which has a multi-banded rainfall structure. The consequences of including model error variability in the case studied are mixed and are summarised as follows. The multiple banding, evident in the radar, is not captured for any single member. However, the single band is positioned in some members where a secondary band is present in the radar. This is found for all ensembles studied. Adding model error variability with fixed parameters in time does increase the ensemble spread for near-surface variables like wind and temperature, but can actually decrease the spread of the rainfall. Perturbing the parameters periodically throughout the forecast does not further increase the spread and exhibits "jumpiness" in the spread at times when the parameters are perturbed. Adding model error variability gives an improvement in forecast skill after the first 2–3 h of the forecast for near-surface temperature and relative humidity. For precipitation skill scores, adding model error variability has the effect of improving the skill in the first 1–2 h of the forecast, but then of reducing the skill after that. Complementary experiments were performed where the only difference between members was the set of parameter values (i.e. no initial condition variability). The resulting spread was found to be significantly less than the spread from initial condition variability alone.

scholarly journals Ensemble Streamflow Forecasting across the U.S. Mid-Atlantic Region with a Distributed Hydrological Model Forced by GEFS Reforecasts

2017 ◽  
Vol 18 (7) ◽  
pp. 1905-1928 ◽  
Author(s):  
Ridwan Siddique ◽  
Alfonso Mejia
Keyword(s):  
Hydrological Model ◽  
Hydrologic Model ◽  
Ensemble Prediction ◽  
Lead Times ◽  
Distributed Hydrological Model ◽  
Streamflow Forecasting ◽  
Atlantic Region ◽  
Meteorological Forcing ◽  
Streamflow Forecasts ◽  
The U.S

Abstract The quality of ensemble streamflow forecasts in the U.S. mid-Atlantic region (MAR) is investigated for short- to medium-range forecast lead times (6–168 h). To this end, a regional hydrological ensemble prediction system (RHEPS) is assembled and implemented. The RHEPS in this case comprises the ensemble meteorological forcing, a distributed hydrological model, and a statistical postprocessor. As the meteorological forcing, precipitation, and near-surface temperature outputs from the National Oceanic and Atmospheric Administration (NOAA)/National Centers for Environmental Prediction (NCEP) 11-member Global Ensemble Forecast System Reforecast, version 2 (GEFSRv2), are used. The Hydrology Laboratory Research Distributed Hydrologic Model (HL-RDHM) is used as the distributed hydrological model, and a statistical autoregressive model with an exogenous variable is used as the postprocessor. To verify streamflow forecasts from the RHEPS, eight river basins in the MAR are selected, ranging in drainage area from ~262 to 29 965 km2 and covering some of the major rivers in the MAR. The verification results for the RHEPS show that, at the initial lead times (1–3 days), the hydrological uncertainties have more impact on forecast skill than the meteorological ones. The former become less pronounced, and the meteorological uncertainties dominate, across longer lead times (>3 days). Nonetheless, the ensemble streamflow forecasts remain skillful for lead times of up to 7 days. Additionally, postprocessing increases forecast skills across lead times and spatial scales, particularly for the high-flow conditions. Overall, the proposed RHEPS is able to improve streamflow forecasting in the MAR relative to the deterministic (unperturbed GEFSRv2 member) forecasting case.

scholarly journals Probabilistic Flood Forecasting with a Limited-Area Ensemble Prediction System: Selected Case Studies

2007 ◽  
Vol 8 (4) ◽  
pp. 897-909 ◽  
Author(s):  
M. Verbunt ◽  
A. Walser ◽  
J. Gurtz ◽  
A. Montani ◽  
C. Schär
Keyword(s):  
Case Studies ◽  
Heavy Precipitation ◽  
Hydrologic Model ◽  
Ensemble Prediction ◽  
Limited Area ◽  
Prediction System ◽  
Rhine River ◽  
Time Step ◽  
Ensemble Prediction System ◽  
Runoff Forecasting

Abstract A high-resolution atmospheric ensemble forecasting system is coupled to a hydrologic model to investigate probabilistic runoff forecasts for the alpine tributaries of the Rhine River basin (34 550 km2). Five-day ensemble forecasts consisting of 51 members, generated with the global ensemble prediction system (EPS) of the European Centre for Medium-Range Weather Forecasts (ECMWF), are downscaled with the limited-area model Lokal Modell (LM). The resulting limited-area ensemble prediction system (LEPS) uses a horizontal grid spacing of 10 km and provides one-hourly output for driving the distributed hydrologic model Precipitation–Runoff–Evapotranspiration–Hydrotope (PREVAH) hydrologic response unit (HRU) with a resolution of 500 × 500 m2 and a time step of 1 h. The hydrologic model component is calibrated for the river catchments considered, which are characterized by highly complex topography, for the period 1997–98 using surface observations, and validated for 1999–2002. This study explores the feasibility of atmospheric ensemble predictions for runoff forecasting, in comparison with deterministic atmospheric forcing. Detailed analysis is presented for two case studies: the spring 1999 flood event affecting central Europe due to a combination of snowmelt and heavy precipitation, and the November 2002 flood in the Alpine Rhine catchment. For both cases, the deterministic simulations yield forecast failures, while the coupled atmospheric–hydrologic EPS provides appropriate probabilistic forecast guidance with early indications for extreme floods. It is further shown that probabilistic runoff forecasts using a subsample of EPS members, selected by a cluster analysis, properly represent the forecasts using all 51 EPS members, while forecasts from randomly chosen subsamples reveal a reduced spread compared to the representative members. Additional analyses show that the representation of horizontal advection of precipitation in the atmospheric model may be crucial for flood forecasts in alpine catchments.

scholarly journals A past discharge assimilation system for ensemble streamflow forecasts over France – Part 2: Impact on the ensemble streamflow forecasts

2010 ◽  
Vol 14 (8) ◽  
pp. 1639-1653 ◽  
Author(s):  
G. Thirel ◽  
E. Martin ◽  
J.-F. Mahfouf ◽  
S. Massart ◽  
S. Ricci ◽  
...  
Keyword(s):  
Soil Moisture ◽  
Meteorological Data ◽  
Skill Score ◽  
Ensemble Prediction ◽  
Time Range ◽  
Prediction Errors ◽  
Prediction System ◽  
Ensemble Prediction System ◽  
Streamflow Forecasts ◽  
Assimilation System

Abstract. The use of ensemble streamflow forecasts is developing in the international flood forecasting services. Ensemble streamflow forecast systems can provide more accurate forecasts and useful information about the uncertainty of the forecasts, thus improving the assessment of risks. Nevertheless, these systems, like all hydrological forecasts, suffer from errors on initialization or on meteorological data, which lead to hydrological prediction errors. This article, which is the second part of a 2-part article, concerns the impacts of initial states, improved by a streamflow assimilation system, on an ensemble streamflow prediction system over France. An assimilation system was implemented to improve the streamflow analysis of the SAFRAN-ISBA-MODCOU (SIM) hydro-meteorological suite, which initializes the ensemble streamflow forecasts at Météo-France. This assimilation system, using the Best Linear Unbiased Estimator (BLUE) and modifying the initial soil moisture states, showed an improvement of the streamflow analysis with low soil moisture increments. The final states of this suite were used to initialize the ensemble streamflow forecasts of Météo-France, which are based on the SIM model and use the European Centre for Medium-range Weather Forecasts (ECMWF) 10-day Ensemble Prediction System (EPS). Two different configurations of the assimilation system were used in this study: the first with the classical SIM model and the second using improved soil physics in ISBA. The effects of the assimilation system on the ensemble streamflow forecasts were assessed for these two configurations, and a comparison was made with the original (i.e. without data assimilation and without the improved physics) ensemble streamflow forecasts. It is shown that the assimilation system improved most of the statistical scores usually computed for the validation of ensemble predictions (RMSE, Brier Skill Score and its decomposition, Ranked Probability Skill Score, False Alarm Rate, etc.), especially for the first few days of the time range. The assimilation was slightly more efficient for small basins than for large ones.

Sign in / Sign up

Export Citation Format

Share Document