scholarly journals Benchmarking ensemble streamflow prediction skill in the UK

2018 ◽  
Vol 22 (3) ◽  
pp. 2023-2039 ◽  
Author(s):  
Shaun Harrigan ◽  
Christel Prudhomme ◽  
Simon Parry ◽  
Katie Smith ◽  
Maliko Tanguy

Abstract. Skilful hydrological forecasts at sub-seasonal to seasonal lead times would be extremely beneficial for decision-making in water resources management, hydropower operations, and agriculture, especially during drought conditions. Ensemble streamflow prediction (ESP) is a well-established method for generating an ensemble of streamflow forecasts in the absence of skilful future meteorological predictions, instead using initial hydrologic conditions (IHCs), such as soil moisture, groundwater, and snow, as the source of skill. We benchmark when and where the ESP method is skilful across a diverse sample of 314 catchments in the UK and explore the relationship between catchment storage and ESP skill. The GR4J hydrological model was forced with historic climate sequences to produce a 51-member ensemble of streamflow hindcasts. We evaluated forecast skill seamlessly from lead times of 1 day to 12 months initialized at the first of each month over a 50-year hindcast period from 1965 to 2015. Results showed ESP was skilful against a climatology benchmark forecast in the majority of catchments across all lead times up to a year ahead, but the degree of skill was strongly conditional on lead time, forecast initialization month, and individual catchment location and storage properties. UK-wide mean ESP skill decayed exponentially as a function of lead time with continuous ranked probability skill scores across the year of 0.75, 0.20, and 0.11 for 1-day, 1-month, and 3-month lead times, respectively. However, skill was not uniform across all initialization months. For lead times up to 1 month, ESP skill was higher than average when initialized in summer and lower in winter months, whereas for longer seasonal and annual lead times skill was higher when initialized in autumn and winter months and lowest in spring. ESP was most skilful in the south and east of the UK, where slower responding catchments with higher soil moisture and groundwater storage are mainly located; correlation between catchment base flow index (BFI) and ESP skill was very strong (Spearman's rank correlation coefficient =0.90 at 1-month lead time). This was in contrast to the more highly responsive catchments in the north and west which were generally not skilful at seasonal lead times. Overall, this work provides scientific justification for when and where use of such a relatively simple forecasting approach is appropriate in the UK. This study, furthermore, creates a low cost benchmark against which potential skill improvements from more sophisticated hydro-meteorological ensemble prediction systems can be judged.

2017 ◽  
Author(s):  
Shaun Harrigan ◽  
Christel Prudhomme ◽  
Simon Parry ◽  
Katie Smith ◽  
Maliko Tanguy

Abstract. Skilful hydrological forecasts at sub-seasonal to seasonal lead times would be extremely beneficial for decision-making in water resources management, hydropower operations, and agriculture, especially during drought conditions. Ensemble Streamflow Prediction (ESP) is a well-established method for generating an ensemble of streamflow forecasts in the absence of skilful future meteorological predictions, instead using Initial Hydrological Conditions (IHCs), such as soil moisture, groundwater, and snow, as the source of skill. We benchmark when and where the ESP method is skilful across a diverse sample of 314 catchments in the UK and explore the relationship between catchment storage and ESP skill. The GR4J hydrological model was forced with historic climate sequences to produce 51-member ensemble of streamflow hindcasts. We evaluated forecast skill seamlessly from lead times of 1-day to 12-months initialised at the first of each month over a 50-year hindcast period from 1965–2015. Results show ESP was skilful against a climatology benchmark forecast in the majority of catchments across all lead times up to a year ahead, but the degree of skill was strongly conditional on lead time, forecast initialisation month, and individual catchment location and storage properties. UK-wide mean ESP skill decays exponentially as a function of lead time with mean squared error skill scores across the year of 0.839, 0.303, and 0.179 for 1-day, 1-month, and 3-month lead times, respectively. However, skill was not uniform across all initialisation months. For lead times up to 1-month, ESP skill was higher than average when initialised in summer and lower in winter, whereas for longer seasonal and annual lead times skill was highest when initialised in autumn and winter months and lowest in April. ESP is most skilful in the south and east of the UK, where slower responding catchments with higher soil moisture and groundwater storage are mainly located; correlation between catchment Baseflow Index (BFI) and ESP skill was very strong (ρ = 0.896 at 1-month lead time). This is in contrast to the more highly responsive catchments in the north and west which are generally not skilful at seasonal lead times. Overall, this work provides a scientifically defensible justification for when and where use of such a relatively simple forecasting approach is appropriate in the UK and creates a low cost benchmark against which potential skill improvements from more sophisticated hydro-meteorological ensemble prediction systems can be judged.


2020 ◽  
Author(s):  
Seán Donegan ◽  
Conor Murphy ◽  
Shaun Harrigan ◽  
Ciaran Broderick ◽  
Saeed Golian ◽  
...  

Abstract. Skilful hydrological forecasts can benefit decision-making in water resources management and other water-related sectors that require long-term planning. In Ireland, no such service exists to deliver forecasts at the catchment scale. In order to understand the potential for hydrological forecasting in Ireland, we benchmark the skill of Ensemble Streamflow Prediction (ESP) for a diverse sample of 46 catchments using the GR4J hydrological model. Skill is evaluated within a 52-year hindcast study design over lead times of 1 day to 12 months for each of 12 initialisation months, January to December. Our results show that ESP is skilful against a probabilistic climatology benchmark in the majority of catchments up to several months ahead. However, the level of skill was strongly dependent on lead time, initialisation month, and individual catchment location and storage properties. Mean ESP skill was found to decay rapidly as a function of lead time, with continuous ranked probability skill scores of 0.8 (1-day), 0.32 (2-week), 0.18 (1-month), 0.05 (3-month), and 0.01 (12-month). Forecasts were generally more skilful when initialised in summer than other seasons. A strong correlation (ρ = 0.94) was observed between forecast skill and catchment storage capacity (baseflow index), with the most skilful regions, the Midlands and East, being those where slowly responding, high storage catchments are located. Results also highlight the potential utility of ESP for decision-making, as measured by its ability to forecast low and high flow events. In addition to our benchmarking experiment, we conditioned ESP on the winter North Atlantic Oscillation (NAO) using adjusted hindcasts from the Met Office's Global Seasonal Forecasting System version 5. We found gains in winter forecast skill of 7–18 % were possible over lead times of 1 to 3 months, and that NAO-conditioned ESP is particularly effective at forecasting dry winters, a critical season for water resources management. We conclude that ESP is skilful in a number of different contexts and thus should be operationalised in Ireland given its potential benefits for water managers and other stakeholders.


2021 ◽  
Vol 25 (7) ◽  
pp. 4159-4183
Author(s):  
Seán Donegan ◽  
Conor Murphy ◽  
Shaun Harrigan ◽  
Ciaran Broderick ◽  
Dáire Foran Quinn ◽  
...  

Abstract. Skilful hydrological forecasts can benefit decision-making in water resources management and other water-related sectors that require long-term planning. In Ireland, no such service exists to deliver forecasts at the catchment scale. In order to understand the potential for hydrological forecasting in Ireland, we benchmark the skill of ensemble streamflow prediction (ESP) for a diverse sample of 46 catchments using the GR4J (Génie Rural à 4 paramètres Journalier) hydrological model. Skill is evaluated within a 52-year hindcast study design over lead times of 1 d to 12 months for each of the 12 initialisation months, January to December. Our results show that ESP is skilful against a probabilistic climatology benchmark in the majority of catchments up to several months ahead. However, the level of skill was strongly dependent on lead time, initialisation month, and individual catchment location and storage properties. Mean ESP skill was found to decay rapidly as a function of lead time, with a continuous ranked probability skill score (CRPSS) of 0.8 (1 d), 0.32 (2-week), 0.18 (1-month), 0.05 (3-month), and 0.01 (12-month). Forecasts were generally more skilful when initialised in summer than other seasons. A strong correlation (ρ=0.94) was observed between forecast skill and catchment storage capacity (baseflow index), with the most skilful regions, the Midlands and the East, being those where slowly responding, high-storage catchments are located. Forecast reliability and discrimination were also assessed with respect to low- and high-flow events. In addition to our benchmarking experiment, we conditioned ESP with the winter North Atlantic Oscillation (NAO) using adjusted hindcasts from the Met Office's Global Seasonal Forecasting System version 5. We found gains in winter forecast skill (CRPSS) of 7 %–18 % were possible over lead times of 1 to 3 months and that improved reliability and discrimination make NAO-conditioned ESP particularly effective at forecasting dry winters, a critical season for water resources management. We conclude that ESP is skilful in a number of different contexts and thus should be operationalised in Ireland given its potential benefits for water managers and other stakeholders.


2007 ◽  
Vol 11 (4) ◽  
pp. 1501-1513 ◽  
Author(s):  
M. K. Schneider ◽  
F. Brunner ◽  
J. M. Hollis ◽  
C. Stamm

Abstract. Predicting discharge in ungauged catchments or contaminant movement through soil requires knowledge of the distribution and spatial heterogeneity of hydrological soil properties. Because hydrological soil information is not available at a European scale, we reclassified the Soil Geographical Database of Europe (SGDBE) at 1:1 million in a hydrological manner by adopting the Hydrology Of Soil Types (HOST) system developed in the UK. The HOST classification describes dominant pathways of water movement through soil and was related to the base flow index (BFI) of a catchment (the long-term proportion of base flow on total stream flow). In the original UK study, a linear regression of the coverage of HOST classes in a catchment explained 79% of BFI variability. We found that a hydrological soil classification can be built based on the information present in the SGDBE. The reclassified SGDBE and the regression coefficients from the original UK study were used to predict BFIs for 103 catchments spread throughout Europe. The predicted BFI explained around 65% of the variability in measured BFI in catchments in Northern Europe, but the explained variance decreased from North to South. We therefore estimated new regression coefficients from the European discharge data and found that these were qualitatively similar to the original estimates from the UK. This suggests little variation across Europe in the hydrological effect of particular HOST classes, but decreasing influence of soil on BFI towards Southern Europe. Our preliminary study showed that pedological information is useful for characterising soil hydrology within Europe and the long-term discharge regime of catchments in Northern Europe. Based on these results, we draft a roadmap for a refined hydrological classification of European soils.


2021 ◽  
Author(s):  
Edward E. Salakpi ◽  
Peter D. Hurley ◽  
James M. Muthoka ◽  
Adam B. Barrett ◽  
Andrew Bowell ◽  
...  

Abstract. Droughts form a large part of climate/weather-related disasters reported globally. In Africa, pastoralists living in the Arid and Semi-Arid Lands (ASALs) are the worse affected. Prolonged dry spells that cause vegetation stress in these regions have resulted in the loss of income and livelihoods. To curb this, global initiatives like the Paris Agreement and the United Nations recognised the need to establish Early Warning Systems (EWS) to save lives and livelihoods. Existing EWS use a combination of Satellite Earth Observation (EO) based biophysical indicators like the Vegetation Condition Index (VCI) and socio-economic factors to measure and monitor droughts. Most of these EWS rely on expert knowledge in estimating upcoming drought conditions without using forecast models. Recent research has shown that the use of robust algorithms like Auto-Regression, Gaussian Processes and Artificial Neural Networks can provide very skilled models for forecasting vegetation condition at short to medium range lead times. However, to enable preparedness for early action, forecasts with a longer lead time are needed. The objective of this research work is to develop models that forecast vegetation conditions at longer lead times on the premise that vegetation condition is controlled by factors like precipitation and soil moisture. To achieve this, we used a Bayesian Auto-Regressive Distributed Lag (BARDL) modelling approach which enabled us to factor in lagged information from Precipitation and Soil moisture levels into our VCI forecast model. The results showed a ∼2-week gain in the forecast range compared to the univariate AR model used as a baseline. The R2 scores for the Bayesian ARDL model were 0.94, 0.85 and 0.74, compared to the AR model's R2 of 0.88, 0.77 and 0.65 for 6, 8 and 10 weeks lead time respectively.


2021 ◽  
Author(s):  
Carlos Velasco-Forero ◽  
Jayaram Pudashine ◽  
Mark Curtis ◽  
Alan Seed

<div> <p>Short-term precipitation forecast plays a vital role for minimizing the adverse effects of heavy precipitation events such as flash flooding.  Radar rainfall nowcasting techniques based on statistical extrapolations are used to overcome current limitations of precipitation forecasts from numerical weather models, as they provide high spatial and temporal resolutions forecasts within minutes of the observation time. Among various algorithms, the Short-Term Ensemble Prediction System (STEPS) provides rainfall fields nowcasts in a probabilistic sense by accounting the uncertainty in the precipitation forecasts by means of ensembles, with spatial and temporal characteristic very similar to those in the observed radar rainfall fields. The Australian Bureau of Meteorology uses STEPS to generate ensembles of forecast rainfall ensembles in real-time from its extensive weather radar network. </p> </div><div> <p>In this study, results of a large probabilistic verification exercise to a new version of STEPS (hereafter named STEPS-3) are reported. An extensive dataset of more than 47000 individual 5-minute radar rainfall fields (the equivalent of more than 163 days of rain) from ten weather radars across Australia (covering tropical to mid-latitude regions) were used to generate (and verify) 96-member rainfall ensembles nowcasts with up to a 90-minute lead time. STEPS-3 was found to be more than 15-times faster in delivering results compared with previous version of STEPS and an open-source algorithm called pySTEPS. Interestingly, significant variations were observed in the quality of predictions and verification results from one radar to other, from one event to other, depending on the characteristics and location of the radar, nature of the rainfall event, accumulation threshold and lead time. For example, CRPS and RMSE of ensembles of 5-min rainfall forecasts for radars located in mid-latitude regions are better (lower) than those ones from radars located in tropical areas for all lead-times. Also, rainfall fields from S-band radars seem to produce rainfall forecasts able to successfully identify extreme rainfall events for lead times up to 10 minutes longer than those produced using C-band radar datasets for the same rain rate thresholds. Some details of the new STEPS-3 version, case studies and examples of the verification results will be presented. </p> </div>


2020 ◽  
Vol 12 (9) ◽  
pp. 1490 ◽  
Author(s):  
Calum Baugh ◽  
Patricia de Rosnay ◽  
Heather Lawrence ◽  
Toni Jurlina ◽  
Matthias Drusch ◽  
...  

In this study the impacts of Soil Moisture and Ocean Salinity (SMOS) soil moisture data assimilation upon the streamflow prediction of the operational Global Flood Awareness System (GloFAS) were investigated. Two GloFAS experiments were performed, one which used hydro-meteorological forcings produced with the assimilation of the SMOS data, the other using forcings which excluded the assimilation of the SMOS data. Both sets of experiment results were verified against streamflow observations in the United States and Australia. Skill scores were computed for each experiment against the observation datasets, the differences in the skill scores were used to identify where GloFAS skill may be affected by the assimilation of SMOS soil moisture data. In addition, a global assessment was made of the impact upon the 5th and 95th GloFAS flow percentiles to see how SMOS data assimilation affected low and high flows respectively. Results against in-situ observations found that GloFAS skill score was only affected by a small amount. At a global scale, the results showed a large impact on high flows in areas such as the Hudson Bay, central United States, the Sahel and Australia. There was no clear spatial trend to these differences as opposing signs occurred within close proximity to each other. Investigating the differences between the simulations at individual gauging stations showed that they often only occurred during a single flood event; for the remainder of the simulation period the experiments were almost identical. This suggests that SMOS data assimilation may affect the generation of surface runoff during high flow events, but may have less impact on baseflow generation during the remainder of the hydrograph. To further understand this, future work could assess the impact of SMOS data assimilation upon specific hydrological components such as surface and subsurface runoff.


Atmosphere ◽  
2019 ◽  
Vol 10 (8) ◽  
pp. 458 ◽  
Author(s):  
Zhenzhen Liu ◽  
Qiang Dai ◽  
Lu Zhuo

Radar rainfall nowcasts are subject to many sources of uncertainty and these uncertainties change with the characteristics of a storm. The predictive skill of a radar rainfall nowcasting model can be difficult to understand as sometimes it appears to be perfect but at other times it is highly inaccurate. This hinders the decision making required for the early warning of natural hazards caused by rainfall. In this study we define radar spatial and temporal rainfall variability and relate them to the predictive skill of a nowcasting model. The short-term ensemble prediction system model is configured to predict 731 events with lead times of one, two, and three hours. The nowcasting skill is expressed in terms of six well-known indicators. The results show that the quality of radar rainfall nowcasts increases with the rainfall autocorrelation and decreases with the rainfall variability coefficient. The uncertainty of radar rainfall nowcasts also shows a positive connection with rainfall variability. In addition, the spatial variability is more important than the temporal variability. Based on these results, we recommend that the lead time for radar rainfall nowcasting models should change depending on the storm and that it should be determined according to the rainfall variability. Such measures could improve trust in the rainfall nowcast products that are used for hydrological and meteorological applications.


Sign in / Sign up

Export Citation Format

Share Document