Model adequacy tests for improving predictions in ungauged basins

2020 ◽  
Author(s):  
Cristina Prieto ◽  
Nataliya Le Vine ◽  
Dmitri Kavetski ◽  
César Álvarez ◽  
Raúl Medina
Keyword(s):  
Time Series ◽  
Hydrological Model ◽  
Flow Time ◽  
Flow Index ◽  
Model Parameters ◽  
Ungauged Basins ◽  
Ungauged Catchments ◽  
Subsequent Work ◽  
Study Results

<p>Flow prediction in ungauged catchments is a major unresolved challenge in scientific and engineering hydrology. Meeting this challenge is made difficult by the uncertainty in the “regionalization” model used to transpose hydrological data (e.g., flow indices) from gauged to ungauged basins, and by the uncertainty in the hydrological model used to predict streamflow in the ungauged basin. This study combines recent advances in flow index selection, regionalization via machine learning methods, and a Bayesian inference framework. In addition, it proposes two new statistical metrics, “DistanceTest” and “InfoTest”, to assess the adequacy of a model before estimating its parameters. “DistanceTest” quantifies whether a model (hydrological or regionalization) is likely to reproduce the available hydrological information in a catchment. “InfoTest” is based on Bayes Factors and quantifies the information added by a model (hydrological or regionalization) over prior knowledge about the available hydrological information in a catchment). The proposed adequacy tests can be seen as a prerequisite for a model (hydrological or regionalization) being considered capable of providing meaningful and high quality flow time series predictions in ungauged catchments. If a model is found inadequate a priori and rejected, the modeler is spared the effort in estimating the model parameters, which can be a substantial saving.</p><p>The proposed regionalization approach is applied to 92 northern Spain catchments, with 16 catchments treated as ungauged. It is found that (1) a small number of PCs capture approximately 87% of variability in the flow indices, and (2) adequacy tests with respect to regionalized information are indicative of (but do not guarantee) the ability of a hydrological model to predict flow time series. The adequacy tests identify the regionalization of flow index PCs as adequate in 12 of 16 catchments but the hydrological model as adequate in only 1 of 16 catchments. In addition, the case study results suggest that the hydrological model is the main source of uncertainty in comparison to the regionalization model, and hence should receive the main priority in subsequent work at the case study catchments.</p>

scholarly journals Uncertainty analysis in model parameters regionalization: a case study involving the SWAT model in Mediterranean catchments (Southern France)

2013 ◽  
Vol 10 (4) ◽  
pp. 4951-5011 ◽  
Author(s):  
H. Sellami ◽  
I. La Jeunesse ◽  
S. Benabdallah ◽  
N. Baghdadi ◽  
M. Vanclooster
Keyword(s):  
Model Prediction ◽  
Hydrological Model ◽  
Swat Model ◽  
Behavioral Model ◽  
Model Parameters ◽  
Ungauged Catchments ◽  
Southern France ◽  
Ungauged Catchment ◽  
Prediction Uncertainty

Abstract. In this study a method for propagating the hydrological model uncertainty in discharge predictions of ungauged Mediterranean catchments using a model parameter regionalization approach is presented. The method is developed and tested for the Thau catchment located in southern France using the SWAT hydrological model. Regionalization of model parameters based on physical similarity measured between gauged and ungauged catchments attributes is a popular methodology for discharge prediction in ungauged basins, but it is often confronted with an arbitrary criterion for selecting the "behavioral" model parameters sets (Mps) at the gauged catchment. A more objective method is provided in this paper where the transferrable Mps are selected based on the similarity between the donor and the receptor catchments. In addition, the method allows propagating the modeling uncertainty while transferring the Mps to the ungauged catchments. Results indicate that physically similar catchments located within the same geographic and climatic region may exhibit similar hydrological behavior and can also be affected by similar model prediction uncertainty. Furthermore, the results suggest that model prediction uncertainty at the ungauged catchment increases as the dissimilarity between the donor and the receptor catchments increases. The methodology presented in this paper can be replicated and used in regionalization of any hydrological model parameters for estimating streamflow at ungauged catchment.

scholarly journals Uncertainty analysis in model parameters regionalization: a case study involving the SWAT model in Mediterranean catchments (Southern France)

2014 ◽  
Vol 18 (6) ◽  
pp. 2393-2413 ◽  
Author(s):  
H. Sellami ◽  
I. La Jeunesse ◽  
S. Benabdallah ◽  
N. Baghdadi ◽  
M. Vanclooster
Keyword(s):  
Model Prediction ◽  
Hydrological Model ◽  
Swat Model ◽  
Behavioral Model ◽  
Model Parameters ◽  
Ungauged Catchments ◽  
Southern France ◽  
Model Parameter ◽  
Ungauged Catchment ◽  
Prediction Uncertainty

Abstract. In this study a method for propagating the hydrological model uncertainty in discharge predictions of ungauged Mediterranean catchments using a model parameter regionalization approach is presented. The method is developed and tested for the Thau catchment located in Southern France using the SWAT hydrological model. Regionalization of model parameters, based on physical similarity measured between gauged and ungauged catchment attributes, is a popular methodology for discharge prediction in ungauged basins, but it is often confronted with an arbitrary criterion for selecting the "behavioral" model parameter sets (Mps) at the gauged catchment. A more objective method is provided in this paper where the transferrable Mps are selected based on the similarity between the donor and the receptor catchments. In addition, the method allows propagating the modeling uncertainty while transferring the Mps to the ungauged catchments. Results indicate that physically similar catchments located within the same geographic and climatic region may exhibit similar hydrological behavior and can also be affected by similar model prediction uncertainty. Furthermore, the results suggest that model prediction uncertainty at the ungauged catchment increases as the dissimilarity between the donor and the receptor catchments increases. The methodology presented in this paper can be replicated and used in regionalization of any hydrological model parameters for estimating streamflow at ungauged catchment.

scholarly journals Conditioning rainfall-runoff model parameters for ungauged catchments and land management impacts analysis

2009 ◽  
Vol 13 (6) ◽  
pp. 893-904 ◽  
Author(s):  
N. Bulygina ◽  
N. McIntyre ◽  
H. Wheater
Keyword(s):  
Parameter Space ◽  
Land Management ◽  
Base Flow ◽  
Distributed Model ◽  
Flow Index ◽  
Model Parameters ◽  
Ungauged Catchments ◽  
Management Interventions ◽  
Simulated Event ◽  
Base Flow Index

Abstract. Data scarcity and model over-parameterisation, leading to model equifinality and large prediction uncertainty, are common barriers to effective hydrological modelling. The problem can be alleviated by constraining the prior parameter space using parameter regionalisation. A common basis for regionalisation in the UK is the HOST database which provides estimates of hydrological indices for different soil classifications. In our study, Base Flow Index is estimated from the HOST database and the power of this index for constraining the parameter space is explored. The method is applied to a highly discretised distributed model of a 12.5 km2 upland catchment in Wales. To assess probabilistic predictions against flow observations, a probabilistic version of the Nash-Sutcliffe efficiency is derived. For six flow gauges with reliable data, this efficiency ranged between 0.70 and 0.81, and inspection of the results shows that the model explains the data well. Knowledge of how Base Flow Index and interception losses may change under future land use management interventions was then used to further condition the model. Two interventions are considered: afforestation of grazed areas, and soil degradation associated with increased grazing intensity. Afforestation leads to median reduction in modelled runoff volume of 24% over the simulated 3 month period; and a median peak flow reduction ranging from 12 to 15% over the six gauges for the largest simulated event. Uncertainty in all results is low compared to prior uncertainty and it is concluded that using Base Flow Index estimated from HOST is a simple and potentially powerful method of conditioning the parameter space under current and future land management.

scholarly journals Estimation of baseflow parameters of variable infiltration capacity model with soil and topography properties for predictions in ungauged basins

2011 ◽  
Vol 8 (4) ◽  
pp. 7017-7053 ◽  
Author(s):  
Z. Bao ◽  
J. Liu ◽  
J. Zhang ◽  
G. Fu ◽  
G. Wang ◽  
...  
Keyword(s):  
Goodness Of Fit ◽  
Model Simulation ◽  
Parameters Estimation ◽  
Model Parameters ◽  
Ungauged Basins ◽  
Variable Infiltration Capacity ◽  
Infiltration Capacity ◽  
Ungauged Catchments ◽  
Vic Model ◽  
Predictions In Ungauged Basins

Abstract. Equifinality is unavoidable when transferring model parameters from gauged catchments to ungauged catchments for predictions in ungauged basins (PUB). A framework for estimating the three baseflow parameters of variable infiltration capacity (VIC) model, directly with soil and topography properties is presented. When the new parameters setting methodology is used, the number of parameters needing to be calibrated is reduced from six to three, that leads to a decrease of equifinality and uncertainty. This is validated by Monte Carlo simulations in 24 hydro-climatic catchments in China. Using the new parameters estimation approach, model parameters become more sensitive and the extent of parameters space will be smaller when a threshold of goodness-of-fit is given. That means the parameters uncertainty is reduced with the new parameters setting methodology. In addition, the uncertainty of model simulation is estimated by the generalised likelihood uncertainty estimation (GLUE) methodology. The results indicate that the uncertainty of streamflow simulations, i.e., confidence interval, is lower with the new parameters estimation methodology compared to that used by original calibration methodology. The new baseflow parameters estimation framework could be applied in VIC model and other appropriate models for PUB.

scholarly journals On the selection of precipitation products for the regionalisation of hydrological model parameters

2021 ◽  
Vol 25 (11) ◽  
pp. 5805-5837
Author(s):  
Oscar M. Baez-Villanueva ◽  
Mauricio Zambrano-Bigiarini ◽  
Pablo A. Mendoza ◽  
Ian McNamara ◽  
Hylke E. Beck ◽  
...  
Keyword(s):  
Hydrological Model ◽  
Model Performance ◽  
Temporal Distribution ◽  
Hydrological Regime ◽  
Hydrologic Model ◽  
Spatial Proximity ◽  
Model Parameters ◽  
Ungauged Catchments ◽  
Water Balance Components ◽  
Feature Similarity

Abstract. Over the past decades, novel parameter regionalisation techniques have been developed to predict streamflow in data-scarce regions. In this paper, we examined how the choice of gridded daily precipitation (P) products affects the relative performance of three well-known parameter regionalisation techniques (spatial proximity, feature similarity, and parameter regression) over 100 near-natural catchments with diverse hydrological regimes across Chile. We set up and calibrated a conceptual semi-distributed HBV-like hydrological model (TUWmodel) for each catchment, using four P products (CR2MET, RF-MEP, ERA5, and MSWEPv2.8). We assessed the ability of these regionalisation techniques to transfer the parameters of a rainfall-runoff model, implementing a leave-one-out cross-validation procedure for each P product. Despite differences in the spatio-temporal distribution of P, all products provided good performance during calibration (median Kling–Gupta efficiencies (KGE′s) > 0.77), two independent verification periods (median KGE′s >0.70 and 0.61, for near-normal and dry conditions, respectively), and regionalisation (median KGE′s for the best method ranging from 0.56 to 0.63). We show how model calibration is able to compensate, to some extent, differences between P forcings by adjusting model parameters and thus the water balance components. Overall, feature similarity provided the best results, followed by spatial proximity, while parameter regression resulted in the worst performance, reinforcing the importance of transferring complete model parameter sets to ungauged catchments. Our results suggest that (i) merging P products and ground-based measurements does not necessarily translate into an improved hydrologic model performance; (ii) the spatial resolution of P products does not substantially affect the regionalisation performance; (iii) a P product that provides the best individual model performance during calibration and verification does not necessarily yield the best performance in terms of parameter regionalisation; and (iv) the model parameters and the performance of regionalisation methods are affected by the hydrological regime, with the best results for spatial proximity and feature similarity obtained for rain-dominated catchments with a minor snowmelt component.

scholarly journals Calibration of physically based models: back to basics?

2003 ◽  
Vol 5 (4) ◽  
pp. 233-244 ◽  
Author(s):  
Vincent Guinot ◽  
Philippe Gourbesville
Keyword(s):  
Hydrological Model ◽  
Flash Flood ◽  
Model Parameters ◽  
Model Structure ◽  
Ungauged Catchments ◽  
Model Response ◽  
Physically Based ◽  
Physically Based Models ◽  
Extreme Hydrological Events ◽  
Main Factor

The modelling of extreme hydrological events often suffers from a lack of available data. Physically based models are the best available modelling option in such situations, as they can in principle provide answers about the behaviour of ungauged catchments provided that the geometry and the forcings are known with sufficient accuracy. The need for calibration is therefore limited. In some situations, calibration (seen as adjusting the model parameters so that they fit the calculation as closely to the measurements as possible) is impossible. This paper presents such a situation. The MIKE SHE physically based hydrological model is used to model a flash flood over a medium-sized catchment of the Mediterranean Alps (2820 km2). An examination of a number of modelling alternatives shows that the main factor of uncertainty in the model response is the model structure (what are the dominant processes). The second most important factor is the accuracy with which the catchment geometry is represented in the model. The model results exhibit very little sensitivity to the model parameters, and therefore calibration of these parameters is found to be useless.

scholarly journals Streamflow prediction in ungauged basins: benchmarking the efficiency of deep learning

2020 ◽  
Vol 163 ◽  
pp. 01001
Author(s):  
Georgy Ayzel ◽  
Liubov Kurochkina ◽  
Eduard Kazakov ◽  
Sergei Zhuravlev
Keyword(s):  
Deep Learning ◽  
Hydrological Model ◽  
State Of The Art ◽  
Flash Flood ◽  
Early Warning Systems ◽  
Model Parameters ◽  
Ungauged Basins ◽  
Streamflow Prediction ◽  
Basin Scale ◽  
The Impact

Streamflow prediction is a vital public service that helps to establish flash-flood early warning systems or assess the impact of projected climate change on water management. However, the availability of streamflow observations limits the utilization of the state-of-the-art streamflow prediction techniques to the basins where hydrometric gauging stations exist. Since the most river basins in the world are ungauged, the development of the specialized techniques for the reliable streamflow prediction in ungauged basins (PUB) is of crucial importance. In recent years, the emerging field of deep learning provides a myriad of new models that can breathe new life into the stagnating PUB methods. In the presented study, we benchmark the streamflow prediction efficiency of Long Short-Term Memory (LSTM) networks against the standard technique of GR4J hydrological model parameters regionalization (HMREG) at 200 basins in Northwest Russia. Results show that the LSTM-based regional hydrological model significantly outperforms the HMREG scheme in terms of median Nash-Sutcliffe efficiency (NSE), which is 0.73 and 0.61 for LSTM and HMREG, respectively. Moreover, LSTM demonstrates the comparable median NSE with that for basin-scale calibration of GR4J (0.75). Therefore, this study underlines the high utilization potential of deep learning for the PUB by demonstrating the new state-of-the-art performance in this field.

scholarly journals Calibration of hydrological model parameters for ungauged catchments

2007 ◽  
Vol 11 (2) ◽  
pp. 703-710 ◽  
Author(s):  
A. Bárdossy
Keyword(s):  
Hydrological Model ◽  
Model Performance ◽  
Model Parameters ◽  
Hydrological Models ◽  
Rainfall Runoff ◽  
Ungauged Catchments ◽  
Rainfall Runoff Model ◽  
Climate Statistics ◽  
Runoff Model ◽  
German Part

Abstract. The parameters of hydrological models for catchments with few or no discharge records can be estimated using regional information. One can assume that catchments with similar characteristics show a similar hydrological behaviour and thus can be modeled using similar model parameters. Therefore a regionalisation of the hydrological model parameters on the basis of catchment characteristics is plausible. However, due to the non-uniqueness of the rainfall-runoff model parameters (equifinality), a workflow of regional parameter estimation by model calibration and a subsequent fit of a regional function is not appropriate. In this paper a different approach for the transfer of entire parameter sets from one catchment to another is discussed. Parameter sets are considered as tranferable if the corresponding model performance (defined as the Nash-Sutclife efficiency) on the donor catchment is good and the regional statistics: means and variances of annual discharges estimated from catchment properties and annual climate statistics for the recipient catchment are well reproduced by the model. The methodology is applied to a set of 16 catchments in the German part of the Rhine catchments. Results show that the parameters transfered according to the above criteria perform well on the target catchments.

scholarly journals Estimating parameter values of a socio-hydrological flood model

2018 ◽  
Vol 379 ◽  
pp. 193-198
Author(s):  
Marlies Holkje Barendrecht ◽  
Alberto Viglione ◽  
Heidi Kreibich ◽  
Sergiy Vorogushyn ◽  
Bruno Merz ◽  
...  
Keyword(s):  
Time Series ◽  
Case Studies ◽  
Hydrological Model ◽  
Promising Tool ◽  
Flood Model ◽  
Modelling Studies ◽  
Data Points ◽  
Few Data ◽  
Parameter Values

Abstract. Socio-hydrological modelling studies that have been published so far show that dynamic coupled human-flood models are a promising tool to represent the phenomena and the feedbacks in human-flood systems. So far these models are mostly generic and have not been developed and calibrated to represent specific case studies. We believe that applying and calibrating these type of models to real world case studies can help us to further develop our understanding about the phenomena that occur in these systems. In this paper we propose a method to estimate the parameter values of a socio-hydrological model and we test it by applying it to an artificial case study. We postulate a model that describes the feedbacks between floods, awareness and preparedness. After simulating hypothetical time series with a given combination of parameters, we sample few data points for our variables and try to estimate the parameters given these data points using Bayesian Inference. The results show that, if we are able to collect data for our case study, we would, in theory, be able to estimate the parameter values for our socio-hydrological flood model.

scholarly journals Conditioning rainfall-runoff model parameters for ungauged catchments and land management impacts analysis

2009 ◽  
Vol 6 (2) ◽  
pp. 1907-1938 ◽  
Author(s):  
N. Bulygina ◽  
N. McIntyre ◽  
H. Wheater
Keyword(s):  
Parameter Space ◽  
Land Management ◽  
Base Flow ◽  
Distributed Model ◽  
Flow Index ◽  
Model Parameters ◽  
Ungauged Catchments ◽  
Management Interventions ◽  
Simulated Event ◽  
Base Flow Index

Abstract. Data scarcity and model over-parameterisation, leading to model equifinality and large prediction uncertainty, are common barriers to effective hydrological modelling. The problem can be alleviated by constraining the prior parameter space using parameter regionalization. A common basis for regionalization in the UK is the HOST database which provides estimates of hydrological indices for different soil classifications. In our study, Base Flow Index is estimated from the HOST database and the power of this index for constraining the parameter space is explored. The method is applied to a highly discretized distributed model of a 12.5 km2 upland catchment in Wales. To assess probabilistic predictions against flow observations, a probabilistic version of the Nash-Sutcliffe efficiency is derived. For six flow gauges with reliable data, this efficiency ranged between 0.70 and 0.81, and inspection of the results shows that the model explains the data well. Knowledge of how Base Flow Index and interception losses may change under future land use management interventions was then used to further condition the model. Two interventions are considered: afforestation of grazed areas, and soil degradation associated with increased grazing intensity. Afforestation leads to median reduction in modelled runoff volume of 24% over the simulated 3 month period; and a median peak flow reduction ranging from 12–15% over the six gauges for the largest simulated event. Uncertainty in all results is suprisingly low and it is concluded that using Base Flow Index estimated from HOST is a simple and potentially powerful method of conditioning the parameter space under current and future land management.

Sign in / Sign up

Export Citation Format

Share Document