scholarly journals Technical note: PMR – a proxy metric to assess hydrological model robustness in a changing climate

2021 ◽  
Vol 25 (11) ◽  
pp. 5703-5716
Author(s):  
Paul Royer-Gaspard ◽  
Vazken Andréassian ◽  
Guillaume Thirel

Abstract. The ability of hydrological models to perform in climatic conditions different from those encountered in calibration is crucial to ensure a reliable assessment of the impact of climate change on river regimes and water availability. However, most evaluation studies based on the differential split-sample test (DSST) endorsed the consensus that rainfall–runoff models lack climatic robustness. Models applied under climatologically different conditions typically exhibit substantial errors in streamflow volumes. In this technical note, we propose a new performance metric to evaluate model robustness without applying the DSST, and it can be performed with a single hydrological model calibration. The proxy for model robustness (PMR) is based on the systematic computation of model error on sliding sub-periods of the whole streamflow time series. We demonstrate that the PMR metric shows patterns similar to those obtained with the DSST for a conceptual model on a set of 377 French catchments. An analysis of the sensitivity to the length of the sub-periods shows that this length influences the values of the PMR and its equivalency with DSST biases. We recommend a range of a few years for the choice of sub-period lengths, although this should be context dependent. Our work makes it possible to evaluate the temporal transferability of any hydrological model, including uncalibrated models, at a very low computational cost.

2021 ◽  
Author(s):  
Paul Royer-Gaspard ◽  
Vazken Andréassian ◽  
Guillaume Thirel

Abstract. The ability of hydrological models to perform in climatic conditions different from those encountered in calibration is crucial to ensure a reliable assessment of the impact of climate change in water management sectors. However, most evaluation studies based on the Differential Split-Sample Test (DSST) endorsed the consensus that rainfall-runoff models lack climatic robustness. Models typically exhibit substantial errors on streamflow volumes applied under climatologically different conditions. In this technical note, we propose a new performance metric to evaluate model robustness without applying the DSST and which performs with a single hydrological model calibration. The Proxy for Model Robustness (PMR) is based on the systematic computation of model error on sliding sub-periods of the whole streamflow time series. We demonstrate that the metric shows patterns similar to those obtained with the DSST for a conceptual model on a set of 377 French catchments. An analysis of sensitivity to the length of the sub-periods shows that this length influences the values of the PMR and its adequation with DSST biases. We recommend a range of a few years for the choice of sub-period lengths, although this should be context-dependent. Our work makes it possible to evaluate the temporal transferability of any hydrological model, including uncalibrated models, at a very low computational cost.


2021 ◽  
Author(s):  
Vazken Andréassian ◽  
Léonard Santos ◽  
Torben Sonnenborg ◽  
Alban de Lavenne ◽  
Göran Lindström ◽  
...  

<p>Hydrological models are increasingly used under evolving climatic conditions. They should thus be evaluated regarding their temporal transferability (application in different time periods) and extrapolation capacity (application beyond the range of known past conditions). In theory, parameters of hydrological models are independent of climate. In practice, however, many published studies based on the Split-Sample Test (Klemeš, 1986), have shown that model performances decrease systematically when it is used out of its calibration period. The RAT test proposed here aims at evaluating model robustness to a changing climate by assessing potential undesirable dependencies of hydrological model performances to climate variables. The test compares, over a long data period, the annual value of several climate variables (temperature, precipitation and aridity index) and the bias of the model over each year. If a significant relation exists between the climatic variable and the bias, the model is not considered to be robust to climate change on the catchment. The test has been compared to the Generalized Split-Sample Test (Coron et al., 2012) and showed similar results.</p><p>Here, we report on a large scale application of the test for three hydrological models with different level of complexity (GR6J, HYPE, MIKE-SHE) on a data set of 352 catchments in Denmark, France and Sweden. The results show that the test behaves differently given the evaluated variable (be temperature, precipitation or aridity) and the hydrological characteristics of each catchment. They also show that, although of different level of complexity, the robustness of the three models is similar on the overall data set. However, they are not robust on the same catchments and, then, are not sensitive to the same hydrological characteristics. This example highlights the applicability of the RAT test regardless of the model set-up and calibration procedure and its ability to provide a first evaluation of the model robustness to climate change.</p><p> </p><p><strong>References</strong></p><p>Coron, L., V. Andréassian, C. Perrin, J. Lerat, J. Vaze, M. Bourqui, and F. Hendrickx, 2012. Crash testing hydrological models in contrasted climate conditions: An experiment on 216 Australian catchments, Water Resour. Res., 48, W05552, doi:10.1029/2011WR011721</p><p>Klemeš, V., 1986. Operational testing of hydrological simulation models, Hydrol. Sci. J., 31, 13–24, doi:10.1080/02626668609491024</p><p> </p>


2017 ◽  
Author(s):  
Tingju Zhu ◽  
Petra Döll ◽  
Hannes Müller Schmied ◽  
Claudia Ringler ◽  
Mark W. Rosegrant

Abstract. This paper describes the IMPACT Global Hydrological Model (IGHM), a component of the International Model for Policy Analysis of Agricultural Commodities and Trade (IMPACT) integrated modeling system. IMPACT has been developed in the early 1990s to identify and analyze long-term challenges and opportunities for food, agriculture, and natural resources at global and regional scales and builds on a series of previous food demand and supply projections models developed at the International Food Policy Research Institute since the early 1980s. The IGHM has been developed to assess water availability and variability as drivers of water use and irrigated crop production in IMPACT. It adopts a saturation runoff generation scheme and uses a linear groundwater reservoir to simulate base flow in 0.5º latitude by 0.5º longitude grid cells over the global land surface excluding Antarctica. The IGHM has four cell-specific calibration parameters, which are determined through maximizing the Kling–Gupta efficiency (KGE) with a genetic algorithm at the grid cell level, using gridded natural runoff series generated by the WaterGAP Global Hydrological Model (WGHM). During the calibration and validation periods, globally, the majority of grid cells attain KGE values greater than 0.50. As a meta-model of the more computationally expensive WGHM, IGHM transfers the climate-hydrology dynamics provided by WGHM into the integrated IMPACT model at a lower computational cost and enables coupling hydrology and other related processes considered in IMPACT which are important for analyzing long-term water and food security under a range of environmental and socioeconomic changes.


2012 ◽  
Vol 16 (4) ◽  
pp. 1239-1254 ◽  
Author(s):  
C. Z. Li ◽  
L. Zhang ◽  
H. Wang ◽  
Y. Q. Zhang ◽  
F. L. Yu ◽  
...  

Abstract. This paper investigates issues involved in calibrating hydrological models against observed data when the aim of the modelling is to predict future runoff under different climatic conditions. To achieve this objective, we tested two hydrological models, DWBM and SIMHYD, using data from 30 unimpaired catchments in Australia which had at least 60 yr of daily precipitation, potential evapotranspiration (PET), and streamflow data. Nash-Sutcliffe efficiency (NSE), modified index of agreement (d1) and water balance error (WBE) were used as performance criteria. We used a differential split-sample test to split up the data into 120 sub-periods and 4 different climatic sub-periods in order to assess how well the calibrated model could be transferred different periods. For each catchment, the models were calibrated for one sub-period and validated on the other three. Monte Carlo simulation was used to explore parameter stability compared to historic climatic variability. The chi-square test was used to measure the relationship between the distribution of the parameters and hydroclimatic variability. The results showed that the performance of the two hydrological models differed and depended on the model calibration. We found that if a hydrological model is set up to simulate runoff for a wet climate scenario then it should be calibrated on a wet segment of the historic record, and similarly a dry segment should be used for a dry climate scenario. The Monte Carlo simulation provides an effective and pragmatic approach to explore uncertainty and equifinality in hydrological model parameters. Some parameters of the hydrological models are shown to be significantly more sensitive to the choice of calibration periods. Our findings support the idea that when using conceptual hydrological models to assess future climate change impacts, a differential split-sample test and Monte Carlo simulation should be used to quantify uncertainties due to parameter instability and non-uniqueness.


2021 ◽  
Author(s):  
Pierre Nicolle ◽  
Vazken Andréassian ◽  
Paul Royer-Gaspard ◽  
Charles Perrin ◽  
Guillaume Thirel ◽  
...  

Abstract. In this note, we present RAT, a new method to assess the robustness of hydrological models. RAT can be seen as an alternative to the classical split-sample test widely used in hydrology. And because the RAT method does not require multiple calibrations, we suggest that it can be applied even to uncalibrated models. The RAT method can be used to determine whether a hydrological model is "safe" for being used for climate change impact studies.


2011 ◽  
Vol 8 (5) ◽  
pp. 8701-8736 ◽  
Author(s):  
C. Z. Li ◽  
L. Zhang ◽  
H. Wang ◽  
Y. Q. Zhang ◽  
F. L. Yu ◽  
...  

Abstract. This paper investigates issues involved in calibrating hydrological models against observed data when the aim of the modelling is to predict future runoff under different climatic conditions. To achieve this objective, we tested two hydrological models, DWBM and SIMHYD, using data from 30 unimpaired catchments in Australia which had at least 60 years of daily precipitation, potential evapotranspiration (PET), and streamflow data. Nash-Sutcliffe efficiency (NSE) and absolute percentage water balance error (WBE) were used as performance criteria. We used a differential split-sample test to split up the data into 120 sub-periods and 4 different climatic sub-periods in order to assess how well the calibrated model could be transferred different periods. For each catchment, the models were calibrated for one sub-period and validated on the other three. Monte Carlo simulation was used to explore parameter stability compared to historic climatic variability. The chi-square test was used to measure the relationship between the distribution of the parameters and hydroclimatic variability. The results showed that the performance of the two hydrological models differed and depended on the model calibration. We found that if a hydrological model is set up to simulate runoff for a wet climate scenario then it should be calibrated on a wet segment of the historic record, and similarly a dry segment should be used for a dry climate scenario. The Monte Carlo simulation provides an effective and pragmatic approach to explore uncertainty and equifinality in hydrological model parameters. Some parameters of the hydrological models are shown to be significantly more sensitive to the choice of calibration periods. Our findings support the idea that when using conceptual hydrological models to assess future climate change impacts, a differential split-sample test and Monte Carlo simulation can reduce uncertainties due to parameter instability and non-uniqueness.


2020 ◽  
pp. 50-64
Author(s):  
Kuladeep Kumar Sadevi ◽  
Avlokita Agrawal

With the rise in awareness of energy efficient buildings and adoption of mandatory energy conservation codes across the globe, significant change is being observed in the way the buildings are designed. With the launch of Energy Conservation Building Code (ECBC) in India, climate responsive designs and passive cooling techniques are being explored increasingly in building designs. Of all the building envelope components, roof surface has been identified as the most significant with respect to the heat gain due to the incident solar radiation on buildings, especially in tropical climatic conditions. Since ECBC specifies stringent U-Values for roof assembly, use of insulating materials is becoming popular. Along with insulation, the shading of the roof is also observed to be an important strategy for improving thermal performance of the building, especially in Warm and humid climatic conditions. This study intends to assess the impact of roof shading on building’s energy performance in comparison to that of exposed roof with insulation. A typical office building with specific geometry and schedules has been identified as base case model for this study. This building is simulated using energy modelling software ‘Design Builder’ with base case parameters as prescribed in ECBC. Further, the same building has been simulated parametrically adjusting the amount of roof insulation and roof shading simultaneously. The overall energy consumption and the envelope performance of the top floor are extracted for analysis. The results indicate that the roof shading is an effective passive cooling strategy for both naturally ventilated and air conditioned buildings in Warm and humid climates of India. It is also observed that a fully shaded roof outperforms the insulated roof as per ECBC prescription. Provision of shading over roof reduces the annual energy consumption of building in case of both insulated and uninsulated roofs. However, the impact is higher for uninsulated roofs (U-Value of 3.933 W/m2K), being 4.18% as compared to 0.59% for insulated roofs (U-Value of 0.33 W/m2K).While the general assumption is that roof insulation helps in reducing the energy consumption in tropical buildings, it is observed to be the other way when insulation is provided with roof shading. It is due to restricted heat loss during night.


Author(s):  
S.E. Rudov ◽  
◽  
V.Ya. Shapiro ◽  
O.I. Grigoreva ◽  
I.V. Grigorev ◽  
...  

In the Russian Federation logging operations are traditionally carried out in winter. This is due to the predominance of areas with swamped and water-logged (class III and IV) soils in the forest fund, where work of forestry equipment is difficult, and sometimes impossible in the warm season. The work of logging companies in the forests of the cryolithozone, characterized by a sharply continental climate, with severe frosts in winter, is hampered by the fact that forest machines are not recommended to operate at temperatures below –40 °C due to the high probability of breaking of metal structures and hydraulic system. At the same time, in the warm season, most of the cutting areas on cryosolic soils become difficult to pass for heavy forest machines. It turns out that the convenient period for logging in the forests of the cryolithozone is quite small. This results in the need of work in the so-called off-season period, when the air temperature becomes positive, and the thawing processes of the soil top layer begin. The same applies to the logging companies not operating in the conditions of cryosolic soils, for instance, in the Leningrad, Novgorod, Pskov, Vologda regions, etc. The observed climate warming has led to a significant reduction in the sustained period of winter logging. Frequent temperature transitions around 0 °C in winter, autumn and spring necessitate to work during the off-season too, while cutting areas thaw. In bad seasonal and climatic conditions, which primarily include off-season periods in general and permafrost in particular, it is very difficult to take into account in mathematical models features of soil freezing and thawing and their effect on the destruction nature. The article shows that the development of long-term predictive models of indicators of cyclic interaction between the skidding system and forest soil in adverse climatic conditions of off-season logging operations in order to improve their reliability requires rapid adjustment of the calculated parameters based on the actual experimental data at a given step of the cycles.


Molecules ◽  
2021 ◽  
Vol 26 (12) ◽  
pp. 3746
Author(s):  
Magdalena Polak-Śliwińska ◽  
Małgorzata Tańska

The benefits of natural honeybee products (e.g., honey, royal jelly, beeswax, propolis, beevenom and pollen) to the immune system are remarkable, and many of them are involved in the induction of antibody production, maturation of immune cells and stimulation of the immune system. The type of plants in the geographical area, climatic conditions and production method have a significantly influence on the nutritional quality of honey. However, this variability can influence consumer liking by the sensory attributes of the product. The aim of this work was to compare the most popular honeys from Poland in terms of nutritional value, organoleptic properties and antioxidant activity. In the study, five varieties of honey (honeydew, forest, buckwheat, linden and dandelion) from conventional and organic production methods were tested. The nutritional characteristics of honey samples included acidity, content of water, sugars, vitamin C, HMF and phenolics (total and flavonoids), while honey color, taste, aroma and consistency were investigated in the organoleptic characteristics. The antioxidant activity was determined in water- and ethanol-soluble honey extracts using DPPH and ORAC tests. The results showed that organoleptic and nutritional characteristics of popular Polish honeys differ significantly in relation to plant source and production method. The significant effect of honey variety on the content of HMF, saccharose and phenolics, as well as acidity and antioxidant capacity were noted. The impact of variety and variety × production method interaction was significant in the case of the content of vitamin C, glucose and fructose. A visible difference of buckwheat and forest honeys from other samples was observed. The highest content of total phenolics with antioxidant activity based on the SET mechanism was found in buckwheat honeys, while forest honeys were richer in flavonoids.


Sign in / Sign up

Export Citation Format

Share Document