Integrating Model Evaluation and Observations into a Production-Release Pipeline

Author(s):  
Philipp S. Sommer ◽  
Ronny Petrik ◽  
Beate Geyer ◽  
Ulrike Kleeberg ◽  
Dietmar Sauer ◽  
...  

<p>The complexity of Earth System and Regional Climate Models represents a considerable challenge for developers. Tuning but also improving one aspect of a model can unexpectedly decrease the performance of others and introduces hidden errors. Reasons are in particular the multitude of output parameters and the shortage of reliable and complete observational datasets. One possibility to overcome these issues is a rigorous and continuous scientific evaluation of the model. This requires standardized model output and, most notably, standardized observational datasets. Additionally, in order to reduce the extra burden for the single scientist, this evaluation has to be as close as possible to the standard workflow of the researcher, and it needs to be flexible enough to adapt it to new scientific questions.</p><p>We present the Free Evaluation System Framework (Freva) implementation within the Helmholtz Coastal Data Center (HCDC) at the Institute of Coastal Research in the Helmholtz-Zentrum Geesthacht (HZG). Various plugins into the Freva software, namely the HZG-EvaSuite, use observational data to perform a standardized evaluation of the model simulation. We present a comprehensive data management infrastructure that copes with the heterogeneity of observations and simulations. This web framework comprises a FAIR and standardized database of both, large-scale and in-situ observations exported to a format suitable for data-model intercomparisons (particularly netCDF following the CF-conventions). Our pipeline links the raw data of the individual model simulations (i.e. the production of the results) to the finally published results (i.e. the released data). </p><p>Another benefit of the Freva-based evaluation is the enhanced exchange between the different compartments of the institute, particularly between the model developers and the data collectors, as Freva contains built-in functionalities to share and discuss results with colleagues. We will furthermore use the tool to strengthen the active communication with the data and software managers of the institute to generate or adapt the evaluation plugins.</p>

2012 ◽  
Vol 16 (6) ◽  
pp. 1709-1723 ◽  
Author(s):  
D. González-Zeas ◽  
L. Garrote ◽  
A. Iglesias ◽  
A. Sordo-Ward

Abstract. An important step to assess water availability is to have monthly time series representative of the current situation. In this context, a simple methodology is presented for application in large-scale studies in regions where a properly calibrated hydrologic model is not available, using the output variables simulated by regional climate models (RCMs) of the European project PRUDENCE under current climate conditions (period 1961–1990). The methodology compares different interpolation methods and alternatives to generate annual times series that minimise the bias with respect to observed values. The objective is to identify the best alternative to obtain bias-corrected, monthly runoff time series from the output of RCM simulations. This study uses information from 338 basins in Spain that cover the entire mainland territory and whose observed values of natural runoff have been estimated by the distributed hydrological model SIMPA. Four interpolation methods for downscaling runoff to the basin scale from 10 RCMs are compared with emphasis on the ability of each method to reproduce the observed behaviour of this variable. The alternatives consider the use of the direct runoff of the RCMs and the mean annual runoff calculated using five functional forms of the aridity index, defined as the ratio between potential evapotranspiration and precipitation. In addition, the comparison with respect to the global runoff reference of the UNH/GRDC dataset is evaluated, as a contrast of the "best estimator" of current runoff on a large scale. Results show that the bias is minimised using the direct original interpolation method and the best alternative for bias correction of the monthly direct runoff time series of RCMs is the UNH/GRDC dataset, although the formula proposed by Schreiber (1904) also gives good results.


2013 ◽  
Vol 13 (2) ◽  
pp. 263-277 ◽  
Author(s):  
C. Dobler ◽  
G. Bürger ◽  
J. Stötter

Abstract. The objectives of the present investigation are (i) to study the effects of climate change on precipitation extremes and (ii) to assess the uncertainty in the climate projections. The investigation is performed on the Lech catchment, located in the Northern Limestone Alps. In order to estimate the uncertainty in the climate projections, two statistical downscaling models as well as a number of global and regional climate models were considered. The downscaling models applied are the Expanded Downscaling (XDS) technique and the Long Ashton Research Station Weather Generator (LARS-WG). The XDS model, which is driven by analyzed or simulated large-scale synoptic fields, has been calibrated using ECMWF-interim reanalysis data and local station data. LARS-WG is controlled through stochastic parameters representing local precipitation variability, which are calibrated from station data only. Changes in precipitation mean and variability as simulated by climate models were then used to perturb the parameters of LARS-WG in order to generate climate change scenarios. In our study we use climate simulations based on the A1B emission scenario. The results show that both downscaling models perform well in reproducing observed precipitation extremes. In general, the results demonstrate that the projections are highly variable. The choice of both the GCM and the downscaling method are found to be essential sources of uncertainty. For spring and autumn, a slight tendency toward an increase in the intensity of future precipitation extremes is obtained, as a number of simulations show statistically significant increases in the intensity of 90th and 99th percentiles of precipitation on wet days as well as the 5- and 20-yr return values.


2021 ◽  
Author(s):  
Antoine Doury ◽  
Samuel Somot ◽  
Sébastien Gadat ◽  
Aurélien Ribes ◽  
Lola Corre

Abstract Providing reliable information on climate change at local scale remains a challenge of first importance for impact studies and policymakers. Here, we propose a novel hybrid downscaling method combining the strengths of both empirical statistical downscaling methods and Regional Climate Models (RCMs). The aim of this tool is to enlarge the size of high-resolution RCM simulation ensembles at low cost.We build a statistical RCM-emulator by estimating the downscaling function included in the RCM. This framework allows us to learn the relationship between large-scale predictors and a local surface variable of interest over the RCM domain in present and future climate. Furthermore, the emulator relies on a neural network architecture, which grants computational efficiency. The RCM-emulator developed in this study is trained to produce daily maps of the near-surface temperature at the RCM resolution (12km). The emulator demonstrates an excellent ability to reproduce the complex spatial structure and daily variability simulated by the RCM and in particular the way the RCM refines locally the low-resolution climate patterns. Training in future climate appears to be a key feature of our emulator. Moreover, there is a huge computational benefit in running the emulator rather than the RCM, since training the emulator takes about 2 hours on GPU, and the prediction is nearly instantaneous. However, further work is needed to improve the way the RCM-emulator reproduces some of the temperature extremes, the intensity of climate change, and to extend the proposed methodology to different regions, GCMs, RCMs, and variables of interest.


2020 ◽  
Vol 61 (81) ◽  
pp. 214-224 ◽  
Author(s):  
Nanna B. Karlsson ◽  
Sebastian Razik ◽  
Maria Hörhold ◽  
Anna Winter ◽  
Daniel Steinhage ◽  
...  

AbstractThe internal stratigraphy of snow and ice as imaged by ground-penetrating radar may serve as a source of information on past accumulation. This study presents results from two ground-based radar surveys conducted in Greenland in 2007 and 2015, respectively. The first survey was conducted during the traverse from the ice-core station NGRIP (North Greenland Ice Core Project) to the ice-core station NEEM (North Greenland Eemian Ice Drilling). The second survey was carried out during the traverse from NEEM to the ice-core station EGRIP (East Greenland Ice Core Project) and then onwards to Summit Station. The total length of the radar profiles is 1427 km. From the radar data, we retrieve the large-scale spatial variation of the accumulation rates in the interior of the ice sheet. The accumulation rates range from 0.11 to 0.26 m a−1 ice equivalent with the lowest values found in the northeastern sector towards EGRIP. We find no evidence of temporal or spatial changes in accumulation rates when comparing the 150-year average accumulation rates with the 321-year average accumulation rates. Comparisons with regional climate models reveal that the models underestimate accumulation rates by up to 35% in northeastern Greenland. Our results serve as a robust baseline to detect present changes in either surface accumulation rates or patterns.


2017 ◽  
Vol 98 (1) ◽  
pp. 79-93 ◽  
Author(s):  
Elizabeth J. Kendon ◽  
Nikolina Ban ◽  
Nigel M. Roberts ◽  
Hayley J. Fowler ◽  
Malcolm J. Roberts ◽  
...  

Abstract Regional climate projections are used in a wide range of impact studies, from assessing future flood risk to climate change impacts on food and energy production. These model projections are typically at 12–50-km resolution, providing valuable regional detail but with inherent limitations, in part because of the need to parameterize convection. The first climate change experiments at convection-permitting resolution (kilometer-scale grid spacing) are now available for the United Kingdom; the Alps; Germany; Sydney, Australia; and the western United States. These models give a more realistic representation of convection and are better able to simulate hourly precipitation characteristics that are poorly represented in coarser-resolution climate models. Here we examine these new experiments to determine whether future midlatitude precipitation projections are robust from coarse to higher resolutions, with implications also for the tropics. We find that the explicit representation of the convective storms themselves, only possible in convection-permitting models, is necessary for capturing changes in the intensity and duration of summertime rain on daily and shorter time scales. Other aspects of rainfall change, including changes in seasonal mean precipitation and event occurrence, appear robust across resolutions, and therefore coarse-resolution regional climate models are likely to provide reliable future projections, provided that large-scale changes from the global climate model are reliable. The improved representation of convective storms also has implications for projections of wind, hail, fog, and lightning. We identify a number of impact areas, especially flooding, but also transport and wind energy, for which very high-resolution models may be needed for reliable future assessments.


2012 ◽  
Vol 9 (1) ◽  
pp. 175-214
Author(s):  
D. González-Zeas ◽  
L. Garrote ◽  
A. Iglesias ◽  
A. Sordo-Ward

Abstract. An important aspect to assess the impact of climate change on water availability is to have monthly time series representative of the current situation. In this context, a simple methodology is presented for application in large-scale studies in regions where a properly calibrated hydrologic model is not available, using the output variables simulated by regional climate models (RCMs) of the European project PRUDENCE under current climate conditions (period 1961–1990). The methodology compares different interpolation methods and alternatives to generate annual times series that minimize the bias with respect to observed values. The objective is to identify the best alternative to obtain bias-corrected, monthly runoff time series from the output of RCM simulations. This study uses information from 338 basins in Spain that cover the entire mainland territory and whose observed values of naturalised runoff have been estimated by the distributed hydrological model SIMPA. Four interpolation methods for downscaling runoff to the basin scale from 10 RCMs are compared with emphasis on the ability of each method to reproduce the observed behavior of this variable. The alternatives consider the use of the direct runoff of the RCMs and the mean annual runoff calculated using five functional forms of the aridity index, defined as the ratio between potential evaporation and precipitation. In addition, the comparison with respect to the global runoff reference of the UNH/GRDC dataset is evaluated, as a contrast of the "best estimator" of current runoff on a large scale. Results show that the bias is minimised using the direct original interpolation method and the best alternative for bias correction of the monthly direct runoff time series of RCMs is the UNH/GRDC dataset, although the formula proposed by Schreiber also gives good results.


2012 ◽  
Vol 12 (21) ◽  
pp. 10535-10544 ◽  
Author(s):  
A. Devasthale ◽  
M. Tjernström ◽  
M. Caian ◽  
M. A. Thomas ◽  
B. H. Kahn ◽  
...  

Abstract. The main purpose of this study is to investigate the influence of the Arctic Oscillation (AO), the dominant mode of natural variability over the northerly high latitudes, on the spatial (horizontal and vertical) distribution of clouds in the Arctic. To that end, we use a suite of sensors onboard NASA's A-Train satellites that provide accurate observations of the distribution of clouds along with information on atmospheric thermodynamics. Data from three independent sensors are used (AQUA-AIRS, CALIOP-CALIPSO and CPR-CloudSat) covering two time periods (winter half years, November through March, of 2002–2011 and 2006–2011, respectively) along with data from the ERA-Interim reanalysis. We show that the zonal vertical distribution of cloud fraction anomalies averaged over 67–82° N to a first approximation follows a dipole structure (referred to as "Greenland cloud dipole anomaly", GCDA), such that during the positive phase of the AO, positive and negative cloud anomalies are observed eastwards and westward of Greenland respectively, while the opposite is true for the negative phase of AO. By investigating the concurrent meteorological conditions (temperature, humidity and winds), we show that differences in the meridional energy and moisture transport during the positive and negative phases of the AO and the associated thermodynamics are responsible for the conditions that are conducive for the formation of this dipole structure. All three satellite sensors broadly observe this large-scale GCDA despite differences in their sensitivities, spatio-temporal and vertical resolutions, and the available lengths of data records, indicating the robustness of the results. The present study also provides a compelling case to carry out process-based evaluation of global and regional climate models.


2016 ◽  
Vol 10 (4) ◽  
pp. 1679-1694 ◽  
Author(s):  
Thomas B. Overly ◽  
Robert L. Hawley ◽  
Veit Helm ◽  
Elizabeth M. Morris ◽  
Rohan N. Chaudhary

Abstract. We report annual snow accumulation rates from 1959 to 2004 along a 250 km segment of the Expéditions Glaciologiques Internationales au Groenland (EGIG) line across central Greenland using Airborne SAR/Interferometric Radar Altimeter System (ASIRAS) radar layers and high resolution neutron-probe (NP) density profiles. ASIRAS-NP-derived accumulation rates are not statistically different (95 % confidence interval) from in situ EGIG accumulation measurements from 1985 to 2004. ASIRAS-NP-derived accumulation increases by 20 % below 3000 m elevation, and increases by 13 % above 3000 m elevation for the period 1995 to 2004 compared to 1985 to 1994. Three Regional Climate Models (PolarMM5, RACMO2.3, MAR) underestimate snow accumulation below 3000 m by 16–20 % compared to ASIRAS-NP from 1985 to 2004. We test radar-derived accumulation rates sensitivity to density using modeled density profiles in place of NP densities. ASIRAS radar layers combined with Herron and Langway (1980) model density profiles (ASIRAS-HL) produce accumulation rates within 3.5 % of ASIRAS-NP estimates in the dry snow region. We suggest using Herron and Langway (1980) density profiles to calibrate radar layers detected in dry snow regions of ice sheets lacking detailed in situ density measurements, such as those observed by the Operation IceBridge campaign.


2015 ◽  
Vol 2015 ◽  
pp. 1-13 ◽  
Author(s):  
Michal Belda ◽  
Petr Skalák ◽  
Aleš Farda ◽  
Tomáš Halenka ◽  
Michel Déqué ◽  
...  

Regional climate models (RCMs) are important tools used for downscaling climate simulations from global scale models. In project CECILIA, two RCMs were used to provide climate change information for regions of Central and Eastern Europe. Models RegCM and ALADIN-Climate were employed in downscaling global simulations from ECHAM5 and ARPEGE-CLIMAT under IPCC A1B emission scenario in periods 2021–2050 and 2071–2100. Climate change signal present in these simulations is consistent with respective driving data, showing similar large-scale features: warming between 0 and 3°C in the first period and 2 and 5°C in the second period with the least warming in northwestern part of the domain increasing in the southeastern direction and small precipitation changes within range of +1 to −1 mm/day. Regional features are amplified by the RCMs, more so in case of the ALADIN family of models.


2012 ◽  
Vol 51 (1) ◽  
pp. 100-114 ◽  
Author(s):  
Robert E. Nicholas ◽  
David S. Battisti

AbstractThis study describes an EOF-based technique for statistical downscaling of high-spatial-resolution monthly-mean precipitation from large-scale reanalysis circulation fields. The method is demonstrated and evaluated for four widely separated locations: the southeastern United States, the upper Colorado River basin, China’s Jiangxi Province, and central Europe. For each location, the EOF-based downscaling models successfully reproduce the observed annual cycle while eliminating the biases seen in NCEP–NCAR reanalysis precipitation. They also frequently reproduce the monthly precipitation anomalies with greater fidelity than is seen in the precipitation field derived directly from reanalysis, and they outperform a suite of regional climate models over the two U.S. locations. With the relatively high skill achieved over a range of climate regimes, this technique may be a viable alternative to numerical downscaling of monthly-mean precipitation for many locations.


Sign in / Sign up

Export Citation Format

Share Document