Web-based post-processing workflow composition for CMIP6

Author(s):  
Martin Schupfner ◽  
Fabian Wachsmann

<p>CMIP6 defines a data standard as well as a data request (DReq) in order to facilitate analysis across results from different climate models. For most model output, post-processing is required to make it CMIP6 compliant. The German Federal Ministry of Education and Research (BMBF) is funding a project [1] providing services which help with the production of quality-assured CMIP6 compliant data according to the DReq. </p><p> </p><p>In that project, a web-based GUI [2] has been developed which guides the modelers through the different steps of the data post-processing workflow, allowing to orchestrate the aggregation, diagnostic and standardizing of the model data in a modular manner. Therefor the website provides several functionalities:<br>1. A DReq generator, based on Martin Juckes’ DreqPy API [3], can be used to tailor the DReq according to the envisaged experiments and supported MIPs. Moreover, the expected data volume can be calculated.</p><p>2. The mapping between variables of the DReq and of the raw model output can be specified. These specifications (model variable names, units, etc.) may include diagnostic algorithms and are stored in a database. </p><p>3. The variable mapping information can be retrieved as a mapping table (MT). Additionally, this information can be used to create post-processing script fragments. One of the script fragments contains processing commands based on the diagnostic algorithms entered into the mapping GUI, whereas the other rewrites the (diagnosed) data in a CMIP6 compliant format. Both script fragments use the CDO tool kit [4] developed at the Max Planck Institute for Meteorology, namely the CDO expr and cmor [5] operators. The latter makes use of the CMOR3 library [6] and parses the MT. The script fragments are meant to be integrated into CMIP6 data workflows or scripts. A template for such a script, that allows for a modular and flexible process control of the single workflow steps, will be included when downloading the script fragments.</p><p>4. User specific metadata can be generated, which supply the CDO cmor operator with the required and correct metadata as specified in the CMIP6 controlled vocabulary (CV).</p><p> </p><p>[1] National CMIP6 Support Activities. https://www.dkrz.de/c6de , last access 9.1.2020.</p><p>[2] Martin Schupfner (2018): CMIP6 Data Request WebGUI. https://c6dreq.dkrz.de/ , last access 9.1.2020.</p><p>[3] Martin Juckes (2018): Data Request Python API. Vers. 01.00.28. http://proj.badc.rl.ac.uk/svn/exarch/CMIP6dreq/tags/latest/dreqPy/docs/dreqPy.pdf , last access 9.1.2020.  </p><p>[4] Uwe Schulzweida (2019): CDO User Guide. Climate Data Operators. Vers. 1.9.8. https://code.mpimet.mpg.de/projects/cdo/embedded/cdo.pdf , last access 9.1.2020.</p><p>[5] Fabian Wachsmann (2017): The cdo cmor operator. https://code.mpimet.mpg.de/attachments/19411/cdo_cmor.pdf , last access 9.1.2020.</p><p>[6] Denis Nadeau (2018): CMOR version 3.3. https://cmor.llnl.gov/pdf/mydoc.pdf , last access 9.1.2020.</p>

2020 ◽  
Author(s):  
Fabian Wachsmann

<p>The Climate Data Operators [1] tool kit (CDO) is a worldwide popular infrastructure software developed and maintained at the Max Planck Institute for Meteorology (MPI-M). It comprises a large number of command line operators for gridded data, including statistics, interpolation, or arithmetics. Users benefit from the extensive support facilities provided by the MPI-M and the DKRZ.</p><p>As a part of the sixth phase of the Coupled Model Intercomparison Project (CMIP6), the German Federal Ministry of Education and Research (BMBF) is funding activities promoting the use of the CDOs for CMIP6 data preparation and analysis.  </p><p>The operator ‘cmor’ has been developed to enable users to prepare their data according to the CMIP6 data standard. It is part of the web-based CMIP6 post-processing infrastructure [2] which is developed at DKRZ and used by different Earth System Models. The CDO metadata and its data model have been expanded to include the CMIP6 data standard so that users can use the tool for project data evaluation.</p><p>As a second activity, operators for 27 climate extremes indices, which were defined by the Expert Team on Climate Change Detection and Indices (ETCCDI), have been integrated into the tool. As with CMIP5, the ETCCDI climate extremes indices will be part of CMIP6 model analyses due to their robustness and straightforward interpretation.</p><p>This contribution provides an insight into advanced CDO application and offers ideas for post-processing optimization. </p><p>[1] Schulzweida, U. (2019): CDO user guide. code.mpimet.mpg.de/projects/cdo , last access: 01.13.2020.</p><p>[2] Schupfner, M. (2020):  The CMIP6 Data Request WebGUI. c6dreq.dkrz.de , last access: 01.13.2020.</p>


2020 ◽  
Author(s):  
Florian Ziemen ◽  
Niklas Röber ◽  
Dela Spickermann ◽  
Michael Böttinger

<p>The new generation of global storm-resolving climate models yields model output at unprecedented resolution, going way beyond what can be displayed on a state-of-the-art computer screen. This data can be visualized in photo-realistic renderings that cannot be easily distinguished from satellite data (e.g. Stevens et al, 2019). The EU-funded Centre of Excellence in Simulation of Weather and Climate in Europe (ESiWACE) enables this kind of simulations through improvements of model performance, data storage and processing. It is closely related with the DYAMOND model intercomparison project. The Max-Planck-Institute for Meteorology (MPI-M) will contribute to the second phase of the DYAMOND intercomparison with coupled global 5 km-resolving atmosphere-ocean climate simulations, internally called DYAMOND++.<br><br>Because of the great level of detail, these simulations are especially appealing for scientific outreach. In this PICO presentation we will illustrate how we turn the output of a DYAMOND++ test simulation into a movie clip for dome theaters, as used in the WISDOME contest of the IEEE EUROVIS conference and in planetaria and science centers. Our presentation outlines the main steps of this process from data generation via pre-processing to the methods employed in the rendering of the scenes.</p><p>Stevens, B., Satoh, M., Auger, L. et al.: DYAMOND: the DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains. Prog Earth Planet Sci (2019) 6: 61. https://doi.org/10.1186/s40645-019-0304-z</p>


Water ◽  
2021 ◽  
Vol 13 (11) ◽  
pp. 1548
Author(s):  
Suresh Marahatta ◽  
Deepak Aryal ◽  
Laxmi Prasad Devkota ◽  
Utsav Bhattarai ◽  
Dibesh Shrestha

This study aims at analysing the impact of climate change (CC) on the river hydrology of a complex mountainous river basin—the Budhigandaki River Basin (BRB)—using the Soil and Water Assessment Tool (SWAT) hydrological model that was calibrated and validated in Part I of this research. A relatively new approach of selecting global climate models (GCMs) for each of the two selected RCPs, 4.5 (stabilization scenario) and 8.5 (high emission scenario), representing four extreme cases (warm-wet, cold-wet, warm-dry, and cold-dry conditions), was applied. Future climate data was bias corrected using a quantile mapping method. The bias-corrected GCM data were forced into the SWAT model one at a time to simulate the future flows of BRB for three 30-year time windows: Immediate Future (2021–2050), Mid Future (2046–2075), and Far Future (2070–2099). The projected flows were compared with the corresponding monthly, seasonal, annual, and fractional differences of extreme flows of the simulated baseline period (1983–2012). The results showed that future long-term average annual flows are expected to increase in all climatic conditions for both RCPs compared to the baseline. The range of predicted changes in future monthly, seasonal, and annual flows shows high uncertainty. The comparative frequency analysis of the annual one-day-maximum and -minimum flows shows increased high flows and decreased low flows in the future. These results imply the necessity for design modifications in hydraulic structures as well as the preference of storage over run-of-river water resources development projects in the study basin from the perspective of climate resilience.


2021 ◽  
Author(s):  
Thordis Thorarinsdottir ◽  
Jana Sillmann ◽  
Marion Haugen ◽  
Nadine Gissibl ◽  
Marit Sandstad

<p>Reliable projections of extremes in near-surface air temperature (SAT) by climate models become more and more important as global warming is leading to significant increases in the hottest days and decreases in coldest nights around the world with considerable impacts on various sectors, such as agriculture, health and tourism.</p><p>Climate model evaluation has traditionally been performed by comparing summary statistics that are derived from simulated model output and corresponding observed quantities using, for instance, the root mean squared error (RMSE) or mean bias as also used in the model evaluation chapter of the fifth Assessment Report of the Intergovernmental Panel on Climate Change (IPCC AR5). Both RMSE and mean bias compare averages over time and/or space, ignoring the variability, or the uncertainty, in the underlying values. Particularly when interested in the evaluation of climate extremes, climate models should be evaluated by comparing the probability distribution of model output to the corresponding distribution of observed data.</p><p>To address this shortcoming, we use the integrated quadratic distance (IQD) to compare distributions of simulated indices to the corresponding distributions from a data product. The IQD is the proper divergence associated with the proper continuous ranked probability score (CRPS) as it fulfills essential decision-theoretic properties for ranking competing models and testing equality in performance, while also assessing the full distribution.</p><p>The IQD is applied to evaluate CMIP5 and CMIP6 simulations of monthly maximum (TXx) and minimum near-surface air temperature (TNn) over the data-dense regions Europe and North America against both observational and reanalysis datasets. There is not a notable difference between the model generations CMIP5 and CMIP6 when the model simulations are compared against the observational dataset HadEX2. However, the CMIP6 models show a better agreement with the reanalysis ERA5 than CMIP5 models, with a few exceptions. Overall, the climate models show higher skill when compared against ERA5 than when compared against HadEX2. While the model rankings vary with region, season and index, the model evaluation is robust against changes in the grid resolution considered in the analysis.</p>


2008 ◽  
Vol 21 (22) ◽  
pp. 6052-6059 ◽  
Author(s):  
B. Timbal ◽  
P. Hope ◽  
S. Charles

Abstract The consistency between rainfall projections obtained from direct climate model output and statistical downscaling is evaluated. Results are averaged across an area large enough to overcome the difference in spatial scale between these two types of projections and thus make the comparison meaningful. Undertaking the comparison using a suite of state-of-the-art coupled climate models for two forcing scenarios presents a unique opportunity to test whether statistical linkages established between large-scale predictors and local rainfall under current climate remain valid in future climatic conditions. The study focuses on the southwest corner of Western Australia, a region that has experienced recent winter rainfall declines and for which climate models project, with great consistency, further winter rainfall reductions due to global warming. Results show that as a first approximation the magnitude of the modeled rainfall decline in this region is linearly related to the model global warming (a reduction of about 9% per degree), thus linking future rainfall declines to future emission paths. Two statistical downscaling techniques are used to investigate the influence of the choice of technique on projection consistency. In addition, one of the techniques was assessed using different large-scale forcings, to investigate the impact of large-scale predictor selection. Downscaled and direct model projections are consistent across the large number of models and two scenarios considered; that is, there is no tendency for either to be biased; and only a small hint that large rainfall declines are reduced in downscaled projections. Among the two techniques, a nonhomogeneous hidden Markov model provides greater consistency with climate models than an analog approach. Differences were due to the choice of the optimal combination of predictors. Thus statistically downscaled projections require careful choice of large-scale predictors in order to be consistent with physically based rainfall projections. In particular it was noted that a relative humidity moisture predictor, rather than specific humidity, was needed for downscaled projections to be consistent with direct model output projections.


2018 ◽  
Vol 11 (6) ◽  
pp. 2033-2048 ◽  
Author(s):  
Richard Hyde ◽  
Ryan Hossaini ◽  
Amber A. Leeson

Abstract. Clustering – the automated grouping of similar data – can provide powerful and unique insight into large and complex data sets, in a fast and computationally efficient manner. While clustering has been used in a variety of fields (from medical image processing to economics), its application within atmospheric science has been fairly limited to date, and the potential benefits of the application of advanced clustering techniques to climate data (both model output and observations) has yet to be fully realised. In this paper, we explore the specific application of clustering to a multi-model climate ensemble. We hypothesise that clustering techniques can provide (a) a flexible, data-driven method of testing model–observation agreement and (b) a mechanism with which to identify model development priorities. We focus our analysis on chemistry–climate model (CCM) output of tropospheric ozone – an important greenhouse gas – from the recent Atmospheric Chemistry and Climate Model Intercomparison Project (ACCMIP). Tropospheric column ozone from the ACCMIP ensemble was clustered using the Data Density based Clustering (DDC) algorithm. We find that a multi-model mean (MMM) calculated using members of the most-populous cluster identified at each location offers a reduction of up to ∼ 20 % in the global absolute mean bias between the MMM and an observed satellite-based tropospheric ozone climatology, with respect to a simple, all-model MMM. On a spatial basis, the bias is reduced at ∼ 62 % of all locations, with the largest bias reductions occurring in the Northern Hemisphere – where ozone concentrations are relatively large. However, the bias is unchanged at 9 % of all locations and increases at 29 %, particularly in the Southern Hemisphere. The latter demonstrates that although cluster-based subsampling acts to remove outlier model data, such data may in fact be closer to observed values in some locations. We further demonstrate that clustering can provide a viable and useful framework in which to assess and visualise model spread, offering insight into geographical areas of agreement among models and a measure of diversity across an ensemble. Finally, we discuss caveats of the clustering techniques and note that while we have focused on tropospheric ozone, the principles underlying the cluster-based MMMs are applicable to other prognostic variables from climate models.


2012 ◽  
Vol 9 (8) ◽  
pp. 9847-9884
Author(s):  
N. Guyennon ◽  
E. Romano ◽  
I. Portoghese ◽  
F. Salerno ◽  
S. Calmanti ◽  
...  

Abstract. Various downscaling techniques have been developed to bridge the scale gap between global climate models (GCMs) and finer scales required to assess hydrological impacts of climate change. Such techniques may be grouped into two downscaling approaches: the deterministic dynamical downscaling (DD) and the stochastic statistical downscaling (SD). Although SD has been traditionally seen as an alternative to DD, recent works on statistical downscaling have aimed to combine the benefits of these two approaches. The overall objective of this study is to examine the relative benefits of each downscaling approach and their combination in making the GCM scenarios suitable for basin scale hydrological applications. The case study presented here focuses on the Apulia region (South East of Italy, surface area about 20 000 km2), characterized by a typical Mediterranean climate; the monthly cumulated precipitation and monthly mean of daily minimum and maximum temperature distribution were examined for the period 1953–2000. The fifth-generation ECHAM model from the Max-Planck-Institute for Meteorology was adopted as GCM. The DD was carried out with the Protheus system (ENEA), while the SD was performed through a monthly quantile-quantile transform. The SD resulted efficient in reducing the mean bias in the spatial distribution at both annual and seasonal scales, but it was not able to correct the miss-modeled non-stationary components of the GCM dynamics. The DD provided a partial correction by enhancing the trend spatial heterogeneity and time evolution predicted by the GCM, although the comparison with observations resulted still underperforming. The best results were obtained through the combination of both DD and SD approaches.


2021 ◽  
Vol 15 (2) ◽  
pp. 1131-1156
Author(s):  
Marie-Luise Kapsch ◽  
Uwe Mikolajewicz ◽  
Florian A. Ziemen ◽  
Christian B. Rodehacke ◽  
Clemens Schannwell

Abstract. A realistic simulation of the surface mass balance (SMB) is essential for simulating past and future ice-sheet changes. As most state-of-the-art Earth system models (ESMs) are not capable of realistically representing processes determining the SMB, most studies of the SMB are limited to observations and regional climate models and cover the last century and near future only. Using transient simulations with the Max Planck Institute ESM in combination with an energy balance model (EBM), we extend previous research and study changes in the SMB and equilibrium line altitude (ELA) for the Northern Hemisphere ice sheets throughout the last deglaciation. The EBM is used to calculate and downscale the SMB onto a higher spatial resolution than the native ESM grid and allows for the resolution of SMB variations due to topographic gradients not resolved by the ESM. An evaluation for historical climate conditions (1980–2010) shows that derived SMBs compare well with SMBs from regional modeling. Throughout the deglaciation, changes in insolation dominate the Greenland SMB. The increase in insolation and associated warming early in the deglaciation result in an ELA and SMB increase. The SMB increase is caused by compensating effects of melt and accumulation: the warming of the atmosphere leads to an increase in melt at low elevations along the ice-sheet margins, while it results in an increase in accumulation at higher levels as a warmer atmosphere precipitates more. After 13 ka, the increase in melt begins to dominate, and the SMB decreases. The decline in Northern Hemisphere summer insolation after 9 ka leads to an increasing SMB and decreasing ELA. Superimposed on these long-term changes are centennial-scale episodes of abrupt SMB and ELA decreases related to slowdowns of the Atlantic meridional overturning circulation (AMOC) that lead to a cooling over most of the Northern Hemisphere.


2021 ◽  
Author(s):  
Michael Steininger ◽  
Daniel Abel ◽  
Katrin Ziegler ◽  
Anna Krause ◽  
Heiko Paeth ◽  
...  

<p>Climate models are an important tool for the assessment of prospective climate change effects but they suffer from systematic and representation errors, especially for precipitation. Model output statistics (MOS) reduce these errors by fitting the model output to observational data with machine learning. In this work, we explore the feasibility and potential of deep learning with convolutional neural networks (CNNs) for MOS. We propose the CNN architecture ConvMOS specifically designed for reducing errors in climate model outputs and apply it to the climate model REMO. Our results show a considerable reduction of errors and mostly improved performance compared to three commonly used MOS approaches.</p>


Abstract Climate trends have been observed over the recent decades in many parts of the world, but current global climate models (GCMs) for seasonal climate forecasting often fail to capture these trends. As a result, model forecasts may be biased above or below the trendline. In our previous research, we developed a trend-aware forecast post-processing method to overcome this problem. The method was demonstrated to be effective for embedding observed trends into seasonal temperature forecasts. In this study, we further develop the method for post-processing GCM seasonal precipitation forecasts. We introduce new formulation and evaluation features to cater for special characteristics of precipitation amounts, such as having a zero lower bound and highly positive skewness. We apply the improved method to calibrate ECMWF SEAS5 forecasts of seasonal precipitation for Australia. Our evaluation shows that the calibrated forecasts reproduce observed trends over the hindcast period of 36 years. In some regions where observed trends are statistically significant, forecast skill is greatly improved by embedding trends into the forecasts. In most regions, the calibrated forecasts outperform the raw forecasts in terms of bias, skill, and reliability. Wider applications of the new trend-aware post-processing method are expected to boost user confidence in seasonal precipitation forecasts.


Sign in / Sign up

Export Citation Format

Share Document