scholarly journals ESM-Tools Version 5.0: A modular infrastructure for stand-alone and coupled Earth System Modelling (ESM)

2021 ◽  
Author(s):  
Dirk Barbi ◽  
Miguel Andrés-Martínez ◽  
Deniz Ural ◽  
Luisa Cristini ◽  
Paul Gierz ◽  
...  
Keyword(s):  
Land Surface ◽  
Ice Sheet ◽  
Multiple Models ◽  
System Modelling ◽  
Specific Information ◽  
Climate Modelling ◽  
Earth System ◽  
Wide Range ◽  
Ocean Atmosphere ◽  
Earth System Modelling

<p>During the last two decades, modern societies have gradually understood the urge to tackle the climate change challenge, and consequently, a growing number of national and international initiatives have been launched with the aim of better understanding the Earth System. In this context, Earth System Modelling (ESM) has rapidly expanded, leading to a large number of research groups targeting the many components of the system at different scales and with different levels of interactions between components. This has led to the development of increasing number of models, couplings, versions tuned to address different scales or scenarios, and model-specific compilation and operating procedures. This operational complexity makes the implementation of multiple models excessively time consuming especially for less experienced modellers.</p><p>ESM-Tools is an open-source modular software written in Python, aimed to overcome many of the difficulties associated to the operation of ESMs. ESM-Tools allows for downloading, compiling and running a wide range of ESM models and coupled setups in the most important HPC facilities available in Germany. It currently supports multiple models for ocean, atmosphere, biochemistry, ice sheet, isostatic adjustment, hydrology, and land-surface, and six ocean-atmosphere and two ice-sheet-ocean-atmosphere coupled setups, through two couplers (included modularly through ESM-Interface). The tools are coded in Python while all the component and coupling information is contained in easy-to-read YAML files. The front-end user is required to provide only a short script written in YAML format, containing the experiment specific definitions. This user-friendly interface makes ESM-Tools a convenient software for training and educational purposes. Simultaneously, its modularity and the separation between the component-specific information and tool scripts facilitates the implementation and maintenance of new components, couplings and versions. ESM-Tools team of scientific programmers provides also user support, workshops and detailed documentation. The ESM-Tools were developed within the framework of the project Advance Earth System Model Capacity, supported by Helmholtz Association and has become one of the main pillars of the German infrastructure for Climate Modelling.</p>

scholarly journals ESM-Tools Version 4.0: A modular infrastructure for stand-alone and coupled Earth System Modelling (ESM)

2020 ◽  
Author(s):  
Dirk Barbi ◽  
Nadine Wieters ◽  
Paul Gierz ◽  
Fatemeh Chegini ◽  
Sara Khosravi ◽  
...  
Keyword(s):  
Land Surface ◽  
High Performance ◽  
Surface Model ◽  
System Modelling ◽  
Climate Modelling ◽  
Earth System ◽  
Coupled Models ◽  
Wide Range ◽  
Runtime Infrastructure ◽  
Earth System Modelling

Abstract. Earth system and climate modelling involves the simulation of processes on a wide range of scales and within and across various components of the Earth system. In practice, component models are often developed independently by different research groups and then combined using a dedicated coupling software. This procedure not only leads to a strongly growing number of available versions of model components and coupled setups but also to model- and system-dependent ways of obtaining and operating them. Therefore, implementing these Earth System Models (ESMs) can be challenging and extremely time-consuming, especially for less experienced modellers, or scientists aiming to use different ESMs as in the case of inter-comparison projects. To assist researchers and modellers by reducing avoidable complexity, we developed the ESM-Tools software, which provides a standard way for downloading, configuring, compiling, running and monitoring different models - coupled ESMs and stand-alone models alike - on a variety of High-Performance Computing (HPC) systems. (The ESM-Tools are equally applicable and helpful for stand-alone as for coupled models. In fact, the ESM-Tools are used as standard compile and runtime infrastructure for FESOM2, and currently also applied for ECHAM and ICON standalone simulations. As coupled ESMs are technically the more challenging tasks, we will focus on coupled setups, always implying that stand-alone models can benefit in the same way.) With the ESM-Tools, the user is only required to provide a short script consisting of only the experiment specific definitions, while the software executes all the phases of a simulation in the correct order. The software, which is well documented and easy to install and use, currently supports four ocean models, three atmosphere models, two biogeochemistry models, an ice sheet model, an isostatic adjustment model, a hydrology model and a land-surface model. ESM-Tools has been entirely re-coded in a high-level programming language (Python) and provides researchers with an even more user-friendly interface for Earth system modelling lately. The ESM-Tools were developed within the framework of the project Advanced Earth System Model Capacity, supported by the Helmholtz Association.

scholarly journals ESM-Tools version 5.0: a modular infrastructure for stand-alone and coupled Earth system modelling (ESM)

2021 ◽  
Vol 14 (6) ◽  
pp. 4051-4067
Author(s):  
Dirk Barbi ◽  
Nadine Wieters ◽  
Paul Gierz ◽  
Miguel Andrés-Martínez ◽  
Deniz Ural ◽  
...  
Keyword(s):  
Land Surface ◽  
High Performance ◽  
Land Surface Model ◽  
Management Tool ◽  
Surface Model ◽  
System Modelling ◽  
Climate Modelling ◽  
Earth System ◽  
Wide Range ◽  
Earth System Modelling

Abstract. Earth system and climate modelling involves the simulation of processes on a wide range of scales and within and across various compartments of the Earth system. In practice, component models are often developed independently by different research groups, adapted by others to their special interests and then combined using a dedicated coupling software. This procedure not only leads to a strongly growing number of available versions of model components and coupled setups but also to model- and high-performance computing (HPC)-system-dependent ways of obtaining, configuring, building and operating them. Therefore, implementing these Earth system models (ESMs) can be challenging and extremely time consuming, especially for less experienced modellers or scientists aiming to use different ESMs as in the case of intercomparison projects. To assist researchers and modellers by reducing avoidable complexity, we developed the ESM-Tools software, which provides a standard way for downloading, configuring, compiling, running and monitoring different models on a variety of HPC systems. It should be noted that ESM-Tools is not a coupling software itself but a workflow and infrastructure management tool to provide access to increase usability of already existing components and coupled setups. As coupled ESMs are technically the more challenging tasks, we will focus on coupled setups, always implying that stand-alone models can benefit in the same way. With ESM-Tools, the user is only required to provide a short script consisting of only the experiment-specific definitions, while the software executes all the phases of a simulation in the correct order. The software, which is well documented and easy to install and use, currently supports four ocean models, three atmosphere models, two biogeochemistry models, an ice sheet model, an isostatic adjustment model, a hydrology model and a land-surface model. Compared to previous versions, ESM-Tools has lately been entirely recoded in a high-level programming language (Python) and provides researchers with an even more user-friendly interface for Earth system modelling. ESM-Tools was developed within the framework of the Advanced Earth System Model Capacity project, supported by the Helmholtz Association.

ESM-Tools: A common infrastructure for modular coupled earth system modelling

2020 ◽  
Author(s):  
Dirk Barbi ◽  
Nadine Wieters ◽  
Luisa Cristini ◽  
Paul Gierz ◽  
Sara Khosravi ◽  
...  
Keyword(s):  
Ice Sheet ◽  
Modular System ◽  
System Modelling ◽  
Climate Modelling ◽  
Earth System ◽  
Isostatic Adjustment ◽  
Full Control ◽  
Model Components ◽  
User Friendly ◽  
Component Models

<p>Earth system and climate modelling involves the simulation of processes on a large range of scales, and within very different components of the earth system. In practice, component models from different institutes are mostly developed independently, and then combined using a dedicated coupling software.</p><p>This procedure not only leads to a wildly growing number of available versions of model components as well as coupled setups, but also to a specific way of obtaining and operating many of these. This can be a challenging problem (and potentially a huge waste of time) especially for unexperienced researchers, or scientists aiming to change to a different model system, e.g. for intercomparisons.</p><p>In order to define a standard way of downloading, configuring, compiling and running modular ESMs on a variety of HPC systems, AWI and partner institutions develop and maintain the OpenSource ESM-Tools software (https://www.esm-tools.net). Our aim is to provide standard solutions to typical problems occurring within the workflow of model simulations such as calendar operations, data postprocessing and monitoring, sanity checks, sorting and archiving of output, and script-based coupling (e.g. ice sheet models, isostatic adjustment models). The user only provides a short (30-40 lines) runscript of absolutely necessary experiment specific definitions, while the ESM-Tools execute the phases of a simulation in the correct order. A user-friendly API ensures that more experienced users have full control over each of these phases, and can easily add functionality. A GUI has been developed to provide a more intuitive approach to the modular system, and also to add a graphical overview over the available models and combinations.</p><p>Since revision 2 (released on March 19<sup>th</sup> 2019), the ESM-Tools were entirely re-written, separating the implementation of actions (written in Python 3) from any information that we have, either on models, coupled setups, software tools, HPC systems etc. into nicely structured yaml configuration files. This has been done to reduce maintenance problems, and also to ensure that also unexperienced scientist can easily edit configurations, or even add new models or software without any programming experience. Since revision 3 the ESM-Tools support four ocean models (FESOM1, FESOM2, NEMO, MPIOM), three atmosphere models (ECHAM6, OpenIFS, ICON), two BGC models (HAMOCC, REcoM), an ice sheet (PISM) and an isostatic adjustment model (VILMA) as well as standard settings for five HPC systems. For the future we plan to add interfaces to regional models and soil/hydrology models.</p><p>The Tools currently have more than 70 registered users from 5 institutions, and more than 40 authors of contributions to either model configurations or functionality.</p>

scholarly journals Coupling technologies for Earth System Modelling

2012 ◽  
Vol 5 (3) ◽  
pp. 1987-2006 ◽  
Author(s):  
S. Valcke ◽  
V. Balaji ◽  
A. Craig ◽  
C. DeLuca ◽  
R. Dunlap ◽  
...  
Keyword(s):  
System Modelling ◽  
Climate Modelling ◽  
Earth System ◽  
Common Features ◽  
The Earth ◽  
Future Challenges ◽  
Computing Platforms ◽  
Design Characteristics ◽  
Earth System Modelling

Abstract. This paper presents a review of the software currently used in climate modelling in general and in CMIP5 in particular to couple the numerical codes representing the different components of the Earth system. The coupling technologies presented show common features, such as the ability to communicate and regrid data, but also offer different functions and implementations. Design characteristics of the different approaches are discussed as well as future challenges arising from the increasing complexity of scientific problems and computing platforms.

Assess the impacts of different land cover datasets on land surface hydrological process in Community Earth System Model (CESM)

2020 ◽  
Author(s):  
Shaoqiang Ni ◽  
Hui Lu
Keyword(s):  
Land Use ◽  
Land Cover ◽  
Land Cover Change ◽  
Land Surface ◽  
Substantial Effect ◽  
Land Cover Changes ◽  
System Modelling ◽  
Hydrological Process ◽  
Earth System ◽  
Earth System Modelling

<p>By changing matter and energy exchange, biogeochemical process and geophysical process, land use and land cover changes have crucial effects on the earth system modelling. Previous studies have focused on reconstructing the land use and land cover change to be a continuous changing process over time considering human and natural factors. The real land cover change processes have rarely been taken into consideration in the simulation of earth system. Using Gong global land cover mapping products (1985-2015) and the Lawrence land cover dataset (default) in CESM, this study have quantitatively compared the differences in plant function types (PFT) between two products. The results show the land cover changes in default dataset are slowly changing processes with little variation from year to year. In contrast, the Gong global mapping products express a noticeable drastic change tendency between adjacent years. Driving the model with different land cover datasets, our results indicates that globally land evapotranspiration (ET) is dramatically impacted by the land cover changes, especially in areas with distinct tree changes. Also the land cover change can cause a certain proportion variation in soil water (-50%-65%) and runoff (-60%-60%, even >90% in some special grid points) in a global scale. This study estimates the substantial effect land use and land cover changes can have on the land surface hydrological process in earth system modelling.</p>

scholarly journals Coupling technologies for Earth System Modelling

2012 ◽  
Vol 5 (6) ◽  
pp. 1589-1596 ◽  
Author(s):  
S. Valcke ◽  
V. Balaji ◽  
A. Craig ◽  
C. DeLuca ◽  
R. Dunlap ◽  
...  
Keyword(s):  
System Modelling ◽  
Climate Modelling ◽  
Earth System ◽  
Common Features ◽  
The Earth ◽  
Future Challenges ◽  
Computing Platforms ◽  
Design Characteristics ◽  
Earth System Modelling

Abstract. This paper presents a review of the software currently used in climate modelling in general and in CMIP5 in particular to couple the numerical codes representing the different components of the Earth System. The coupling technologies presented show common features, such as the ability to communicate and regrid data, and also offer different functions and implementations. Design characteristics of the different approaches are discussed as well as future challenges arising from the increasing complexity of scientific problems and computing platforms.

Bridging the Future of Earth System Modelling – the ESM Summer School 2019

2020 ◽  
Author(s):  
Luisa Cristini ◽  
Robert Sausen ◽  
Mariano Mertens ◽  
Nadine Wieters ◽  
Sara Pasqualetto
Keyword(s):  
Knowledge Transfer ◽  
Summer School ◽  
Early Career ◽  
System Modelling ◽  
Earth System ◽  
School Students ◽  
The Earth ◽  
Wide Range ◽  
Summer Schools ◽  
Earth System Modelling

<p>The Earth System Modelling Capacity (ESM) project is a 3-year effort funded by the Helmholtz Association started in April 2017 and involving eight research centres across Germany. The project has a strong knowledge transfer component aiming to provide decision-makers with relevant tools in order to face grand challenges in the near future and to support early career scientists (PhD students and early career postdoctoral researchers) from ESM project partner centres as well as the national and international community in developing and strengthening their knowledge on Earth system modelling, as one of the primary efforts to establish a legacy for the project.</p><p>From 9<sup>th</sup> to 19<sup>th</sup> of September 2019, the ESM summer school was held in Bad Aibling (Germany) with 50 participating students from 26 institutes placed all over the world. A core objective of the school was to train and educate early-career scientists from a wide range of discipline and with a diverse international and gender background to apply cutting edge science in the study of the Earth system and at the same time to engage in a stimulating exercise of knowledge transfer for the project.</p><p>During the 10-day summer school, students had four lectures daily about topics related to the Earth system and its components, from atmospheric dynamics to terrestrial modelling, from the modelling of waves and oceans to that of ice sheets and glaciers. The school included practical exercises and hands-on sessions that involved coding and building mini-cluster computers, building on the advanced technical knowledge of ESM partners and scientists. The lectures were held by thirty researchers from the ESM Project’s partner institutes and beyond. Two poster sessions were also organized, where students had the chance to present their work to their peers and to the senior scientists, exchange experiences, share results and receive feedbacks from fellow students and lecturers.</p><p>In this presentation, we will present the concept and key features of the summer school, content and organisation, and also offer the students’ feedback collected after the school in an effort to showcase an example of how summer schools remain a powerful mean to value diversities and create an inclusive environment in (Earth system) science.</p>

scholarly journals A multi-layer land surface energy budget model for implicit coupling with global atmospheric simulations

2014 ◽  
Vol 7 (6) ◽  
pp. 8649-8701 ◽  
Author(s):  
J. Ryder ◽  
J. Polcher ◽  
P. Peylin ◽  
C. Ottlé ◽  
Y. Chen ◽  
...  
Keyword(s):  
Stomatal Conductance ◽  
Energy Budget ◽  
Land Surface ◽  
Radiation Budget ◽  
Surface Model ◽  
System Modelling ◽  
Detailed Calculation ◽  
Sensible Heat ◽  
Earth System ◽  
Specific Calculation

Abstract. In Earth system modelling, a description of the energy budget of the vegetated surface layer is fundamental as it determines the meteorological conditions in the planetary boundary layer and as such contributes to the atmospheric conditions and its circulation. The energy budget in most Earth system models has long been based on a "big-leaf approach", with averaging schemes that represent in-canopy processes. Such models have difficulties in reproducing consistently the energy balance in field observations. We here outline a newly developed numerical model for energy budget simulation, as a component of the land surface model ORCHIDEE-CAN (Organising Carbon and Hydrology In Dynamic Ecosystems – CANopy). This new model implements techniques from single-site canopy models in a practical way. It includes representation of in-canopy transport, a multilayer longwave radiation budget, height-specific calculation of aerodynamic and stomatal conductance, and interaction with the bare soil flux within the canopy space. Significantly, it avoids iterations over the height of tha canopy and so maintains implicit coupling to the atmospheric model LMDz. As a first test, the model is evaluated against data from both an intensive measurement campaign and longer term eddy covariance measurements for the intensively studied Eucalyptus stand at Tumbarumba, Australia. The model performs well in replicating both diurnal and annual cycles of fluxes, as well as the gradients of sensible heat fluxes. However, the model overestimates sensible heat flux against an underestimate of the radiation budget. Improved performance is expected through the implementation of a more detailed calculation of stand albedo and a more up-to-date stomatal conductance calculation.

scholarly journals sympl (v. 0.4.0) and climt (v. 0.15.3) – towards a flexible framework for building model hierarchies in Python

2018 ◽  
Vol 11 (9) ◽  
pp. 3781-3794 ◽  
Author(s):  
Joy Merwin Monteiro ◽  
Jeremy McGibbon ◽  
Rodrigo Caballero
Keyword(s):  
Model Building ◽  
Relevant Information ◽  
System Modelling ◽  
Climate Modelling ◽  
Earth System ◽  
Wide Audience ◽  
Fine Grained ◽  
Building Model ◽  
Building Models ◽  
Model Components

Abstract. sympl (System for Modelling Planets) and climt (Climate Modelling and Diagnostics Toolkit) are an attempt to rethink climate modelling frameworks from the ground up. The aim is to use expressive data structures available in the scientific Python ecosystem along with best practices in software design to allow scientists to easily and reliably combine model components to represent the climate system at a desired level of complexity and to enable users to fully understand what the model is doing. sympl is a framework which formulates the model in terms of a state that gets evolved forward in time or modified within a specific time by well-defined components. sympl's design facilitates building models that are self-documenting, are highly interoperable, and provide fine-grained control over model components and behaviour. sympl components contain all relevant information about the input they expect and output that they provide. Components are designed to be easily interchanged, even when they rely on different units or array configurations. sympl provides basic functions and objects which could be used in any type of Earth system model. climt is an Earth system modelling toolkit that contains scientific components built using sympl base objects. These include both pure Python components and wrapped Fortran libraries. climt provides functionality requiring model-specific assumptions, such as state initialization and grid configuration. climt's programming interface designed to be easy to use and thus appealing to a wide audience. Model building, configuration and execution are performed through a Python script (or Jupyter Notebook), enabling researchers to build an end-to-end Python-based pipeline along with popular Python data analysis and visualization tools.

Earth System Modelling - Volume 3

2012 ◽  
Author(s):  
Sophie Valcke ◽  
René Redler ◽  
Reinhard Budich
Keyword(s):  
System Modelling ◽  
Earth System ◽  
Earth System Modelling
Sign in / Sign up

Export Citation Format

Share Document