scholarly journals Adaptive lossy compression of climate model data based on hierarchical tensor with Adaptive-HGFDR (v1.0)

2020 ◽  
Author(s):  
Zhaoyuan Yu ◽  
Zhengfang Zhang ◽  
Dongshuang Li ◽  
Wen Luo ◽  
Yuan Liu ◽  
...  
Keyword(s):  
Data Compression ◽  
Compression Ratio ◽  
Large Scale ◽  
Data Representation ◽  
Lossy Compression ◽  
Earth System Model ◽  
System Model ◽  
Earth System ◽  
Model Data ◽  
Compression Parameter

Abstract. Lossy compression has been applied to large-scale experimental model data compression due to its advantages of a high compression ratio. However, few methods consider the uneven distribution of compression errors affecting compression quality. Here we develop an adaptive lossy compression method with the stable compression error for earth system model data based on Hierarchical Geospatial Field Data Representation (HGFDR). We extended the original HGFDR by firstly dividing the original data into a series of the local block according to the exploratory experiment to maximize the local correlations of the data. After that, from the mathematical model of the HGFDR, the relationship between the compression parameter and compression error in HGFDR for each block is analyzed and calculated. Using optimal compression parameter selection rule and an adaptive compression algorithm, our method, the Adaptive-HGFDR, achieved the data compression under the constraints that the compression error is as stable as possible through each dimension. Experiments concerning model data compression are carried out based on the Community Earth System Model (CESM) data. The results show that our method has higher compression ratio and more uniform error distributions, compared with other commonly used lossy compression methods, such as the Fixed-Rate Compressed Floating-Point Arrays method.

scholarly journals Lossy compression of Earth system model data based on a hierarchical tensor with Adaptive-HGFDR (v1.0)

2021 ◽  
Vol 14 (2) ◽  
pp. 875-887
Author(s):  
Zhaoyuan Yu ◽  
Dongshuang Li ◽  
Zhengfang Zhang ◽  
Wen Luo ◽  
Yuan Liu ◽  
...  
Keyword(s):  
Field Data ◽  
Large Scale ◽  
Data Representation ◽  
Lossy Compression ◽  
Earth System Model ◽  
System Model ◽  
Earth System ◽  
Model Data ◽  
Compression Method ◽  
Compression Parameter

Abstract. Lossy compression has been applied to the data compression of large-scale Earth system model data (ESMD) due to its advantages of a high compression ratio. However, few lossy compression methods consider both global and local multidimensional coupling correlations, which could lead to information loss in data approximation of lossy compression. Here, an adaptive lossy compression method, adaptive hierarchical geospatial field data representation (Adaptive-HGFDR), is developed based on the foundation of a stream compression method for geospatial data called blocked hierarchical geospatial field data representation (Blocked-HGFDR). In addition, the original Blocked-HGFDR method is also improved from the following perspectives. Firstly, the original data are divided into a series of data blocks of a more balanced size to reduce the effect of the dimensional unbalance of ESMD. Following this, based on the mathematical relationship between the compression parameter and compression error in Blocked-HGFDR, the control mechanism is developed to determine the optimal compression parameter for the given compression error. By assigning each data block an independent compression parameter, Adaptive-HGFDR can capture the local variation of multidimensional coupling correlations to improve the approximation accuracy. Experiments are carried out based on the Community Earth System Model (CESM) data. The results show that our method has higher compression ratio and more uniform error distributions compared with ZFP and Blocked-HGFDR. For the compression results among 22 climate variables, Adaptive-HGFDR can achieve good compression performances for most flux variables with significant spatiotemporal heterogeneity and fast changing rate. This study provides a new potential method for the lossy compression of the large-scale Earth system model data.

scholarly journals Earth System Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP

2020 ◽  
Vol 13 (7) ◽  
pp. 3383-3438 ◽  
Author(s):  
Veronika Eyring ◽  
Lisa Bock ◽  
Axel Lauer ◽  
Mattia Righi ◽  
Manuel Schlund ◽  
...  
Keyword(s):  
Model Evaluation ◽  
Large Scale ◽  
Performance Metrics ◽  
Earth System Model ◽  
System Model ◽  
Earth System ◽  
Evaluation Tool ◽  
The Earth ◽  
And Performance ◽  
Earth System Models

Abstract. The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool designed to improve comprehensive and routine evaluation of Earth system models (ESMs) participating in the Coupled Model Intercomparison Project (CMIP). It has undergone rapid development since the first release in 2016 and is now a well-tested tool that provides end-to-end provenance tracking to ensure reproducibility. It consists of (1) an easy-to-install, well-documented Python package providing the core functionalities (ESMValCore) that performs common preprocessing operations and (2) a diagnostic part that includes tailored diagnostics and performance metrics for specific scientific applications. Here we describe large-scale diagnostics of the second major release of the tool that supports the evaluation of ESMs participating in CMIP Phase 6 (CMIP6). ESMValTool v2.0 includes a large collection of diagnostics and performance metrics for atmospheric, oceanic, and terrestrial variables for the mean state, trends, and variability. ESMValTool v2.0 also successfully reproduces figures from the evaluation and projections chapters of the Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report (AR5) and incorporates updates from targeted analysis packages, such as the NCAR Climate Variability Diagnostics Package for the evaluation of modes of variability, the Thermodynamic Diagnostic Tool (TheDiaTo) to evaluate the energetics of the climate system, as well as parts of AutoAssess that contains a mix of top–down performance metrics. The tool has been fully integrated into the Earth System Grid Federation (ESGF) infrastructure at the Deutsches Klimarechenzentrum (DKRZ) to provide evaluation results from CMIP6 model simulations shortly after the output is published to the CMIP archive. A result browser has been implemented that enables advanced monitoring of the evaluation results by a broad user community at much faster timescales than what was possible in CMIP5.

scholarly journals Description and evaluation of NorESM1-F: A fast version of the Norwegian Earth System Model (NorESM)

2018 ◽  
Author(s):  
Chuncheng Guo ◽  
Mats Bentsen ◽  
Ingo Bethke ◽  
Mehmet Ilicak ◽  
Jerry Tjiputra ◽  
...  
Keyword(s):  
Carbon Cycle ◽  
Sea Ice ◽  
Large Scale ◽  
Coupled Model ◽  
Coupled System ◽  
Internal Variability ◽  
Earth System Model ◽  
Meridional Overturning Circulation ◽  
System Model ◽  
Earth System

Abstract. A new computationally efficient version of the Norwegian Earth System Model (NorESM) is presented. This new version (here termed NorESM1-F) runs about 2.5 times faster (e.g. 90 model years per day on current hardware) than the version that contributed to the fifth phase of the Coupled Model Intercomparison project (CMIP5), i.e., NorESM1-M, and is therefore particularly suitable for multi-millennial paleoclimate and carbon cycle simulations or large ensemble simulations. The speedup is primarily a result of using a prescribed atmosphere aerosol chemistry and a tripolar ocean-sea ice horizontal grid configuration that allows an increase of the ocean-sea ice component time steps. Ocean biogeochemistry can be activated for fully coupled and semi-coupled carbon cycle applications. This paper describes the model and evaluates its performance using observations and NorESM1-M as benchmarks. The evaluation emphasises model stability, important large-scale features in the ocean and sea ice components, internal variability in the coupled system, and climate sensitivity. Simulation results from NorESM1-F in general agree well with observational estimates, and show evident improvements over NorESM1-M, for example, in the strength of the meridional overturning circulation and sea ice simulation, both important metrics in simulating past and future climates. Whereas NorESM1-M showed a slight global cool bias in the upper oceans, NorESM1-F exhibits a global warm bias. In general, however, NorESM1-F has more similarities than dissimilarities compared to NorESM1-M, and some biases and deficiencies known in NorESM1-M remain.

scholarly journals The Canadian Earth System Model version 5 (CanESM5.0.3)

2019 ◽  
Vol 12 (11) ◽  
pp. 4823-4873 ◽  
Author(s):  
Neil C. Swart ◽  
Jason N. S. Cole ◽  
Viatcheslav V. Kharin ◽  
Mike Lazare ◽  
John F. Scinocca ◽  
...  
Keyword(s):  
Land Surface ◽  
General Circulation ◽  
Large Scale ◽  
General Circulation Models ◽  
Earth System Model ◽  
System Model ◽  
Historical Period ◽  
Earth System ◽  
Historical Climate ◽  
Model Version

Abstract. The Canadian Earth System Model version 5 (CanESM5) is a global model developed to simulate historical climate change and variability, to make centennial-scale projections of future climate, and to produce initialized seasonal and decadal predictions. This paper describes the model components and their coupling, as well as various aspects of model development, including tuning, optimization, and a reproducibility strategy. We also document the stability of the model using a long control simulation, quantify the model's ability to reproduce large-scale features of the historical climate, and evaluate the response of the model to external forcing. CanESM5 is comprised of three-dimensional atmosphere (T63 spectral resolution equivalent roughly to 2.8∘) and ocean (nominally 1∘) general circulation models, a sea-ice model, a land surface scheme, and explicit land and ocean carbon cycle models. The model features relatively coarse resolution and high throughput, which facilitates the production of large ensembles. CanESM5 has a notably higher equilibrium climate sensitivity (5.6 K) than its predecessor, CanESM2 (3.7 K), which we briefly discuss, along with simulated changes over the historical period. CanESM5 simulations contribute to the Coupled Model Intercomparison Project phase 6 (CMIP6) and will be employed for climate science and service applications in Canada.

scholarly journals Description and evaluation of NorESM1-F: a fast version of the Norwegian Earth System Model (NorESM)

2019 ◽  
Vol 12 (1) ◽  
pp. 343-362 ◽  
Author(s):  
Chuncheng Guo ◽  
Mats Bentsen ◽  
Ingo Bethke ◽  
Mehmet Ilicak ◽  
Jerry Tjiputra ◽  
...  
Keyword(s):  
Carbon Cycle ◽  
Sea Ice ◽  
Large Scale ◽  
Coupled Model ◽  
Coupled System ◽  
Internal Variability ◽  
Earth System Model ◽  
Meridional Overturning Circulation ◽  
System Model ◽  
Earth System

Abstract. A new computationally efficient version of the Norwegian Earth System Model (NorESM) is presented. This new version (here termed NorESM1-F) runs about 2.5 times faster (e.g., 90 model years per day on current hardware) than the version that contributed to the fifth phase of the Coupled Model Intercomparison project (CMIP5), i.e., NorESM1-M, and is therefore particularly suitable for multimillennial paleoclimate and carbon cycle simulations or large ensemble simulations. The speed-up is primarily a result of using a prescribed atmosphere aerosol chemistry and a tripolar ocean–sea ice horizontal grid configuration that allows an increase of the ocean–sea ice component time steps. Ocean biogeochemistry can be activated for fully coupled and semi-coupled carbon cycle applications. This paper describes the model and evaluates its performance using observations and NorESM1-M as benchmarks. The evaluation emphasizes model stability, important large-scale features in the ocean and sea ice components, internal variability in the coupled system, and climate sensitivity. Simulation results from NorESM1-F in general agree well with observational estimates and show evident improvements over NorESM1-M, for example, in the strength of the meridional overturning circulation and sea ice simulation, both important metrics in simulating past and future climates. Whereas NorESM1-M showed a slight global cool bias in the upper oceans, NorESM1-F exhibits a global warm bias. In general, however, NorESM1-F has more similarities than dissimilarities compared to NorESM1-M, and some biases and deficiencies known in NorESM1-M remain.

scholarly journals Evaluating Lossy Data Compression on Climate Simulation Data within a Large Ensemble

2016 ◽  
Author(s):  
Allison H. Baker ◽  
Dorit M. Hammerling ◽  
Sheri A. Mickleson ◽  
Haiying Xu ◽  
Martin B. Stolpe ◽  
...  
Keyword(s):  
Data Compression ◽  
Climate Science ◽  
Original Data ◽  
Earth System Model ◽  
System Model ◽  
Climate Simulation ◽  
Earth System ◽  
Climate Data ◽  
Large Ensemble ◽  
Simulation Data

Abstract. High-resolution earth system model simulations generate enormous data volumes, and retaining the data from these simulations often strains institutional storage resources. Further, these exceedingly large storage requirements negatively impact science objectives by forcing reductions in data output frequency, simulation length, or ensemble size, for example. To lessen data volumes from the Community Earth System Model (CESM), we advocate the use of lossy data compression techniques. While lossy data compression does not exactly preserve the original data (as lossless compression does), lossy techniques have an advantage in terms of smaller storage requirements. To preserve the integrity of the scientific simulation data, the effects of lossy data compression on the original data should, at a minimum, not be statistically distinguishable from the natural variability of the climate system, and previous preliminary work with data from CESM has shown this goal to be attainable. However, to ultimately convince climate scientists that it is acceptable to use lossy data compression, we provide climate scientists with access to publicly available climate data that has undergone lossy data compression. In particular, we report on the results of a lossy data compression experiment with output from the CESM Large Ensemble (CESM-LE) Community Project, in which we challenge climate scientists to examine features of the data relevant to their interests, and attempt to identify which of the ensemble members have been compressed and reconstructed. We find that while detecting distinguishing features is certainly possible, the compression effects noticeable in these features are often unimportant or disappear in post-processing analyses. In addition, we perform several analyses that directly compare the original data to the reconstructed data to investigate the preservation, or lack thereof, of specific features critical to climate science. Overall, we conclude that applying lossy data compression to climate simulation data is both advantageous in terms of data reduction and generally acceptable in terms of effects on scientific results.

scholarly journals Snowball Earth Bifurcations in a Fully-Implicit Earth System Model

2021 ◽  
Vol 31 (06) ◽  
pp. 2130017
Author(s):  
Thomas E. Mulder ◽  
Heiko Goelzer ◽  
Fred W. Wubs ◽  
Henk A. Dijkstra
Keyword(s):  
Large Scale ◽  
Climate Models ◽  
Ocean Model ◽  
Earth System Model ◽  
System Model ◽  
Snowball Earth ◽  
Earth System ◽  
Geological Evidence ◽  
Fully Implicit ◽  
Additional Support

There is now much geological evidence that the Earth was fully glaciated during several periods in the geological past (about 700[Formula: see text]Myr ago) and attained a so-called Snowball Earth (SBE) state. Additional support for this idea has come from climate models of varying complexity that show transitions to SBE states and undergo hysteresis under changes in solar radiation. In this paper, we apply large-scale bifurcation analyses to a novel, fully-implicit Earth System Model of Intermediate Complexity (I-EMIC) to study SBE transitions. The I-EMIC contains a primitive equation ocean model, a model for atmospheric heat and moisture transport, a sea ice component and formulations for the adjustment of albedo over snow and ice. With the I-EMIC, high-dimensional branches of the SBE bifurcation diagram are obtained through parameter continuation. We are able to identify stable and unstable equilibria and uncover an intricate bifurcation structure associated with the ice-albedo feedback. Moreover, large-scale linear stability analyses are performed near major bifurcations, revealing the spatial nature of destabilizing perturbations.

Sign in / Sign up

Export Citation Format

Share Document