scholarly journals A new ensemble-based consistency test for the Community Earth System Model

2015 ◽  
Vol 8 (5) ◽  
pp. 3823-3859 ◽  
Author(s):  
A. H. Baker ◽  
D. M. Hammerling ◽  
M. N. Levy ◽  
H. Xu ◽  
J. M. Dennis ◽  
...  
Keyword(s):  
Software Verification ◽  
Earth System Model ◽  
System Model ◽  
Earth System ◽  
Consistency Test ◽  
Climate Simulations ◽  
Community Earth System Model ◽  
Software And Hardware ◽  
Verification Process

Abstract. Climate simulations codes, such as the Community Earth System Model (CESM), are especially complex and continually evolving. Their on-going state of development requires frequent software verification in the form of quality assurance to both preserve the quality of the code and instill model confidence. To formalize and simplify this previously subjective and computationally-expensive aspect of the verification process, we have developed a new tool for evaluating climate consistency. Because an ensemble of simulations allows us to gauge the natural variability of the model's climate, our new tool uses an ensemble approach for consistency testing. In particular, an ensemble of CESM climate runs is created, from which we obtain a statistical distribution that can be used to determine whether a new climate run is statistically distinguishable from the original ensemble. The CESM Ensemble Consistency Test, referred to as CESM-ECT, is objective in nature and accessible to CESM developers and users. The tool has proven its utility in detecting errors in software and hardware environments and providing rapid feedback to model developers.

scholarly journals A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0)

2015 ◽  
Vol 8 (9) ◽  
pp. 2829-2840 ◽  
Author(s):  
A. H. Baker ◽  
D. M. Hammerling ◽  
M. N. Levy ◽  
H. Xu ◽  
J. M. Dennis ◽  
...  
Keyword(s):  
Software Verification ◽  
Earth System Model ◽  
System Model ◽  
Climate Simulation ◽  
Earth System ◽  
Consistency Test ◽  
Community Earth System Model ◽  
Software And Hardware ◽  
Verification Process

Abstract. Climate simulation codes, such as the Community Earth System Model (CESM), are especially complex and continually evolving. Their ongoing state of development requires frequent software verification in the form of quality assurance to both preserve the quality of the code and instill model confidence. To formalize and simplify this previously subjective and computationally expensive aspect of the verification process, we have developed a new tool for evaluating climate consistency. Because an ensemble of simulations allows us to gauge the natural variability of the model's climate, our new tool uses an ensemble approach for consistency testing. In particular, an ensemble of CESM climate runs is created, from which we obtain a statistical distribution that can be used to determine whether a new climate run is statistically distinguishable from the original ensemble. The CESM ensemble consistency test, referred to as CESM-ECT, is objective in nature and accessible to CESM developers and users. The tool has proven its utility in detecting errors in software and hardware environments and providing rapid feedback to model developers.

scholarly journals Regional Climate Simulations With the Community Earth System Model

2018 ◽  
Vol 10 (6) ◽  
pp. 1245-1265 ◽  
Author(s):  
A. Gettelman ◽  
P. Callaghan ◽  
V. E. Larson ◽  
C. M. Zarzycki ◽  
J. T. Bacmeister ◽  
...  
Keyword(s):  
Regional Climate ◽  
Earth System Model ◽  
System Model ◽  
Earth System ◽  
Climate Simulations ◽  
Community Earth System Model

scholarly journals Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0)

2017 ◽  
Author(s):  
Daniel J. Milroy ◽  
Allison H. Baker ◽  
Dorit M. Hammerling ◽  
Elizabeth R. Jessup
Keyword(s):  
Atmospheric Model ◽  
Earth System Model ◽  
System Model ◽  
Small Scale ◽  
Earth System ◽  
Consistency Test ◽  
Robust Test ◽  
Community Land Model ◽  
Community Earth System Model ◽  
Statistical Consistency

Abstract. The Community Earth System Model Ensemble Consistency Test (CESM-ECT) suite was developed as an alternative to requiring bitwise identical output for quality assurance. This objective test provides a statistical measurement of consistency between an accepted ensemble created by small initial temperature perturbations and a test set of CESM simulations. In this work, we extend the CESM-ECT suite by the addition of an inexpensive and robust test for ensemble consistency that is applied to Community Atmospheric Model (CAM) output after only nine model time steps. We demonstrate that adequate ensemble variability is achieved with instantaneous variable values at the ninth step, despite rapid perturbation growth and heterogeneous variable spread. We refer to this new test as the Ultra-Fast CAM Ensemble Consistency Test (UF-CAM-ECT) and demonstrate its effectiveness in practice, including its ability to detect small-scale events and its applicability to the Community Land Model (CLM). The new ultra-fast test facilitates CESM development, porting, and optimization efforts, particularly when used to complement information from the original CESM-ECT suite of tools.

scholarly journals Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0)

2018 ◽  
Vol 11 (2) ◽  
pp. 697-711 ◽  
Author(s):  
Daniel J. Milroy ◽  
Allison H. Baker ◽  
Dorit M. Hammerling ◽  
Elizabeth R. Jessup
Keyword(s):  
Atmospheric Model ◽  
Earth System Model ◽  
System Model ◽  
Small Scale ◽  
Earth System ◽  
Consistency Test ◽  
Robust Test ◽  
Community Land Model ◽  
Community Earth System Model ◽  
Statistical Consistency

Abstract. The Community Earth System Model Ensemble Consistency Test (CESM-ECT) suite was developed as an alternative to requiring bitwise identical output for quality assurance. This objective test provides a statistical measurement of consistency between an accepted ensemble created by small initial temperature perturbations and a test set of CESM simulations. In this work, we extend the CESM-ECT suite with an inexpensive and robust test for ensemble consistency that is applied to Community Atmospheric Model (CAM) output after only nine model time steps. We demonstrate that adequate ensemble variability is achieved with instantaneous variable values at the ninth step, despite rapid perturbation growth and heterogeneous variable spread. We refer to this new test as the Ultra-Fast CAM Ensemble Consistency Test (UF-CAM-ECT) and demonstrate its effectiveness in practice, including its ability to detect small-scale events and its applicability to the Community Land Model (CLM). The new ultra-fast test facilitates CESM development, porting, and optimization efforts, particularly when used to complement information from the original CESM-ECT suite of tools.

scholarly journals Evaluating simplified chemical mechanisms within present-day simulations of the Community Earth System Model version 1.2 with CAM4 (CESM1.2 CAM-chem): MOZART-4 vs. Reduced Hydrocarbon vs. Super-Fast chemistry

2018 ◽  
Vol 11 (10) ◽  
pp. 4155-4174 ◽  
Author(s):  
Benjamin Brown-Steiner ◽  
Noelle E. Selin ◽  
Ronald Prinn ◽  
Simone Tilmes ◽  
Louisa Emmons ◽  
...  
Keyword(s):  
Computational Cost ◽  
Earth System Model ◽  
Chemical Mechanism ◽  
System Model ◽  
Earth System ◽  
Chemical Mechanisms ◽  
Trade Offs ◽  
Community Earth System Model ◽  
Time Periods ◽  
Fast Mechanism

Abstract. While state-of-the-art complex chemical mechanisms expand our understanding of atmospheric chemistry, their sheer size and computational requirements often limit simulations to short lengths or ensembles to only a few members. Here we present and compare three 25-year present-day offline simulations with chemical mechanisms of different levels of complexity using the Community Earth System Model (CESM) Version 1.2 CAM-chem (CAM4): the Model for Ozone and Related Chemical Tracers, version 4 (MOZART-4) mechanism, the Reduced Hydrocarbon mechanism, and the Super-Fast mechanism. We show that, for most regions and time periods, differences in simulated ozone chemistry between these three mechanisms are smaller than the model–observation differences themselves. The MOZART-4 mechanism and the Reduced Hydrocarbon are in close agreement in their representation of ozone throughout the troposphere during all time periods (annual, seasonal, and diurnal). While the Super-Fast mechanism tends to have higher simulated ozone variability and differs from the MOZART-4 mechanism over regions of high biogenic emissions, it is surprisingly capable of simulating ozone adequately given its simplicity. We explore the trade-offs between chemical mechanism complexity and computational cost by identifying regions where the simpler mechanisms are comparable to the MOZART-4 mechanism and regions where they are not. The Super-Fast mechanism is 3 times as fast as the MOZART-4 mechanism, which allows for longer simulations or ensembles with more members that may not be feasible with the MOZART-4 mechanism given limited computational resources.

scholarly journals Development of hybrid 3-D hydrological modeling for the NCAR Community Earth System Model (CESM)

2015 ◽  
Author(s):  
Xubin Zeng ◽  
◽  
Peter Troch ◽  
Jon Pelletier ◽  
Guo-Yue Niu ◽  
...  
Keyword(s):  
Hydrological Modeling ◽  
Earth System Model ◽  
System Model ◽  
Earth System ◽  
Community Earth System Model
Sign in / Sign up

Export Citation Format

Share Document