scholarly journals Progress report on terrestrial model development (TERRA and HABITAT): Research in support of the CERES earth system modeling project

1994 ◽  
Author(s):  
J.R. Kercher ◽  
M.C. Axelrod ◽  
J.S. Amthor ◽  
J.Q. Chambers

2014 ◽  
Vol 95 (9) ◽  
pp. 1453-1464 ◽  
Author(s):  
Matthew J. Smith ◽  
Paul I. Palmer ◽  
Drew W. Purves ◽  
Mark C. Vanderwel ◽  
Vassily Lyutsarev ◽  
...  

New details about natural and anthropogenic processes are continually added to models of the Earth system, anticipating that the increased realism will increase the accuracy of their predictions. However, perspectives differ about whether this approach will improve the value of the information the models provide to decision makers, scientists, and societies. The present bias toward increasing realism leads to a range of updated projections, but at the expense of uncertainty quantification and model tractability. This bias makes it difficult to quantify the uncertainty associated with the projections from any one model or to the distribution of projections from different models. This in turn limits the utility of climate model outputs for deriving useful information such as in the design of effective climate change mitigation and adaptation strategies or identifying and prioritizing sources of uncertainty for reduction. Here we argue that a new approach to model development is needed, focused on the delivery of information to support specific policy decisions or science questions. The central tenet of this approach is the assessment and justification of the overall balance of model detail that reflects the question posed, current knowledge, available data, and sources of uncertainty. This differs from contemporary practices by explicitly seeking to quantify both the benefits and costs of details at a systemic level, taking into account the precision and accuracy with which predictions are made when compared to existing empirical evidence. We specify changes to contemporary model development practices that would help in achieving this goal.



2015 ◽  
Vol 8 (6) ◽  
pp. 4375-4400 ◽  
Author(s):  
L. Liu ◽  
S. Peng ◽  
C. Zhang ◽  
R. Li ◽  
B. Wang ◽  
...  

Abstract. Reproducibility is a fundamental principle of scientific research. Bitwise identical reproducibility, i.e., bitwise computational results can be reproduced, guarantees the reproduction of exactly the same results. Here we show the importance of bitwise identical reproducibility to Earth system modeling but the importance has not yet been widely recognized. Modeled mean climate states, variability and trends at different scales may be significantly changed or even lead to opposing results due to a slight change in the original simulation setting during a reproduction. Out of the large body of Earth system modeling publications, few thoroughly describe the whole original simulation setting. As a result, the reproduction of a particular simulation experiment by fellow scientists heavily depends on the interaction with the original authors, which is often inconvenient or even impossible. We anticipate bitwise identical reproducibility to be promoted as a worldwide standard, to guarantee the independent reproduction of simulation results and to further improve model development and scientific research.



2015 ◽  
Vol 8 (3) ◽  
pp. 2403-2435 ◽  
Author(s):  
L. Liu ◽  
R. Li ◽  
C. Zhang ◽  
G. Yang ◽  
B. Wang ◽  
...  

Abstract. Reliable numerical simulation plays a critical role in climate change study. The reliability includes bitwise identical reproducibility, i.e. bitwise identical result of numerical simulation can be reproduced. It is important to Earth system modeling and has already been used intra modeling groups for the model development. However, it is rarely considered in a wider range even worldwide. To help achieve the worldwide bitwise identical reproducibility, we introduce the detailed implementations for the bitwise identical reproducibility on the Community Coupler (C-Coupler) platform, a uniform runtime software environment that configures, builds and runs the models in the same manner. Moreover, we share a series of experiences and suggestions regarding the bitwise identical reproducibility. We believe that these implementations, experiences and suggestions can be easily extended to other model software platforms and can prospectively advance the model development and scientific researches in the future.





Eos ◽  
2007 ◽  
Vol 88 (12) ◽  
pp. 143 ◽  
Author(s):  
Sophie Valcke ◽  
Reinhard Budich ◽  
Mick Carter ◽  
Eric Guilyardi ◽  
Marie-Alice Foujols ◽  
...  


2016 ◽  
Vol 9 (2) ◽  
pp. 731-748 ◽  
Author(s):  
R. Li ◽  
L. Liu ◽  
G. Yang ◽  
C. Zhang ◽  
B. Wang

Abstract. Reproducibility and reliability are fundamental principles of scientific research. A compiling setup that includes a specific compiler version and compiler flags is an essential technical support for Earth system modeling. With the fast development of computer software and hardware, a compiling setup has to be updated frequently, which challenges the reproducibility and reliability of Earth system modeling. The existing results of a simulation using an original compiling setup may be irreproducible by a newer compiling setup because trivial round-off errors introduced by the change in compiling setup can potentially trigger significant changes in simulation results. Regarding the reliability, a compiler with millions of lines of code may have bugs that are easily overlooked due to the uncertainties or unknowns in Earth system modeling. To address these challenges, this study shows that different compiling setups can achieve exactly the same (bitwise identical) results in Earth system modeling, and a set of bitwise identical compiling setups of a model can be used across different compiler versions and different compiler flags. As a result, the original results can be more easily reproduced; for example, the original results with an older compiler version can be reproduced exactly with a newer compiler version. Moreover, this study shows that new test cases can be generated based on the differences of bitwise identical compiling setups between different models, which can help detect software bugs in the codes of models and compilers and finally improve the reliability of Earth system modeling.



Sign in / Sign up

Export Citation Format

Share Document