scholarly journals Regional Climate Model Evaluation System powered by Apache Open Climate Workbench v1.3.0: an enabling tool for facilitating regional climate studies

2018 ◽  
Author(s):  
Huikyo Lee ◽  
Alexander Goodman ◽  
Lewis McGibbney ◽  
Duane Waliser ◽  
Jinwon Kim ◽  
...  
Keyword(s):  
Regional Climate Model ◽  
Model Evaluation ◽  
Evaluation System ◽  
Climate Models ◽  
Performance Metrics ◽  
Climate Model ◽  
Regional Climate ◽  
The United States ◽  
Climate Data ◽  
Climate Model Evaluation

Abstract. The Regional Climate Model Evaluation System (RCMES) is an enabling tool of the National Aeronautics and Space Administration to support the United States National Climate Assessment. As a comprehensive system for evaluating climate models on regional and continental scales using observational datasets from a variety of sources, RCMES is designed to yield information on the performance of climate models and guide their improvement. Here we present a user-oriented document describing the latest version of RCMES, its development process and future plans for improvements. The main objective of RCMES is to facilitate the climate model evaluation process at regional scales. RCMES provides a framework for performing systematic evaluations of climate simulations, such as those from the Coordinated Regional Climate Downscaling Experiment (CORDEX), using in-situ observations as well as satellite and reanalysis data products. The main components of RCMES are: 1) a database of observations widely used for climate model evaluation, 2) various data loaders to import climate models and observations in different formats, 3) a versatile processor to subset and regrid the loaded datasets, 4) performance metrics designed to assess and quantify model skill, 5) plotting routines to visualize the performance metrics, 6) a toolkit for statistically downscaling climate model simulations, and 7) two installation packages to maximize convenience of users without Python skills. RCMES website is maintained up to date with brief explanation of these components. Although there are other open-source software (OSS) toolkits that facilitate analysis and evaluation of climate models, there is a need for climate scientists to participate in the development and customization of OSS to study regional climate change. To establish infrastructure and to ensure software sustainability, development of RCMES is an open, publicly accessible process enabled by leveraging the Apache Software Foundation's OSS library, Apache Open Climate Workbench (OCW). The OCW software that powers RCMES includes a Python OSS library for common climate model evaluation tasks as well as a set of user-friendly interfaces for quickly configuring a model evaluation task. OCW also allows users to build their own climate data analysis tools, such as the statistical downscaling toolkit provided as a part of RCMES.

scholarly journals Regional Climate Model Evaluation System powered by Apache Open Climate Workbench v1.3.0: an enabling tool for facilitating regional climate studies

2018 ◽  
Vol 11 (11) ◽  
pp. 4435-4449 ◽  
Author(s):  
Huikyo Lee ◽  
Alexander Goodman ◽  
Lewis McGibbney ◽  
Duane E. Waliser ◽  
Jinwon Kim ◽  
...  
Keyword(s):  
Regional Climate Model ◽  
Model Evaluation ◽  
Evaluation System ◽  
Climate Models ◽  
Performance Metrics ◽  
Climate Model ◽  
Regional Climate ◽  
The United States ◽  
Climate Data ◽  
Climate Model Evaluation

Abstract. The Regional Climate Model Evaluation System (RCMES) is an enabling tool of the National Aeronautics and Space Administration to support the United States National Climate Assessment. As a comprehensive system for evaluating climate models on regional and continental scales using observational datasets from a variety of sources, RCMES is designed to yield information on the performance of climate models and guide their improvement. Here, we present a user-oriented document describing the latest version of RCMES, its development process, and future plans for improvements. The main objective of RCMES is to facilitate the climate model evaluation process at regional scales. RCMES provides a framework for performing systematic evaluations of climate simulations, such as those from the Coordinated Regional Climate Downscaling Experiment (CORDEX), using in situ observations, as well as satellite and reanalysis data products. The main components of RCMES are (1) a database of observations widely used for climate model evaluation, (2) various data loaders to import climate models and observations on local file systems and Earth System Grid Federation (ESGF) nodes, (3) a versatile processor to subset and regrid the loaded datasets, (4) performance metrics designed to assess and quantify model skill, (5) plotting routines to visualize the performance metrics, (6) a toolkit for statistically downscaling climate model simulations, and (7) two installation packages to maximize convenience of users without Python skills. RCMES website is maintained up to date with a brief explanation of these components. Although there are other open-source software (OSS) toolkits that facilitate analysis and evaluation of climate models, there is a need for climate scientists to participate in the development and customization of OSS to study regional climate change. To establish infrastructure and to ensure software sustainability, development of RCMES is an open, publicly accessible process enabled by leveraging the Apache Software Foundation's OSS library, Apache Open Climate Workbench (OCW). The OCW software that powers RCMES includes a Python OSS library for common climate model evaluation tasks as well as a set of user-friendly interfaces for quickly configuring a model evaluation task. OCW also allows users to build their own climate data analysis tools, such as the statistical downscaling toolkit provided as a part of RCMES.

scholarly journals Climate Model Evaluation in the Presence of Observational Uncertainty: Precipitation Indices over the Contiguous United States

2019 ◽  
Vol 20 (7) ◽  
pp. 1339-1357 ◽  
Author(s):  
Peter B. Gibson ◽  
Duane E. Waliser ◽  
Huikyo Lee ◽  
Baijun Tian ◽  
Elias Massoud
Keyword(s):  
United States ◽  
Model Evaluation ◽  
Climate Models ◽  
Climate Model ◽  
Dynamical Downscaling ◽  
Daily Precipitation ◽  
Regional Climate ◽  
Climate Model Evaluation ◽  
Observational Uncertainty ◽  
Precipitation Indices

Abstract Climate model evaluation is complicated by the presence of observational uncertainty. In this study we analyze daily precipitation indices and compare multiple gridded observational and reanalysis products with regional climate models (RCMs) from the North American component of the Coordinated Regional Climate Downscaling Experiment (NA-CORDEX) multimodel ensemble. In the context of model evaluation, observational product differences across the contiguous United States (CONUS) are also deemed nontrivial for some indices, especially for annual counts of consecutive wet days and for heavy precipitation indices. Multidimensional scaling (MDS) is used to directly include this observational spread into the model evaluation procedure, enabling visualization and interpretation of model differences relative to a “cloud” of observational uncertainty. Applying MDS to the evaluation of NA-CORDEX RCMs reveals situations of added value from dynamical downscaling, situations of degraded performance from dynamical downscaling, and the sensitivity of model performance to model resolution. On precipitation days, higher-resolution RCMs typically simulate higher mean and extreme precipitation rates than their lower-resolution pairs, sometimes improving model fidelity with observations. These results document the model spread and biases in daily precipitation extremes across the full NA-CORDEX model ensemble. The often-large divergence between in situ observations, satellite data, and reanalysis, shown here for CONUS, is especially relevant for data-sparse regions of the globe where satellite and reanalysis products are extensively relied upon. This highlights the need to carefully consider multiple observational products when evaluating climate models.

Evaluation of the Surface Climatology over the Conterminous United States in the North American Regional Climate Change Assessment Program Hindcast Experiment Using a Regional Climate Model Evaluation System

2013 ◽  
Vol 26 (15) ◽  
pp. 5698-5715 ◽  
Author(s):  
Jinwon Kim ◽  
Duane E. Waliser ◽  
Chris A. Mattmann ◽  
Linda O. Mearns ◽  
Cameron E. Goodale ◽  
...  
Keyword(s):  
United States ◽  
Regional Climate Model ◽  
Great Plains ◽  
Model Evaluation ◽  
Evaluation System ◽  
Climate Model ◽  
Regional Climate ◽  
Regional Climate Change ◽  
The North ◽  
Climate Change Assessment

Abstract Surface air temperature, precipitation, and insolation over the conterminous United States region from the North American Regional Climate Change Assessment Program (NARCCAP) regional climate model (RCM) hindcast study are evaluated using the Jet Propulsion Laboratory (JPL) Regional Climate Model Evaluation System (RCMES). All RCMs reasonably simulate the observed climatology of these variables. RCM skill varies more widely for the magnitude of spatial variability than the pattern. The multimodel ensemble is among the best performers for all these variables. Systematic biases occur across these RCMs for the annual means, with warm biases over the Great Plains (GP) and cold biases in the Atlantic and the Gulf of Mexico (GM) coastal regions. Wet biases in the Pacific Northwest and dry biases in the GM/southern Great Plains also occur in most RCMs. All RCMs suffer problems in simulating summer rainfall in the Arizona–New Mexico region. RCMs generally overestimate surface insolation, especially in the eastern United States. Negative correlation between the biases in insolation and precipitation suggest that these two fields are related, likely via clouds. Systematic variations in biases for regions, seasons, variables, and metrics suggest that the bias correction in applying climate model data to assess the climate impact on various sectors must be performed accordingly. Precipitation evaluation with multiple observations reveals that observational data can be an important source of uncertainties in model evaluation; thus, cross examination of observational data is important for model evaluation.

scholarly journals Observational uncertainty and regional climate model evaluation: A pan-European perspective

2017 ◽  
Vol 39 (9) ◽  
pp. 3730-3749 ◽  
Author(s):  
Sven Kotlarski ◽  
Péter Szabó ◽  
Sixto Herrera ◽  
Olle Räty ◽  
Klaus Keuler ◽  
...  
Keyword(s):  
Regional Climate Model ◽  
Model Evaluation ◽  
Climate Model ◽  
Regional Climate ◽  
European Perspective ◽  
Climate Model Evaluation ◽  
Observational Uncertainty
Sign in / Sign up

Export Citation Format

Share Document