scholarly journals Evaluating Climate Models with an African Lens

2018 ◽  
Vol 99 (2) ◽  
pp. 313-336 ◽  
Author(s):  
Rachel James ◽  
Richard Washington ◽  
Babatunde Abiodun ◽  
Gillian Kay ◽  
Joseph Mutemi ◽  
...  

Abstract Climate models are becoming evermore complex and increasingly relied upon to inform climate change adaptation. Yet progress in model development is lagging behind in many of the regions that need the information most, including in Africa. Targeted model development for Africa is crucial and so too is targeted model evaluation. Assessment of model performance in specific regions often follows a “validation” approach, focusing on mean biases, but if models are to be improved, it is important to understand how they simulate regional climate dynamics: to move from validation to process-based evaluation. This evaluation may be different for every region and requires local weather and climate expertise: a “one size fits all” approach could overlook important, region-specific phenomena. So which are the important processes in African regions? And how might they be evaluated? This paper addresses these questions, drawing on the expertise of a team of scientists from Central, East, southern, and West Africa. For each region, the current understanding of climate models is reviewed, and an example of targeted evaluation is provided, including analysis of moist circulations, teleconnections, and modes of variability. A pan-African perspective is also considered, to examine processes operating between regions. The analysis is based on the Met Office Unified Model, but it uses diagnostics that might be applied to other models. These examples are intended to prompt further discussion among climate modelers and African scientists about how to best evaluate models with an African lens, and promote the development of a model evaluation hub for Africa, to fast track understanding of model behavior for this important continent.

Author(s):  
María Laura Bettolli

Global climate models (GCM) are fundamental tools for weather forecasting and climate predictions at different time scales, from intraseasonal prediction to climate change projections. Their design allows GCMs to simulate the global climate adequately, but they are not able to skillfully simulate local/regional climates. Consequently, downscaling and bias correction methods are increasingly needed and applied for generating useful local and regional climate information from the coarse GCM resolution. Empirical-statistical downscaling (ESD) methods generate climate information at the local scale or with a greater resolution than that achieved by GCM by means of empirical or statistical relationships between large-scale atmospheric variables and the local observed climate. As a counterpart approach, dynamical downscaling is based on regional climate models that simulate regional climate processes with a greater spatial resolution, using GCM fields as initial or boundary conditions. Various ESD methods can be classified according to different criteria, depending on their approach, implementation, and application. In general terms, ESD methods can be categorized into subgroups that include transfer functions or regression models (either linear or nonlinear), weather generators, and weather typing methods and analogs. Although these methods can be grouped into different categories, they can also be combined to generate more sophisticated downscaling methods. In the last group, weather typing and analogs, the methods relate the occurrence of particular weather classes to local and regional weather conditions. In particular, the analog method is based on finding atmospheric states in the historical record that are similar to the atmospheric state on a given target day. Then, the corresponding historical local weather conditions are used to estimate local weather conditions on the target day. The analog method is a relatively simple technique that has been extensively used as a benchmark method in statistical downscaling applications. Of easy construction and applicability to any predictand variable, it has shown to perform as well as other more sophisticated methods. These attributes have inspired its application in diverse studies around the world that explore its ability to simulate different characteristics of regional climates.


2021 ◽  
Author(s):  
Christian Zeman ◽  
Christoph Schär

<p>Since their first operational application in the 1950s, atmospheric numerical models have become essential tools in weather and climate prediction. As such, they are a constant subject to changes, thanks to advances in computer systems, numerical methods, and the ever increasing knowledge about the atmosphere of Earth. Many of the changes in today's models relate to seemingly unsuspicious modifications, associated with minor code rearrangements, changes in hardware infrastructure, or software upgrades. Such changes are meant to preserve the model formulation, yet the verification of such changes is challenged by the chaotic nature of our atmosphere - any small change, even rounding errors, can have a big impact on individual simulations. Overall this represents a serious challenge to a consistent model development and maintenance framework.</p><p>Here we propose a new methodology for quantifying and verifying the impacts of minor atmospheric model changes, or its underlying hardware/software system, by using ensemble simulations in combination with a statistical hypothesis test. The methodology can assess effects of model changes on almost any output variable over time, and can also be used with different hypothesis tests.</p><p>We present first applications of the methodology with the regional weather and climate model COSMO. The changes considered include a major system upgrade of the supercomputer used, the change from double to single precision floating-point representation, changes in the update frequency of the lateral boundary conditions, and tiny changes to selected model parameters. While providing very robust results, the methodology also shows a large sensitivity to more significant model changes, making it a good candidate for an automated tool to guarantee model consistency in the development cycle.</p>


2013 ◽  
Vol 94 (11) ◽  
pp. 1691-1706 ◽  
Author(s):  
A. A. M. Holtslag ◽  
G. Svensson ◽  
P. Baas ◽  
S. Basu ◽  
B. Beare ◽  
...  

The representation of the atmospheric boundary layer is an important part of weather and climate models and impacts many applications such as air quality and wind energy. Over the years, the performance in modeling 2-m temperature and 10-m wind speed has improved but errors are still significant. This is in particular the case under clear skies and low wind speed conditions at night as well as during winter in stably stratified conditions over land and ice. In this paper, the authors review these issues and provide an overview of the current understanding and model performance. Results from weather forecast and climate models are used to illustrate the state of the art as well as findings and recommendations from three intercomparison studies held within the Global Energy and Water Exchanges (GEWEX) Atmospheric Boundary Layer Study (GABLS). Within GABLS, the focus has been on the examination of the representation of the stable boundary layer and the diurnal cycle over land in clear-sky conditions. For this purpose, single-column versions of weather and climate models have been compared with observations, research models, and large-eddy simulations. The intercomparison cases are based on observations taken in the Arctic, Kansas, and Cabauw in the Netherlands. From these studies, we find that even for the noncloudy boundary layer important parameterization challenges remain.


2018 ◽  
Vol 22 (4) ◽  
pp. 2163-2185 ◽  
Author(s):  
Stefan Liersch ◽  
Julia Tecklenburg ◽  
Henning Rust ◽  
Andreas Dobler ◽  
Madlen Fischer ◽  
...  

Abstract. Climate simulations are the fuel to drive hydrological models that are used to assess the impacts of climate change and variability on hydrological parameters, such as river discharges, soil moisture, and evapotranspiration. Unlike with cars, where we know which fuel the engine requires, we never know in advance what unexpected side effects might be caused by the fuel we feed our models with. Sometimes we increase the fuel's octane number (bias correction) to achieve better performance and find out that the model behaves differently but not always as was expected or desired. This study investigates the impacts of projected climate change on the hydrology of the Upper Blue Nile catchment using two model ensembles consisting of five global CMIP5 Earth system models and 10 regional climate models (CORDEX Africa). WATCH forcing data were used to calibrate an eco-hydrological model and to bias-correct both model ensembles using slightly differing approaches. On the one hand it was found that the bias correction methods considerably improved the performance of average rainfall characteristics in the reference period (1970–1999) in most of the cases. This also holds true for non-extreme discharge conditions between Q20 and Q80. On the other hand, bias-corrected simulations tend to overemphasize magnitudes of projected change signals and extremes. A general weakness of both uncorrected and bias-corrected simulations is the rather poor representation of high and low flows and their extremes, which were often deteriorated by bias correction. This inaccuracy is a crucial deficiency for regional impact studies dealing with water management issues and it is therefore important to analyse model performance and characteristics and the effect of bias correction, and eventually to exclude some climate models from the ensemble. However, the multi-model means of all ensembles project increasing average annual discharges in the Upper Blue Nile catchment and a shift in seasonal patterns, with decreasing discharges in June and July and increasing discharges from August to November.


2019 ◽  
Vol 20 (7) ◽  
pp. 1339-1357 ◽  
Author(s):  
Peter B. Gibson ◽  
Duane E. Waliser ◽  
Huikyo Lee ◽  
Baijun Tian ◽  
Elias Massoud

Abstract Climate model evaluation is complicated by the presence of observational uncertainty. In this study we analyze daily precipitation indices and compare multiple gridded observational and reanalysis products with regional climate models (RCMs) from the North American component of the Coordinated Regional Climate Downscaling Experiment (NA-CORDEX) multimodel ensemble. In the context of model evaluation, observational product differences across the contiguous United States (CONUS) are also deemed nontrivial for some indices, especially for annual counts of consecutive wet days and for heavy precipitation indices. Multidimensional scaling (MDS) is used to directly include this observational spread into the model evaluation procedure, enabling visualization and interpretation of model differences relative to a “cloud” of observational uncertainty. Applying MDS to the evaluation of NA-CORDEX RCMs reveals situations of added value from dynamical downscaling, situations of degraded performance from dynamical downscaling, and the sensitivity of model performance to model resolution. On precipitation days, higher-resolution RCMs typically simulate higher mean and extreme precipitation rates than their lower-resolution pairs, sometimes improving model fidelity with observations. These results document the model spread and biases in daily precipitation extremes across the full NA-CORDEX model ensemble. The often-large divergence between in situ observations, satellite data, and reanalysis, shown here for CONUS, is especially relevant for data-sparse regions of the globe where satellite and reanalysis products are extensively relied upon. This highlights the need to carefully consider multiple observational products when evaluating climate models.


2018 ◽  
Author(s):  
Huikyo Lee ◽  
Alexander Goodman ◽  
Lewis McGibbney ◽  
Duane Waliser ◽  
Jinwon Kim ◽  
...  

Abstract. The Regional Climate Model Evaluation System (RCMES) is an enabling tool of the National Aeronautics and Space Administration to support the United States National Climate Assessment. As a comprehensive system for evaluating climate models on regional and continental scales using observational datasets from a variety of sources, RCMES is designed to yield information on the performance of climate models and guide their improvement. Here we present a user-oriented document describing the latest version of RCMES, its development process and future plans for improvements. The main objective of RCMES is to facilitate the climate model evaluation process at regional scales. RCMES provides a framework for performing systematic evaluations of climate simulations, such as those from the Coordinated Regional Climate Downscaling Experiment (CORDEX), using in-situ observations as well as satellite and reanalysis data products. The main components of RCMES are: 1) a database of observations widely used for climate model evaluation, 2) various data loaders to import climate models and observations in different formats, 3) a versatile processor to subset and regrid the loaded datasets, 4) performance metrics designed to assess and quantify model skill, 5) plotting routines to visualize the performance metrics, 6) a toolkit for statistically downscaling climate model simulations, and 7) two installation packages to maximize convenience of users without Python skills. RCMES website is maintained up to date with brief explanation of these components. Although there are other open-source software (OSS) toolkits that facilitate analysis and evaluation of climate models, there is a need for climate scientists to participate in the development and customization of OSS to study regional climate change. To establish infrastructure and to ensure software sustainability, development of RCMES is an open, publicly accessible process enabled by leveraging the Apache Software Foundation's OSS library, Apache Open Climate Workbench (OCW). The OCW software that powers RCMES includes a Python OSS library for common climate model evaluation tasks as well as a set of user-friendly interfaces for quickly configuring a model evaluation task. OCW also allows users to build their own climate data analysis tools, such as the statistical downscaling toolkit provided as a part of RCMES.


2019 ◽  
Vol 53 (5-6) ◽  
pp. 2985-3005 ◽  
Author(s):  
Giovanni Di Virgilio ◽  
Jason P. Evans ◽  
Alejandro Di Luca ◽  
Roman Olson ◽  
Daniel Argüeso ◽  
...  

2016 ◽  
Author(s):  
Emmanuele Russo ◽  
Ulrich Cubasch

Abstract. The improvement in resolution of climate models is always been mentioned as one of the most important factors when investigating past climatic conditions especially in order to evaluate and compare the results against proxy data. In this paper we present for the first time a set of high resolution simulations for different time slices of mid-to-late Holocene performed over Europe using a Regional Climate Model. Through a validation against a new pollen-based climate reconstructions dataset, covering almost all of Europe, we test the model performances for paleoclimatic applications and investigate the response of temperature to variations in the seasonal cycle of insolation, with the aim of clarifying earlier debated uncertainties, giving physically plausible interpretations of both the pollen data and the model results. The results reinforce previous findings showing that summertime temperatures were driven mainly by changes in insolation and that the model is too sensitive to such changes over Southern Europe, resulting in drier and warmer conditions. In winter, instead, the model does not reproduce correctly the same amplitude of changes, even if it captures the main pattern of the pollen dataset over most of the domain for the time periods under investigation. Through the analysis of variations in atmospheric circulation we suggest that, even though in some areas the discrepancies between the two datasets are most likely due to high pollen uncertanties, in general the model seems to underestimate the changes in the amplitude of the North Atlantic Oscillation, overestimating the contribution of secondary modes of variability


2021 ◽  
Author(s):  
Priscilla A. Mooney ◽  
Diana Rechid ◽  
Edouard L. Davin ◽  
Eleni Katragkou ◽  
Natalie de Noblet-Ducoudré ◽  
...  

Abstract. Land cover in sub-polar and alpine regions of northern and eastern Europe have already begun changing due to natural and anthropogenic changes such as afforestation. This will impact the regional climate and hydrology upon which societies in these regions are highly reliant. This study aims to identify the impacts of afforestation/reforestation (hereafter afforestation) on snow and the snow-albedo effect, and highlight potential improvements for future model development. The study uses an ensemble of nine regional climate models for two different idealised experiments covering a 30-year period; one experiment replaces most land cover in Europe with forest while the other experiment replaces all forested areas with grass. The ensemble consists of nine regional climate models composed of different combinations of five regional atmospheric models and six land surface models. Results show that afforestation reduces the snow-albedo sensitivity index and enhances snow melt. While the direction of change is robustly modelled, there is still uncertainty in the magnitude of change. Greatest differences between models emerge in the snowmelt season. One regional climate model uses different land surface models which shows consistent changes between the three simulations during the accumulation period but differs in the snowmelt season. Together these results point to the need for further model development in representing both grass-snow and forest-snow interactions during the snowmelt season. Pathways to accomplishing this include 1) a more sophisticated representation of forest structure, 2) kilometer scale simulations, and 3) more observational studies on vegetation-snow interactions in Northern Europe.


2020 ◽  
Author(s):  
Huihui Wu ◽  
Jonathan W. Taylor ◽  
Kate Szpek ◽  
Justin Langridge ◽  
Paul I. Williams ◽  
...  

Abstract. Seasonal biomass burning (BB) from June to October in central and southern Africa leads to absorbing aerosols being transported over the south Atlantic Ocean every year, and contributes significantly to the regional climate forcing. The vertical distribution of submicron aerosols and their properties were characterized over the remote southeast Atlantic for the first time, using airborne in-situ measurements made during the CLoud-Aerosol-Radiation Interactions and Forcing for Year 2017 (CLARIFY-2017) campaign. BB aerosols were intensively observed in the region surrounding Ascension Island, in the marine boundary layer (MBL) and free troposphere (FT) up to 5 km. We show that the aerosols had undergone a significant aging process during > 7 days transit from source, as indicated by highly oxidized organic aerosol and thickly coated black carbon (BC). The highly aged BB aerosols in the CLARIFY region were also especially rich in BC compared with those from other regions. We also found significant vertical variation in the single scattering albedos (SSA) of these aerosols, as a function of relative chemical composition and size. The lowest SSA was generally in the low FT layer around 2000 m altitude (medians: 0.83 at 405 nm and 0.80 at 658 nm). This finding is important since it means that BB aerosols across the east Atlantic region are more absorbing than is currently represented in climate models. Furthermore, in the FT, we show that SSA increased with altitude and this was associated with an enhanced inorganic nitrate mass fraction and aerosol size. This likely results from increased partitioning to the existing particles at higher altitude with lower temperature and higher relative humidity. After entrainment into the BL, aerosols were generally smaller in size than were observed in the FT, and had a larger fraction of scattering material with resultant higher average dry SSA, mostly due to marine emissions and aerosol removal by drizzle. Our results provide unique observational constraints on aerosol parameterizations used in modelling regional radiation interactions over this important region. We recommend that future work should consider the impact of this vertical variability on climate models.


Sign in / Sign up

Export Citation Format

Share Document