A weighting scheme to incorporate large ensembles in multi-model ensemble projections

2020 ◽  
Author(s):  
Anna Merrifield ◽  
Lukas Brunner ◽  
Ruth Lorenz ◽  
Reto Knutti
Keyword(s):  
Internal Variability ◽  
Ensemble Member ◽  
Earth System Model ◽  
System Model ◽  
Initial Condition ◽  
Earth System ◽  
Model Ensemble ◽  
Single Model ◽  
Large Ensembles ◽  
Model Ensembles

<p>Multi-model ensembles can be used to estimate uncertainty in projections of regional climate, but this uncertainty often depends on the constituents of the ensemble. The dependence of uncertainty on ensemble composition is clear when single model initial condition large ensembles (SMILEs) are included within a multi-model ensemble. SMILEs introduce new information into a multi-model ensemble by representing region-scale internal variability, but also introduce redundant information, by virtue of a single model being represented by 50–100 outcomes. To preserve the contribution of internal variability and ensure redundancy does not overwhelm uncertainty estimates, a weighting approach is used to incorporate 50-members of the Community Earth System Model (CESM1.2.2), 50-members of the Canadian Earth System Model (CanESM2), and 100-members of the MPI Grand Ensemble (MPI-GE) into an 88-member Coupled Model Intercomparison Project Phase 5 (CMIP5) multi-model ensemble. The weight assigned to each multi-model ensemble member is based on the member's ability to reproduce observed climate (performance) and scaled by a measure of historical redundancy (dependence). Surface air temperature (SAT) and sea level pressure (SLP) diagnostics are used to determine the weights, and relationships between present and future diagnostic behavior are discussed. A new diagnostic, estimated forced trend, is proposed to replace a diagnostic with no clear emergent relationship, 50-year regional SAT trend.</p><p>The influence of the weighting is assessed in estimates of Northern European winter and Mediterranean summer end-of-century warming in the CMIP5 and combined SMILE-CMIP5 multi-model ensembles. The weighting is shown to recover uncertainty obscured by SMILE redundancy, notably in Mediterranean summer. For each SMILE, the independence weight of each ensemble member as a function of the number of SMILE members included in the CMIP5 ensemble is assessed. The independence weight increases linearly with added members with a slope that depends on SMILE, region, and season. Finally, it is shown that the weighting method can be used to guide SMILE member selection if a subsetted ensemble with one member per model is sought. The weight a SMILE receives within a subsetted ensemble depends on which member is used to represent it, reinforcing the advantage of weighting and incorporating all initial condition ensemble members in multi-model ensembles.</p>

scholarly journals A weighting scheme to incorporate large ensembles in multi-model ensemble projections

2019 ◽  
Author(s):  
Anna Louise Merrifield ◽  
Lukas Brunner ◽  
Ruth Lorenz ◽  
Reto Knutti
Keyword(s):  
Internal Variability ◽  
Ensemble Member ◽  
Earth System Model ◽  
System Model ◽  
Initial Condition ◽  
Earth System ◽  
Model Ensemble ◽  
Single Model ◽  
Large Ensembles ◽  
Model Ensembles

Abstract. Multi-model ensembles can be used to estimate uncertainty in projections of regional climate, but this uncertainty often depends on the constituents of the ensemble. The dependence of uncertainty on ensemble composition is clear when single model initial condition large ensembles (SMILEs) are included within a multi-model ensemble. SMILEs introduce new information into a multi-model ensemble by representing region-scale internal variability, but also introduce redundant information, by virtue of a single model being represented by 50–100 outcomes. To preserve the contribution of internal variability and ensure redundancy does not overwhelm uncertainty estimates, a weighting approach is used to incorporate 50-members of the Community Earth System Model (CESM1.2.2), 50-members of the Canadian Earth System Model (CanESM2), and 100-members of the MPI Grand Ensemble (MPI-GE) into an 88-member Coupled Model Intercomparison Project Phase 5 (CMIP5) multi-model ensemble. The weight assigned to each multi-model ensemble member is based on the member's ability to reproduce observed climate (performance) and scaled by a measure of redundancy (dependence). Surface air temperature (SAT) and sea level pressure (SLP) diagnostics are used to determine the weights, and relationships between present and future diagnostic behavior are discussed. A new diagnostic, estimated forced trend, is proposed to replace a diagnostic with no clear emergent relationship, 50-year regional SAT trend. The influence of the weighting is assessed in estimates of Northern European winter and Mediterranean summer end-of-century warming in the CMIP5 and combined SMILE-CMIP5 multi-model ensembles. The weighting is shown to recover uncertainty obscured by SMILE redundancy, notably in Mediterranean summer. For each SMILE, the independence weight of each ensemble member as a function of the number of SMILE members included in the CMIP5 ensemble is assessed. The independence weight increases linearly with added members with a slope that depends on SMILE, region, and season. Finally, it is shown that the weighting method can be used to guide SMILE member selection if a subsetted ensemble with one member per model is sought. The weight a SMILE receives within a subsetted ensemble depends on which member is used to represent it, reinforcing the advantage of weighting and incorporating all initial condition ensemble members in multi-model ensembles.

scholarly journals An investigation of weighting schemes suitable for incorporating large ensembles into multi-model ensembles

2020 ◽  
Vol 11 (3) ◽  
pp. 807-834 ◽  
Author(s):  
Anna Louise Merrifield ◽  
Lukas Brunner ◽  
Ruth Lorenz ◽  
Iselin Medhaug ◽  
Reto Knutti
Keyword(s):  
Coupled Model ◽  
Internal Variability ◽  
System Model ◽  
Initial Condition ◽  
Earth System ◽  
Model Intercomparison ◽  
Model Ensemble ◽  
Single Model ◽  
Large Ensembles ◽  
Model Ensembles

Abstract. Multi-model ensembles can be used to estimate uncertainty in projections of regional climate, but this uncertainty often depends on the constituents of the ensemble. The dependence of uncertainty on ensemble composition is clear when single-model initial condition large ensembles (SMILEs) are included within a multi-model ensemble. SMILEs allow for the quantification of internal variability, a non-negligible component of uncertainty on regional scales, but may also serve to inappropriately narrow uncertainty by giving a single model many additional votes. In advance of the mixed multi-model, the SMILE Coupled Model Intercomparison version 6 (CMIP6) ensemble, we investigate weighting approaches to incorporate 50 members of the Community Earth System Model (CESM1.2.2-LE), 50 members of the Canadian Earth System Model (CanESM2-LE), and 100 members of the MPI Grand Ensemble (MPI-GE) into an 88-member Coupled Model Intercomparison Project Phase 5 (CMIP5) ensemble. The weights assigned are based on ability to reproduce observed climate (performance) and scaled by a measure of redundancy (dependence). Surface air temperature (SAT) and sea level pressure (SLP) predictors are used to determine the weights, and relationships between present and future predictor behavior are discussed. The estimated residual thermodynamic trend is proposed as an alternative predictor to replace 50-year regional SAT trends, which are more susceptible to internal variability. Uncertainty in estimates of northern European winter and Mediterranean summer end-of-century warming is assessed in a CMIP5 and a combined SMILE–CMIP5 multi-model ensemble. Five different weighting strategies to account for the mix of initial condition (IC) ensemble members and individually represented models within the multi-model ensemble are considered. Allowing all multi-model ensemble members to receive either equal weight or solely a performance weight (based on the root mean square error (RMSE) between members and observations over nine predictors) is shown to lead to uncertainty estimates that are dominated by the presence of SMILEs. A more suitable approach includes a dependence assumption, scaling either by 1∕N, the number of constituents representing a “model”, or by the same RMSE distance metric used to define model performance. SMILE contributions to the weighted ensemble are smallest (<10 %) when a model is defined as an IC ensemble and increase slightly (<20 %) when the definition of a model expands to include members from the same institution and/or development stream. SMILE contributions increase further when dependence is defined by RMSE (over nine predictors) amongst members because RMSEs between SMILE members can be as large as RMSEs between SMILE members and other models. We find that an alternative RMSE distance metric, derived from global SAT and hemispheric SLP climatology, is able to better identify IC members in general and SMILE members in particular as members of the same model. Further, more subtle dependencies associated with resolution differences and component similarities are also identified by the global predictor set.

scholarly journals Emulating Earth system model temperatures with MESMER: from global mean temperature trajectories to grid-point-level realizations on land

2020 ◽  
Vol 11 (1) ◽  
pp. 139-159 ◽  
Author(s):  
Lea Beusch ◽  
Lukas Gudmundsson ◽  
Sonia I. Seneviratne
Keyword(s):  
Grid Point ◽  
Earth System Model ◽  
System Model ◽  
Initial Condition ◽  
Earth System ◽  
Single Model ◽  
Global Mean Temperature ◽  
Mean Temperature ◽  
Model Ensembles ◽  
Global Mean

Abstract. Earth system models (ESMs) are invaluable tools to study the climate system's response to specific greenhouse gas emission pathways. Large single-model initial-condition and multi-model ensembles are used to investigate the range of possible responses and serve as input to climate impact and integrated assessment models. Thereby, climate signal uncertainty is propagated along the uncertainty chain and its effect on interactions between humans and the Earth system can be quantified. However, generating both single-model initial-condition and multi-model ensembles is computationally expensive. In this study, we assess the feasibility of geographically explicit climate model emulation, i.e., of statistically producing large ensembles of land temperature field time series that closely resemble ESM runs at a negligible computational cost. For this purpose, we develop a modular emulation framework which consists of (i) a global mean temperature module, (ii) a local temperature response module, and (iii) a local residual temperature variability module. Based on this framework, MESMER, a Modular Earth System Model Emulator with spatially Resolved output, is built. We first show that to successfully mimic single-model initial-condition ensembles of yearly temperature from 1870 to 2100 on grid-point to regional scales with MESMER, it is sufficient to train on a single ESM run, but separate emulators need to be calibrated for individual ESMs given fundamental inter-model differences. We then emulate 40 climate models of the Coupled Model Intercomparison Project Phase 5 (CMIP5) to create a “superensemble”, i.e., a large ensemble which closely resembles a multi-model initial-condition ensemble. The thereby emerging ESM-specific emulator parameters provide essential insights on inter-model differences across a broad range of scales and characterize core properties of each ESM. Our results highlight that, for temperature at the spatiotemporal scales considered here, it is likely more advantageous to invest computational resources into generating multi-model ensembles rather than large single-model initial-condition ensembles. Such multi-model ensembles can be extended to superensembles with emulators like the one presented here.

scholarly journals Insights from Earth system model initial-condition large ensembles and future prospects

2020 ◽  
Vol 10 (4) ◽  
pp. 277-286 ◽  
Author(s):  
C. Deser ◽  
F. Lehner ◽  
K. B. Rodgers ◽  
T. Ault ◽  
T. L. Delworth ◽  
...  
Keyword(s):  
Earth System Model ◽  
System Model ◽  
Initial Condition ◽  
Earth System ◽  
Future Prospects ◽  
Large Ensembles

scholarly journals Publisher Correction: Insights from Earth system model initial-condition large ensembles and future prospects

2020 ◽  
Vol 10 (8) ◽  
pp. 791-791 ◽  
Author(s):  
C. Deser ◽  
F. Lehner ◽  
K. B. Rodgers ◽  
T. Ault ◽  
T. L. Delworth ◽  
...  
Keyword(s):  
Earth System Model ◽  
System Model ◽  
Initial Condition ◽  
Earth System ◽  
Future Prospects ◽  
Large Ensembles

scholarly journals Description and evaluation of NorESM1-F: A fast version of the Norwegian Earth System Model (NorESM)

2018 ◽  
Author(s):  
Chuncheng Guo ◽  
Mats Bentsen ◽  
Ingo Bethke ◽  
Mehmet Ilicak ◽  
Jerry Tjiputra ◽  
...  
Keyword(s):  
Carbon Cycle ◽  
Sea Ice ◽  
Large Scale ◽  
Coupled Model ◽  
Coupled System ◽  
Internal Variability ◽  
Earth System Model ◽  
Meridional Overturning Circulation ◽  
System Model ◽  
Earth System

Abstract. A new computationally efficient version of the Norwegian Earth System Model (NorESM) is presented. This new version (here termed NorESM1-F) runs about 2.5 times faster (e.g. 90 model years per day on current hardware) than the version that contributed to the fifth phase of the Coupled Model Intercomparison project (CMIP5), i.e., NorESM1-M, and is therefore particularly suitable for multi-millennial paleoclimate and carbon cycle simulations or large ensemble simulations. The speedup is primarily a result of using a prescribed atmosphere aerosol chemistry and a tripolar ocean-sea ice horizontal grid configuration that allows an increase of the ocean-sea ice component time steps. Ocean biogeochemistry can be activated for fully coupled and semi-coupled carbon cycle applications. This paper describes the model and evaluates its performance using observations and NorESM1-M as benchmarks. The evaluation emphasises model stability, important large-scale features in the ocean and sea ice components, internal variability in the coupled system, and climate sensitivity. Simulation results from NorESM1-F in general agree well with observational estimates, and show evident improvements over NorESM1-M, for example, in the strength of the meridional overturning circulation and sea ice simulation, both important metrics in simulating past and future climates. Whereas NorESM1-M showed a slight global cool bias in the upper oceans, NorESM1-F exhibits a global warm bias. In general, however, NorESM1-F has more similarities than dissimilarities compared to NorESM1-M, and some biases and deficiencies known in NorESM1-M remain.

scholarly journals Description and evaluation of NorESM1-F: a fast version of the Norwegian Earth System Model (NorESM)

2019 ◽  
Vol 12 (1) ◽  
pp. 343-362 ◽  
Author(s):  
Chuncheng Guo ◽  
Mats Bentsen ◽  
Ingo Bethke ◽  
Mehmet Ilicak ◽  
Jerry Tjiputra ◽  
...  
Keyword(s):  
Carbon Cycle ◽  
Sea Ice ◽  
Large Scale ◽  
Coupled Model ◽  
Coupled System ◽  
Internal Variability ◽  
Earth System Model ◽  
Meridional Overturning Circulation ◽  
System Model ◽  
Earth System

Abstract. A new computationally efficient version of the Norwegian Earth System Model (NorESM) is presented. This new version (here termed NorESM1-F) runs about 2.5 times faster (e.g., 90 model years per day on current hardware) than the version that contributed to the fifth phase of the Coupled Model Intercomparison project (CMIP5), i.e., NorESM1-M, and is therefore particularly suitable for multimillennial paleoclimate and carbon cycle simulations or large ensemble simulations. The speed-up is primarily a result of using a prescribed atmosphere aerosol chemistry and a tripolar ocean–sea ice horizontal grid configuration that allows an increase of the ocean–sea ice component time steps. Ocean biogeochemistry can be activated for fully coupled and semi-coupled carbon cycle applications. This paper describes the model and evaluates its performance using observations and NorESM1-M as benchmarks. The evaluation emphasizes model stability, important large-scale features in the ocean and sea ice components, internal variability in the coupled system, and climate sensitivity. Simulation results from NorESM1-F in general agree well with observational estimates and show evident improvements over NorESM1-M, for example, in the strength of the meridional overturning circulation and sea ice simulation, both important metrics in simulating past and future climates. Whereas NorESM1-M showed a slight global cool bias in the upper oceans, NorESM1-F exhibits a global warm bias. In general, however, NorESM1-F has more similarities than dissimilarities compared to NorESM1-M, and some biases and deficiencies known in NorESM1-M remain.

A Multitask Learning View on the Earth System Model Ensemble

2015 ◽  
Vol 17 (6) ◽  
pp. 35-42
Author(s):  
Andre R. Goncalves ◽  
Fernando J. Von Zuben ◽  
Arindam Banerjee
Keyword(s):  
Multitask Learning ◽  
Earth System Model ◽  
System Model ◽  
Earth System ◽  
Model Ensemble ◽  
The Earth

scholarly journals The Norwegian Earth System Model, NorESM1-M – Part 1: Description and basic evaluation of the physical climate

2013 ◽  
Vol 6 (3) ◽  
pp. 687-720 ◽  
Author(s):  
M. Bentsen ◽  
I. Bethke ◽  
J. B. Debernard ◽  
T. Iversen ◽  
A. Kirkevåg ◽  
...  
Keyword(s):  
Model Performance ◽  
Internal Variability ◽  
Horizontal Resolution ◽  
Ocean Model ◽  
Earth System Model ◽  
System Model ◽  
Earth System ◽  
Climate System Model ◽  
Model Stability ◽  
The University

Abstract. The core version of the Norwegian Climate Center's Earth System Model, named NorESM1-M, is presented. The NorESM family of models are based on the Community Climate System Model version 4 (CCSM4) of the University Corporation for Atmospheric Research, but differs from the latter by, in particular, an isopycnic coordinate ocean model and advanced chemistry–aerosol–cloud–radiation interaction schemes. NorESM1-M has a horizontal resolution of approximately 2° for the atmosphere and land components and 1° for the ocean and ice components. NorESM is also available in a lower resolution version (NorESM1-L) and a version that includes prognostic biogeochemical cycling (NorESM1-ME). The latter two model configurations are not part of this paper. Here, a first-order assessment of the model stability, the mean model state and the internal variability based on the model experiments made available to CMIP5 are presented. Further analysis of the model performance is provided in an accompanying paper (Iversen et al., 2013), presenting the corresponding climate response and scenario projections made with NorESM1-M.

Sign in / Sign up

Export Citation Format

Share Document