scholarly journals Evaluating the Performance of Land Surface Models

2008 ◽  
Vol 21 (21) ◽  
pp. 5468-5481 ◽  
Author(s):  
Gab Abramowitz ◽  
Ray Leuning ◽  
Martyn Clark ◽  
Andy Pitman

Abstract This paper presents a set of analytical tools to evaluate the performance of three land surface models (LSMs) that are used in global climate models (GCMs). Predictions of the fluxes of sensible heat, latent heat, and net CO2 exchange obtained using process-based LSMs are benchmarked against two statistical models that only use incoming solar radiation, air temperature, and specific humidity as inputs to predict the fluxes. Both are then compared to measured fluxes at several flux stations located on three continents. Parameter sets used for the LSMs include default values used in GCMs for the plant functional type and soil type surrounding each flux station, locally calibrated values, and ensemble sets encompassing combinations of parameters within their respective uncertainty ranges. Performance of the LSMs is found to be generally inferior to that of the statistical models across a wide variety of performance metrics, suggesting that the LSMs underutilize the meteorological information used in their inputs and that model complexity may be hindering accurate prediction. The authors show that model evaluation is purpose specific; good performance in one metric does not guarantee good performance in others. Self-organizing maps are used to divide meteorological “‘forcing space” into distinct regions as a mechanism to identify the conditions under which model bias is greatest. These new techniques will aid modelers to identify the areas of model structure responsible for poor performance.

2020 ◽  
Author(s):  
Manon Sabot ◽  
Martin De Kauwe ◽  
Belinda Medlyn ◽  
Andy Pitman

<p>Nearly 2/3 of the annual global evapotranspiration (ET) over land arises from the vegetation. Yet, coupled-climate models only attribute between 22% – 58% of the annual terrestrial ET to plants. In coupled-climate models, the exchange of carbon and water between the terrestrial biosphere and the atmosphere is simulated by land-surface models (LSMs). Within those LSMs, stomatal conductance (g<sub>s</sub>) models allow plants to regulate their transpiration and carbon uptake, but most are empirically linked to climate, soil moisture availabilty, and CO<sub>2</sub>. Therefore, how and which g<sub>s</sub> schemes are implemented within LSMs is a key source of model uncertainty. This uncertainty has led to considerable investment in theory development in the recent years; multiple alternative hypotheses of optimal leaf-level regulation of gas exchange have been proposed as solutions to reduce existing model biases. However, a systematic inter-model evaluation is lacking (i.e. inter-model comparison within a single framework is needed to understand how different mechanistic assumptions across these new g<sub>s</sub> models affect plant behaviour). Here, we asked how, and under what conditions, nine novel optimal g<sub>s</sub> models differ from one another. The models were trained to match under average conditions before being subjected to: (i) a dry-down, (ii) high vapour pressure deficit, and (iii) elevated CO<sub>2</sub>. These experiments allowed us to identify the models’ specific responses and sensitivities. To further assess whether the models’ responses were realistic, we tested them against photosynthetic and hydraulic field data measured along mesic-xeric gradients in Europe and Australia. Finally, we evaluated model performance versus model complexity and the amount of information taken in by each model, which enables us to make recommendations regarding the use of stomatal conductance schemes in global climate models.</p>


2013 ◽  
Vol 7 (3) ◽  
pp. 2333-2372
Author(s):  
E. Kantzas ◽  
M. Lomas ◽  
S. Quegan ◽  
E. Zakharova

Abstract. An increasing number of studies have demonstrated the significant climatic and ecological changes occurring in the northern latitudes over the past decades. As coupled, earth-system models attempt to describe and simulate the dynamics and complex feedbacks of the Arctic environment, it is important to reduce their uncertainties in short-term predictions by improving the description of both the systems processes and its initial state. This study focuses on snow-related variables and extensively utilizes a historical data set (1966–1996) of field snow measurements acquired across the extend of the Former Soviet Union (FSU) to evaluate a range of simulated snow metrics produced by a variety of land surface models, most of them embedded in IPCC-standard climate models. We reveal model-specific issues in simulating snow dynamics such as magnitude and timings of SWE as well as evolution of snow density. We further employ the field snow measurements alongside novel and model-independent methodologies to extract for the first time (i) a fresh snow density value (57–117 kg m–3) for the region and (ii) mean monthly snowpack sublimation estimates across a grassland-dominated western (November–February) [9.2, 6.1, 9.15, 15.25] mm and forested eastern sub-sector (November–March) [1.53, 1.52, 3.05, 3.80, 12.20] mm; we subsequently use the retrieved values to assess relevant model outputs. The discussion session consists of two parts. The first describes a sensitivity study where field data of snow depth and snow density are forced directly into the surface heat exchange formulation of a land surface model to evaluate how inaccuracies in simulating snow metrics affect important modeled variables and carbon fluxes such as soil temperature, thaw depth and soil carbon decomposition. The second part showcases how the field data can be assimilated with ready-available optimization techniques to pinpoint model issues and improve their performance.


2021 ◽  
Author(s):  
Thedini Asali Peiris ◽  
Petra Döll

<p>Unlike global climate models, hydrological models cannot simulate the feedbacks among atmospheric processes, vegetation, water, and energy exchange at the land surface. This severely limits their ability to quantify the impact of climate change and the concurrent increase of atmospheric CO<sub>2</sub> concentrations on evapotranspiration and thus runoff. Hydrological models generally calculate actual evapotranspiration as a fraction of potential evapotranspiration (PET), which is computed as a function of temperature and net radiation and sometimes of humidity and wind speed. Almost no hydrological model takes into account that PET changes because the vegetation responds to changing CO<sub>2</sub> and climate. This active vegetation response consists of three components. With higher CO<sub>2</sub> concentrations, 1) plant stomata close, reducing transpiration (physiological effect) and 2) plants may grow better, with more leaves, increasing transpiration (structural effect), while 3) climatic changes lead to changes in plants growth and even biome shifts, changing evapotranspiration. Global climate models, which include dynamic vegetation models, simulate all these processes, albeit with a high uncertainty, and take into account the feedbacks to the atmosphere.</p><p>Milly and Dunne (2016) (MD) found that in the case of RCP8.5 the change of PET (computed using the Penman-Monteith equation) between 1981- 2000 and 2081-2100 is much higher than the change of non-water-stressed evapotranspiration (NWSET) computed by an ensemble of global climate models. This overestimation is partially due to the neglect of active vegetation response and partially due to the neglected feedbacks between the atmosphere and the land surface.</p><p>The objective of this paper is to present a simple approach for hydrological models that enables them to mimic the effect of active vegetation on potential evapotranspiration under climate change, thus improving computation of freshwater-related climate change hazards by hydrological models. MD proposed an alternative approach to estimate changes in PET for impact studies that is only a function of the changes in energy and not of temperature and achieves a good fit to the ensemble mean change of evapotranspiration computed by the ensemble of global climate models in months and grid cells without water stress. We developed an implementation of the MD idea for hydrological models using the Priestley-Taylor equation (PET-PT) to estimate PET as a function of net radiation and temperature. With PET-PT, an increasing temperature trend leads to strong increases in PET. Our proposed methodology (PET-MD) helps to remove this effect, retaining the impact of temperature on PET but not on long-term PET change.</p><p>We implemented the PET-MD approach in the global hydrological model WaterGAP2.2d. and computed daily time series of PET between 1981 and 2099 using bias-adjusted climate data of four global climate models for RCP 8.5. We evaluated, computed PET-PT and PET-MD at the grid cell level and globally, comparing also to the results of the Milly-Dunne study. The global analysis suggests that the application of PET-MD reduces the PET change until the end of this century from 3.341 mm/day according to PET-PT to 3.087 mm/day (ensemble mean over the four global climate models).</p><p>Milly, P.C.D., Dunne K.A. (2016). DOI:10.1038/nclimate3046.</p>


2015 ◽  
Vol 12 (24) ◽  
pp. 7503-7518 ◽  
Author(s):  
M. G. De Kauwe ◽  
S.-X. Zhou ◽  
B. E. Medlyn ◽  
A. J. Pitman ◽  
Y.-P. Wang ◽  
...  

Abstract. Future climate change has the potential to increase drought in many regions of the globe, making it essential that land surface models (LSMs) used in coupled climate models realistically capture the drought responses of vegetation. Recent data syntheses show that drought sensitivity varies considerably among plants from different climate zones, but state-of-the-art LSMs currently assume the same drought sensitivity for all vegetation. We tested whether variable drought sensitivities are needed to explain the observed large-scale patterns of drought impact on the carbon, water and energy fluxes. We implemented data-driven drought sensitivities in the Community Atmosphere Biosphere Land Exchange (CABLE) LSM and evaluated alternative sensitivities across a latitudinal gradient in Europe during the 2003 heatwave. The model predicted an overly abrupt onset of drought unless average soil water potential was calculated with dynamic weighting across soil layers. We found that high drought sensitivity at the most mesic sites, and low drought sensitivity at the most xeric sites, was necessary to accurately model responses during drought. Our results indicate that LSMs will over-estimate drought impacts in drier climates unless different sensitivity of vegetation to drought is taken into account.


2019 ◽  
Vol 2019 ◽  
pp. 1-18 ◽  
Author(s):  
Suchada Kamworapan ◽  
Chinnawat Surussavadee

This study evaluates the performances of all forty different global climate models (GCMs) that participate in the Coupled Model Intercomparison Project Phase 5 (CMIP5) for simulating climatological temperature and precipitation for Southeast Asia. Historical simulations of climatological temperature and precipitation of the 40 GCMs for the 40-year period of 1960–1999 for both land and sea and those for the century of 1901–1999 for land are evaluated using observation and reanalysis datasets. Nineteen different performance metrics are employed. The results show that the performances of different GCMs vary greatly. CNRM-CM5-2 performs best among the 40 GCMs, where its total error is 3.25 times less than that of GCM performing worst. The performance of CNRM-CM5-2 is compared with those of the ensemble average of all 40 GCMs (40-GCM-Ensemble) and the ensemble average of the 6 best GCMs (6-GCM-Ensemble) for four categories, i.e., temperature only, precipitation only, land only, and sea only. While 40-GCM-Ensemble performs best for temperature, 6-GCM-Ensemble performs best for precipitation. 6-GCM-Ensemble performs best for temperature and precipitation simulations over sea, whereas CNRM-CM5-2 performs best over land. Overall results show that 6-GCM-Ensemble performs best and is followed by CNRM-CM5-2 and 40-GCM-Ensemble, respectively. The total errors of 6-GCM-Ensemble, CNRM-CM5-2, and 40-GCM-Ensemble are 11.84, 13.69, and 14.09, respectively. 6-GCM-Ensemble and CNRM-CM5-2 agree well with observations and can provide useful climate simulations for Southeast Asia. This suggests the use of 6-GCM-Ensemble and CNRM-CM5-2 for climate studies and projections for Southeast Asia.


2015 ◽  
Vol 28 (14) ◽  
pp. 5583-5600 ◽  
Author(s):  
Jacob Scheff ◽  
Dargan M. W. Frierson

Abstract The aridity of a terrestrial climate is often quantified using the dimensionless ratio of annual precipitation (P) to annual potential evapotranspiration (PET). In this study, the climatological patterns and greenhouse warming responses of terrestrial P, Penman–Monteith PET, and are compared among 16 modern global climate models. The large-scale climatological values and implied biome types often disagree widely among models, with large systematic differences from observational estimates. In addition, the PET climatologies often differ by several tens of percent when computed using monthly versus 3-hourly inputs. With greenhouse warming, land P does not systematically increase or decrease, except at high latitudes. Therefore, because of moderate, ubiquitous PET increases, decreases (drying) are much more widespread than increases (wetting) in the tropics, subtropics, and midlatitudes in most models, confirming and expanding on earlier findings. The PET increases are also somewhat sensitive to the time resolution of the inputs, although not as systematically as for the PET climatologies. The changes in the balance between P and PET are also quantified using an alternative aridity index, the ratio , which has a one-to-one but nonlinear correspondence with . It is argued that the magnitudes of changes are more uniformly relevant than the magnitudes of changes, which tend to be much higher in wetter regions. The ratio and its changes are also found to be excellent statistical predictors of the land surface evaporative fraction and its changes.


2010 ◽  
Vol 23 (11) ◽  
pp. 3031-3056 ◽  
Author(s):  
Katherine H. Straub ◽  
Patrick T. Haertel ◽  
George N. Kiladis

Abstract Output from 20 coupled global climate models is analyzed to determine whether convectively coupled Kelvin waves exist in the models, and, if so, how their horizontal and vertical structures compare to observations. Model data are obtained from the World Climate Research Program’s (WCRP’s) Coupled Model Intercomparison Project phase 3 (CMIP3) multimodel dataset. Ten of the 20 models contain spectral peaks in precipitation in the Kelvin wave band, and, of these 10, only 5 contain wave activity distributions and three-dimensional wave structures that resemble the observations. Thus, the majority (75%) of the global climate models surveyed do not accurately represent convectively coupled Kelvin waves, one of the primary sources of submonthly zonally propagating variability in the tropics. The primary feature common to the five successful models is the convective parameterization. Three of the five models use the Tiedtke–Nordeng convective scheme, while the other two utilize the Pan and Randall scheme. The 15 models with less success at generating Kelvin waves predominantly contain convective schemes that are based on the concept of convective adjustment, although it appears that those schemes can be improved by the addition of convective “trigger” functions. Three-dimensional Kelvin wave structures in the five successful models resemble observations to a large degree, with vertically tilted temperature, specific humidity, and zonal wind anomalies. However, no model completely captures the observed signal, with most of the models being deficient in lower-tropospheric temperature and humidity signals near the location of maximum precipitation. These results suggest the need for improvements in the representations of shallow convection and convective downdrafts in global models.


2021 ◽  
Author(s):  
Priscilla A. Mooney ◽  
Diana Rechid ◽  
Edouard L. Davin ◽  
Eleni Katragkou ◽  
Natalie de Noblet-Ducoudré ◽  
...  

Abstract. Land cover in sub-polar and alpine regions of northern and eastern Europe have already begun changing due to natural and anthropogenic changes such as afforestation. This will impact the regional climate and hydrology upon which societies in these regions are highly reliant. This study aims to identify the impacts of afforestation/reforestation (hereafter afforestation) on snow and the snow-albedo effect, and highlight potential improvements for future model development. The study uses an ensemble of nine regional climate models for two different idealised experiments covering a 30-year period; one experiment replaces most land cover in Europe with forest while the other experiment replaces all forested areas with grass. The ensemble consists of nine regional climate models composed of different combinations of five regional atmospheric models and six land surface models. Results show that afforestation reduces the snow-albedo sensitivity index and enhances snow melt. While the direction of change is robustly modelled, there is still uncertainty in the magnitude of change. Greatest differences between models emerge in the snowmelt season. One regional climate model uses different land surface models which shows consistent changes between the three simulations during the accumulation period but differs in the snowmelt season. Together these results point to the need for further model development in representing both grass-snow and forest-snow interactions during the snowmelt season. Pathways to accomplishing this include 1) a more sophisticated representation of forest structure, 2) kilometer scale simulations, and 3) more observational studies on vegetation-snow interactions in Northern Europe.


2015 ◽  
Vol 12 (15) ◽  
pp. 12349-12393 ◽  
Author(s):  
M. G. De Kauwe ◽  
S.-X. Zhou ◽  
B. E. Medlyn ◽  
A. J. Pitman ◽  
Y.-P. Wang ◽  
...  

Abstract. Future climate change has the potential to increase drought in many regions of the globe, making it essential that land surface models (LSMs) used in coupled climate models, realistically capture the drought responses of vegetation. Recent data syntheses show that drought sensitivity varies considerably among plants from different climate zones, but state-of-the-art LSMs currently assume the same drought sensitivity for all vegetation. We tested whether variable drought sensitivities are needed to explain the observed large-scale patterns of drought impact. We implemented data-driven drought sensitivities in the Community Atmosphere Biosphere Land Exchange (CABLE) LSM and evaluated alternative sensitivities across a latitudinal gradient in Europe during the 2003 heatwave. The model predicted an overly abrupt onset of drought unless average soil water potential was calculated with dynamic weighting across soil layers. We found that high drought sensitivity at the northernmost sites, and low drought sensitivity at the southernmost sites, was necessary to accurately model responses during drought. Our results indicate that LSMs will over-estimate drought impacts in drier climates unless different sensitivity of vegetation to drought is taken into account.


2006 ◽  
Vol 19 (20) ◽  
pp. 5455-5464 ◽  
Author(s):  
Ken Minschwaner ◽  
Andrew E. Dessler ◽  
Parnchai Sawaengphokhai

Abstract Relationships between the mean humidity in the tropical upper troposphere and tropical sea surface temperatures in 17 coupled ocean–atmosphere global climate models were investigated. This analysis builds on a prior study of humidity and surface temperature measurements that suggested an overall positive climate feedback by water vapor in the tropical upper troposphere whereby the mean specific humidity increases with warmer sea surface temperature (SST). The model results for present-day simulations show a large range in mean humidity, mean air temperature, and mean SST, but they consistently show increases in upper-tropospheric specific humidity with warmer SST. The model average increase in water vapor at 250 mb with convective mean SST is 44 ppmv K−1, with a standard deviation of 14 ppmv K−1. Furthermore, the implied feedback in the models is not as strong as would be the case if relative humidity remained constant in the upper troposphere. The model mean decrease in relative humidity is −2.3% ± 1.0% K−1 at 250 mb, whereas observations indicate decreases of −4.8% ± 1.7% K−1 near 215 mb. These two values agree within the respective ranges of uncertainty, indicating that current global climate models are simulating the observed behavior of water vapor in the tropical upper troposphere with reasonable accuracy.


Sign in / Sign up

Export Citation Format

Share Document