scholarly journals Land surface Verification Toolkit (LVT) – a generalized framework for land surface model evaluation

2012 ◽  
Vol 5 (1) ◽  
pp. 229-276 ◽  
Author(s):  
S. V. Kumar ◽  
C. D. Peters-Lidard ◽  
J. Santanello ◽  
K. Harrison ◽  
Y. Liu ◽  
...  

Abstract. Model evaluation and verification are key in improving the usage and applicability of simulation models for real-world applications. In this article, the development and capabilities of a formal system for land surface model evaluation called the Land surface Verification Toolkit (LVT) is described. LVT is designed to provide an integrated environment for systematic land model evaluation and facilitates a range of verification approaches and analysis capabilities. LVT operates across multiple temporal and spatial scales and employs a large suite of in-situ, remotely sensed and other model and reanalysis datasets in their native formats. In addition to the traditional accuracy-based measures, LVT also includes uncertainty and ensemble diagnostics, information theory measures, spatial similarity metrics and scale decomposition techniques that provide novel ways for performing diagnostic model evaluations. Though LVT was originally designed to support the land surface modeling and data assimilation framework known as the Land Information System (LIS), it supports hydrological data products from non-LIS environments as well. In addition, the analysis of diagnostics from various computational subsystems of LIS including data assimilation, optimization and uncertainty estimation are supported within LVT. Together, LIS and LVT provide a robust end-to-end environment for enabling the concepts of model data fusion for hydrological applications. The evolving capabilities of LVT framework are expected to facilitate rapid model evaluation efforts and aid the definition and refinement of formal evaluation procedures for the land surface modeling community.

2012 ◽  
Vol 5 (3) ◽  
pp. 869-886 ◽  
Author(s):  
S. V. Kumar ◽  
C. D. Peters-Lidard ◽  
J. Santanello ◽  
K. Harrison ◽  
Y. Liu ◽  
...  

Abstract. Model evaluation and verification are key in improving the usage and applicability of simulation models for real-world applications. In this article, the development and capabilities of a formal system for land surface model evaluation called the Land surface Verification Toolkit (LVT) is described. LVT is designed to provide an integrated environment for systematic land model evaluation and facilitates a range of verification approaches and analysis capabilities. LVT operates across multiple temporal and spatial scales and employs a large suite of in-situ, remotely sensed and other model and reanalysis datasets in their native formats. In addition to the traditional accuracy-based measures, LVT also includes uncertainty and ensemble diagnostics, information theory measures, spatial similarity metrics and scale decomposition techniques that provide novel ways for performing diagnostic model evaluations. Though LVT was originally designed to support the land surface modeling and data assimilation framework known as the Land Information System (LIS), it supports hydrological data products from non-LIS environments as well. In addition, the analysis of diagnostics from various computational subsystems of LIS including data assimilation, optimization and uncertainty estimation are supported within LVT. Together, LIS and LVT provide a robust end-to-end environment for enabling the concepts of model data fusion for hydrological applications. The evolving capabilities of LVT framework are expected to facilitate rapid model evaluation efforts and aid the definition and refinement of formal evaluation procedures for the land surface modeling community.


2010 ◽  
Vol 49 (3) ◽  
pp. 415-423 ◽  
Author(s):  
M. Tugrul Yilmaz ◽  
Paul Houser ◽  
Roshan Shrestha ◽  
Valentine G. Anantharaj

Abstract This paper introduces a new method to improve land surface model skill by merging different available precipitation datasets, given that an accurate land surface parameter ground truth is available. Precipitation datasets are merged with the objective of improving terrestrial water and energy cycle simulation skill, unlike most common methods in which the merging skills are evaluated by comparing the results with gauge data or selected reference data. The optimal merging method developed in this study minimizes the simulated land surface parameter (soil moisture, temperature, etc.) errors using the Noah land surface model with the Nelder–Mead (downhill simplex) method. In addition to improving the simulation skills, this method also impedes the adverse impacts of single-source precipitation data errors. Analysis has indicated that the results from the optimally merged precipitation product have fewer errors in other land surface states and fluxes such as evapotranspiration (ET), discharge R, and skin temperature T than do simulation results obtained by forcing the model using the precipitation products individually. It is also found that, using this method, the true knowledge of soil moisture information minimized land surface modeling errors better than the knowledge of other land surface parameters (ET, R, and T). Results have also shown that, although it does not have the true precipitation information, the method has associated heavier weights with the precipitation product that has intensity, amount, and frequency that are similar to those of the true precipitation.


2021 ◽  
Vol 13 (16) ◽  
pp. 3068
Author(s):  
Haojin Zhao ◽  
Carsten Montzka ◽  
Roland Baatz ◽  
Harry Vereecken ◽  
Harrie-Jan Hendricks Franssen

Land surface models (LSMs) simulate water and energy cycles at the atmosphere–soil interface, however, the physical processes in the subsurface are typically oversimplified and lateral water movement is neglected. Here, a cross-evaluation of land surface model results (with and without lateral flow processes), the National Aeronautics and Space Administration (NASA) Soil Moisture Active/Passive (SMAP) mission soil moisture product, and cosmic-ray neutron sensor (CRNS) measurements is carried out over a temperate climate region with cropland and forests over western Germany. Besides a traditional land surface model (the Community Land Model (CLM) version 3.5), a coupled land surface-subsurface model (CLM-ParFlow) is applied. Compared to CLM stand-alone simulations, the coupled CLM-ParFlow model considered both vertical and lateral water movement. In addition to standard validation metrics, a triple collocation (TC) analysis has been performed to help understanding the random error variances of different soil moisture datasets. In this study, it is found that the three soil moisture datasets are consistent. The coupled and uncoupled model simulations were evaluated at CRNS sites and the coupled model simulations showed less bias than the CLM-standalone model (−0.02 cm3 cm−3 vs. 0.07 cm3 cm−3), similar random errors, but a slightly smaller correlation with the measurements (0.67 vs. 0.71). The TC-analysis showed that CLM-ParFlow reproduced better soil moisture dynamics than CLM stand alone and with a higher signal-to-noise ratio. This suggests that the representation of subsurface physics is of major importance in land surface modeling and that coupled land surface-subsurface modeling is of high interest.


Author(s):  
Nemesio Rodriguez-Fernandez ◽  
Patricia de Rosnay ◽  
Clement Albergel ◽  
Philippe Richaume ◽  
Filipe Aires ◽  
...  

The assimilation of Soil Moisture and Ocean Salinity (SMOS) data into the ECMWF (European Centre for Medium Range Weather Forecasts) H-TESSEL (Hydrology revised - Tiled ECMWF Scheme for Surface Exchanges over Land) model is presented. SMOS soil moisture (SM) estimates have been produced specifically by training a neural network with SMOS brightness temperatures as input and H-TESSEL model SM simulations as reference. This can help the assimilation of SMOS information in several ways: (1) the neural network soil moisture (NNSM) data have a similar climatology to the model, (2) no global bias is present with respect to the model even if regional differences can exist. Experiments performing joint data assimilation (DA) of NNSM, 2 metre air temperature and relative humidity or NNSM-only DA are discussed. The resulting SM was evaluated against a large number of in situ measurements of SM obtaining similar results to those of the model with no assimilation, even if significant differences were found from site to site. In addition, atmospheric forecasts initialized with H-TESSEL runs (without DA) or with the analysed SM were compared to measure of the impact of the satellite information. Although, NNSM DA has an overall neutral impact in the forecast in the Tropics, a significant positive impact was found in other areas and periods, especially in regions with limited in situ information. The joint NNSM, T2m and RH2m DA improves the forecast for all the seasons in the Southern Hemisphere. The impact is mostly due to T2m and RH2m, but SMOS NN DA alone also improves the forecast in July- September. In the Northern Hemisphere, the joint NNSM, T2m and RH2m DA improves the forecast in April-September, while NNSM alone has a significant positive effect in July-September. Furthermore, forecasting skill maps show that SMOS NNSM improves the forecast in North America and in Northern Asia for up to 72 hours lead time.


2021 ◽  
Author(s):  
Eduardo Emilio Sanchez-Leon ◽  
Natascha Brandhorst ◽  
Bastian Waldowski ◽  
Ching Pui Hung ◽  
Insa Neuweiler ◽  
...  

<p>The success of data assimilation systems strongly depends on the suitability of the generated ensembles. While in theory data assimilation should correct the states of an ensemble of models, especially if model parameters are included in the update, its effectiveness will depend on many factors, such as ensemble size, ensemble spread, and the proximity of the prior ensemble simulations to the data. In a previous study, we generated an ensemble-based data-assimilation framework to update model states and parameters of a coupled land surface-subsurface model. As simulation system we used the Terrestrial Systems Modeling Platform TerrSysMP, with the community land-surface model (CLM) coupled to the subsurface model Parflow. In this work, we used the previously generated ensemble to assess the effect of uncertain input forcings (i.e. precipitation), unknown subsurface parameterization, and/or plant physiology in data assimilation. The model domain covers a rectangular area of 1×5km<sup>2</sup>, with a uniform depth of 50m. The subsurface material is divided into four units, and the top soil layers consist of three different soil types with different vegetation. Streams are defined along three of the four boundaries of the domain. For data assimilation, we used the TerrsysMP PDAF framework. We defined a series of data assimilation experiments in which sources of uncertainty were considered individually, and all additional settings of the ensemble members matched those of the reference. To evaluate the effect of all sources of uncertainty combined, we designed an additional test in which the input forcings, subsurface parameters, and the leaf area index of the ensemble were all perturbed. In all these tests, the reference model had homogenous subsurface units and the same grid resolution as all models of the ensemble. We used point measurements of soil moisture in all data assimilation experiments. We concluded that precipitation dominates the dynamics of the simulations, and perturbing the precipitation fields for the ensemble have a major impact in the performance of the assimilation. Still, considerable improvements are observed compared to open-loop simulations. In contrast, the effect of variable plant physiology was minimal, with no visible improvement in relevant fluxes such as evapotranspiration. As expected, improved ensemble predictions are propagated longer in time when parameters are included in the update.</p>


2006 ◽  
Vol 7 (3) ◽  
pp. 421-432 ◽  
Author(s):  
Wade T. Crow ◽  
Emiel Van Loon

Abstract Data assimilation approaches require some type of state forecast error covariance information in order to optimally merge model predictions with observations. The ensemble Kalman filter (EnKF) dynamically derives such information through a Monte Carlo approach and the introduction of random noise in model states, fluxes, and/or forcing data. However, in land data assimilation, relatively little guidance exists concerning strategies for selecting the appropriate magnitude and/or type of introduced model noise. In addition, little is known about the sensitivity of filter prediction accuracy to (potentially) inappropriate assumptions concerning the source and magnitude of modeling error. Using a series of synthetic identical twin experiments, this analysis explores the consequences of making incorrect assumptions concerning the source and magnitude of model error on the efficiency of assimilating surface soil moisture observations to constrain deeper root-zone soil moisture predictions made by a land surface model. Results suggest that inappropriate model error assumptions can lead to circumstances in which the assimilation of surface soil moisture observations actually degrades the performance of a land surface model (relative to open-loop assimilations that lack a data assimilation component). Prospects for diagnosing such circumstances and adaptively correcting the culpable model error assumptions using filter innovations are discussed. The dual assimilation of both runoff (from streamflow) and surface soil moisture observations appears to offer a more robust assimilation framework where incorrect model error assumptions are more readily diagnosed via filter innovations.


2017 ◽  
Vol 21 (4) ◽  
pp. 2015-2033 ◽  
Author(s):  
David Fairbairn ◽  
Alina Lavinia Barbu ◽  
Adrien Napoly ◽  
Clément Albergel ◽  
Jean-François Mahfouf ◽  
...  

Abstract. This study evaluates the impact of assimilating surface soil moisture (SSM) and leaf area index (LAI) observations into a land surface model using the SAFRAN–ISBA–MODCOU (SIM) hydrological suite. SIM consists of three stages: (1) an atmospheric reanalysis (SAFRAN) over France, which forces (2) the three-layer ISBA land surface model, which then provides drainage and runoff inputs to (3) the MODCOU hydro-geological model. The drainage and runoff outputs from ISBA are validated by comparing the simulated river discharge from MODCOU with over 500 river-gauge observations over France and with a subset of stations with low-anthropogenic influence, over several years. This study makes use of the A-gs version of ISBA that allows for physiological processes. The atmospheric forcing for the ISBA-A-gs model underestimates direct shortwave and long-wave radiation by approximately 5 % averaged over France. The ISBA-A-gs model also substantially underestimates the grassland LAI compared with satellite retrievals during winter dormancy. These differences result in an underestimation (overestimation) of evapotranspiration (drainage and runoff). The excess runoff flowing into the rivers and aquifers contributes to an overestimation of the SIM river discharge. Two experiments attempted to resolve these problems: (i) a correction of the minimum LAI model parameter for grasslands and (ii) a bias-correction of the model radiative forcing. Two data assimilation experiments were also performed, which are designed to correct random errors in the initial conditions: (iii) the assimilation of LAI observations and (iv) the assimilation of SSM and LAI observations. The data assimilation for (iii) and (iv) was done with a simplified extended Kalman filter (SEKF), which uses finite differences in the observation operator Jacobians to relate the observations to the model variables. Experiments (i) and (ii) improved the median SIM Nash scores by about 9 % and 18 % respectively. Experiment (iii) reduced the LAI phase errors in ISBA-A-gs but had little impact on the discharge Nash efficiency of SIM. In contrast, experiment (iv) resulted in spurious increases in drainage and runoff, which degraded the median discharge Nash efficiency by about 7 %. The poor performance of the SEKF originates from the observation operator Jacobians. These Jacobians are dampened when the soil is saturated and when the vegetation is dormant, which leads to positive biases in drainage and/or runoff and to insufficient corrections during winter, respectively. Possible ways to improve the model are discussed, including a new multi-layer diffusion model and a more realistic response of photosynthesis to temperature in mountainous regions. The data assimilation should be advanced by accounting for model and forcing uncertainties.


2016 ◽  
Vol 9 (8) ◽  
pp. 2833-2852 ◽  
Author(s):  
Nina M. Raoult ◽  
Tim E. Jupp ◽  
Peter M. Cox ◽  
Catherine M. Luke

Abstract. Land-surface models (LSMs) are crucial components of the Earth system models (ESMs) that are used to make coupled climate–carbon cycle projections for the 21st century. The Joint UK Land Environment Simulator (JULES) is the land-surface model used in the climate and weather forecast models of the UK Met Office. JULES is also extensively used offline as a land-surface impacts tool, forced with climatologies into the future. In this study, JULES is automatically differentiated with respect to JULES parameters using commercial software from FastOpt, resulting in an analytical gradient, or adjoint, of the model. Using this adjoint, the adJULES parameter estimation system has been developed to search for locally optimum parameters by calibrating against observations. This paper describes adJULES in a data assimilation framework and demonstrates its ability to improve the model–data fit using eddy-covariance measurements of gross primary production (GPP) and latent heat (LE) fluxes. adJULES also has the ability to calibrate over multiple sites simultaneously. This feature is used to define new optimised parameter values for the five plant functional types (PFTs) in JULES. The optimised PFT-specific parameters improve the performance of JULES at over 85 % of the sites used in the study, at both the calibration and evaluation stages. The new improved parameters for JULES are presented along with the associated uncertainties for each parameter.


2010 ◽  
Vol 11 (5) ◽  
pp. 1103-1122 ◽  
Author(s):  
Rolf H. Reichle ◽  
Sujay V. Kumar ◽  
Sarith P. P. Mahanama ◽  
Randal D. Koster ◽  
Q. Liu

Abstract Land surface (or “skin”) temperature (LST) lies at the heart of the surface energy balance and is a key variable in weather and climate models. In this research LST retrievals from the International Satellite Cloud Climatology Project (ISCCP) are assimilated into the Noah land surface model and Catchment land surface model (CLSM) using an ensemble-based, offline land data assimilation system. LST is described very differently in the two models. A priori scaling and dynamic bias estimation approaches are applied because satellite and model LSTs typically exhibit different mean values and variabilities. Performance is measured against 27 months of in situ measurements from the Coordinated Energy and Water Cycle Observations Project at 48 stations. LST estimates from Noah and CLSM without data assimilation (“open loop”) are comparable to each other and superior to ISCCP retrievals. For LST, the RMSE values are 4.9 K (CLSM), 5.5 K (Noah), and 7.6 K (ISCCP), and the anomaly correlation coefficients (R) are 0.61 (CLSM), 0.63 (Noah), and 0.52 (ISCCP). Assimilation of ISCCP retrievals provides modest yet statistically significant improvements (over an open loop, as indicated by nonoverlapping 95% confidence intervals) of up to 0.7 K in RMSE and 0.05 in the anomaly R. The skill of the latent and sensible heat flux estimates from the assimilation integrations is essentially identical to the corresponding open loop skill. Noah assimilation estimates of ground heat flux, however, can be significantly worse than open loop estimates. Provided the assimilation system is properly adapted to each land model, the benefits from the assimilation of LST retrievals are comparable for both models.


Sign in / Sign up

Export Citation Format

Share Document