scholarly journals Comparing the ensemble and extended Kalman filters for in situ soil moisture assimilation with contrasting conditions

2015 ◽  
Vol 19 (12) ◽  
pp. 4811-4830 ◽  
Author(s):  
D. Fairbairn ◽  
A. L. Barbu ◽  
J.-F. Mahfouf ◽  
J.-C. Calvet ◽  
E. Gelati

Abstract. Two data assimilation (DA) methods are compared for their ability to produce an accurate soil moisture analysis using the Météo-France land surface model: (i) SEKF, a simplified extended Kalman filter, which uses a climatological background-error covariance, and (ii) EnSRF, the ensemble square root filter, which uses an ensemble background-error covariance and approximates random rainfall errors stochastically. In situ soil moisture observations at 5 cm depth are assimilated into the surface layer and 30 cm deep observations are used to evaluate the root-zone analysis on 12 sites in south-western France (SMOSMANIA network). These sites differ in terms of climate and soil texture. The two methods perform similarly and improve on the open loop. Both methods suffer from incorrect linear assumptions which are particularly degrading to the analysis during water-stressed conditions: the EnSRF by a dry bias and the SEKF by an over-sensitivity of the model Jacobian between the surface and the root-zone layers. These problems are less severe for the sites with wetter climates. A simple bias correction technique is tested on the EnSRF. Although this reduces the bias, it modifies the soil moisture fluxes and suppresses the ensemble spread, which degrades the analysis performance. However, the EnSRF flow-dependent background-error covariance evidently captures seasonal variability in the soil moisture errors and should exploit planned improvements in the model physics. Synthetic twin experiments demonstrate that when there is only a random component in the precipitation forcing errors, the correct stochastic representation of these errors enables the EnSRF to perform better than the SEKF. It might therefore be possible for the EnSRF to perform better than the SEKF with real data, if the rainfall uncertainty was accurately captured. However, the simple rainfall error model is not advantageous in our real experiments. More realistic rainfall error models are suggested.

2015 ◽  
Vol 12 (8) ◽  
pp. 7353-7403
Author(s):  
D. Fairbairn ◽  
A. L. Barbu ◽  
J.-F. Mahfouf ◽  
J.-C. Calvet ◽  
E. Gelati

Abstract. Two data assimilation methods are compared for their ability to produce a deterministic soil moisture analysis on the Météo-France land surface model: (i) SEKF, a Simplified Extended Kalman Filter, which uses a climatological background-error covariance, (ii) EnSRF, the Ensemble Square Root Filter, which uses an ensemble background-error covariance and approximates random forcing errors stochastically. The accuracy of the deterministic analysis is measured on 12 sites with in situ observations and various soil textures in Southwest France (SMOSMANIA network). In the experiments with real observations, the two methods perform similarly and improve on the open loop. Both methods suffer from incorrect linear assumptions which are particularly degrading to the analysis during water-stressed conditions: the EnSRF by a dry bias and the SEKF by an over-sensitivity of the model Jacobian between the surface and the root zone layers. These problems are less severe for sandy soils than clay soils because sandy soils are less sensitive to perturbations in the initial conditions. A simple bias correction technique is tested on the EnSRF. Although this reduces the bias, it also suppresses the ensemble spread, which degrades the analysis performance. However, the EnSRF flow-dependent background-error covariance evidently captures seasonal variability in the soil moisture errors and should exploit planned improvements in the model physics. Synthetic experiments demonstrate that when there is only a random component in the precipitation forcing errors, the correct stochastic representation of these errors enables the EnSRF to perform better than the SEKF. But in the real experiments the same rainfall error specification does not improve the EnSRF analysis. It is likely that the actual rainfall errors are underestimated and that other sources of errors could limit the usefulness of this information. More comprehensive ways of representing the rainfall errors are suggested, which might improve the EnSRF performance.


2021 ◽  
Author(s):  
Adam Pasik ◽  
Wolfgang Preimesberger ◽  
Bernhard Bauer-Marschallinger ◽  
Wouter Dorigo

<p>Multiple satellite-based global surface soil moisture (SSM) datasets are presently available, these however, address exclusively the top layer of the soil (0-5cm). Meanwhile, root-zone soil moisture cannot be directly quantified with remote sensing but can be estimated from SSM using a land surface model. Alternatively, soil water index (SWI; calculated from SSM as a function of time needed for infiltration) can be used as a simple approximation of root-zone conditions. SWI is a proxy for deeper layers of the soil profile which control evapotranspiration, and is hence especially important for studying hydrological processes over vegetation-covered areas and meteorological modelling.</p><p>Here we introduce the advances in our work on the first operationally capable SWI-based root-zone soil moisture dataset from C3S Soil Moisture v201912 COMBINED product, spanning the period 2002-2020. The uniqueness of this dataset lies in the fact that T-values (temporal lengths ruling the infiltration) characteristic of SWI were translated into particular soil depths making it much more intuitive, user-friendly and easily applicable. Available are volumetric soil moisture values for the top 1 m of the soil profile at 10 cm intervals, where the optimal T-value (T-best) for each soil layer is selected based on a range of correlation metrics with in situ measurements from the International Soil Moisture Network (ISMN) and the relevant soil and climatic parameters.<br>Additionally we present the results of an extensive global validation against in situ measurements (ISMN) as well as the results of investigations into the relationship between a range of soil and climate characteristics and the optimal T-values for particular soil depths.</p>


2015 ◽  
Vol 19 (12) ◽  
pp. 4831-4844 ◽  
Author(s):  
C. Draper ◽  
R. Reichle

Abstract. A 9 year record of Advanced Microwave Scanning Radiometer – Earth Observing System (AMSR-E) soil moisture retrievals are assimilated into the Catchment land surface model at four locations in the US. The assimilation is evaluated using the unbiased mean square error (ubMSE) relative to watershed-scale in situ observations, with the ubMSE separated into contributions from the subseasonal (SMshort), mean seasonal (SMseas), and inter-annual (SMlong) soil moisture dynamics. For near-surface soil moisture, the average ubMSE for Catchment without assimilation was (1.8 × 10−3 m3 m−3)2, of which 19 % was in SMlong, 26 % in SMseas, and 55 % in SMshort. The AMSR-E assimilation significantly reduced the total ubMSE at every site, with an average reduction of 33 %. Of this ubMSE reduction, 37 % occurred in SMlong, 24 % in SMseas, and 38 % in SMshort. For root-zone soil moisture, in situ observations were available at one site only, and the near-surface and root-zone results were very similar at this site. These results suggest that, in addition to the well-reported improvements in SMshort, assimilating a sufficiently long soil moisture data record can also improve the model representation of important long-term events, such as droughts. The improved agreement between the modeled and in situ SMseas is harder to interpret, given that mean seasonal cycle errors are systematic, and systematic errors are not typically targeted by (bias-blind) data assimilation. Finally, the use of 1-year subsets of the AMSR-E and Catchment soil moisture for estimating the observation-bias correction (rescaling) parameters is investigated. It is concluded that when only 1 year of data are available, the associated uncertainty in the rescaling parameters should not greatly reduce the average benefit gained from data assimilation, although locally and in extreme years there is a risk of increased errors.


Author(s):  
Rolf H. Reichle ◽  
Qing Liu ◽  
Joseph V. Ardizzone ◽  
Wade T. Crow ◽  
Gabrielle J. M. De Lannoy ◽  
...  

AbstractSoil Moisture Active Passive (SMAP) mission L-band brightness temperature (Tb) observations are routinely assimilated into the Catchment land surface model to generate Level-4 Soil Moisture (L4_SM) estimates of global surface and root-zone soil moisture at 9-km, 3-hourly resolution with ~2.5-day latency. The Catchment model in the L4_SM algorithm is driven with ¼-degree, hourly surface meteorological forcing data from the Goddard Earth Observing System (GEOS). Outside of Africa and the high latitudes, GEOS precipitation is corrected using Climate Prediction Center Unified (CPCU) gauge-based, ½-degree, daily precipitation. L4_SM soil moisture was previously shown to improve over land model-only estimates that use CPCU precipitation but no Tb assimilation (CPCU_SIM). Here, we additionally examine the skill of model-only (CTRL) and Tb assimilation-only (SMAP_DA) estimates derived without CPCU precipitation. Soil moisture is assessed versus in situ measurements in well-instrumented regions and globally through the Instrumental Variable (IV) method using independent soil moisture retrievals from the Advanced Scatterometer. At the in situ locations, SMAP_DA and CPCU_SIM have comparable soil moisture skill improvements relative to CTRL for the unbiased root-mean-square error (surface and root-zone) and correlation metrics (root-zone only). In the global average, SMAP Tb assimilation increases the surface soil moisture anomaly correlation by 0.10-0.11 compared to an increase of 0.02-0.03 from the CPCU-based precipitation corrections. The contrast is particularly strong in central Australia, where CPCU is known to have errors and observation-minus-forecast Tb residuals are larger when CPCU precipitation is used. Validation versus streamflow measurements in the contiguous U.S. reveals that CPCU precipitation provides most of the skill gained in L4_SM runoff estimates over CTRL.


2010 ◽  
Vol 14 (11) ◽  
pp. 2177-2191 ◽  
Author(s):  
C. Albergel ◽  
J.-C. Calvet ◽  
P. de Rosnay ◽  
G. Balsamo ◽  
W. Wagner ◽  
...  

Abstract. The SMOSMANIA soil moisture network in Southwestern France is used to evaluate modelled and remotely sensed soil moisture products. The surface soil moisture (SSM) measured in situ at 5 cm permits to evaluate SSM from the SIM operational hydrometeorological model of Météo-France and to perform a cross-evaluation of the normalised SSM estimates derived from coarse-resolution (25 km) active microwave observations from the ASCAT scatterometer instrument (C-band, onboard METOP), issued by EUMETSAT and resampled to the Discrete Global Grid (DGG, 12.5 km gridspacing) by TU-Wien (Vienna University of Technology) over a two year period (2007–2008). A downscaled ASCAT product at one kilometre scale is evaluated as well, together with operational soil moisture products of two meteorological services, namely the ALADIN numerical weather prediction model (NWP) and the Integrated Forecasting System (IFS) analysis of Météo-France and ECMWF, respectively. In addition to the operational SSM analysis of ECMWF, a second analysis using a simplified extended Kalman filter and assimilating the ASCAT SSM estimates is tested. The ECMWF SSM estimates correlate better with the in situ observations than the Météo-France products. This may be due to the higher ability of the multi-layer land surface model used at ECMWF to represent the soil moisture profile. However, the SSM derived from SIM corresponds to a thin soil surface layer and presents good correlations with ASCAT SSM estimates for the very first centimetres of soil. At ECMWF, the use of a new data assimilation technique, which is able to use the ASCAT SSM, improves the SSM and the root-zone soil moisture analyses.


2015 ◽  
Vol 143 (9) ◽  
pp. 3804-3822 ◽  
Author(s):  
Zhijin Li ◽  
James C. McWilliams ◽  
Kayo Ide ◽  
John D. Farrara

Abstract A multiscale data assimilation (MS-DA) scheme is formulated for fine-resolution models. A decomposition of the cost function is derived for a set of distinct spatial scales. The decomposed cost function allows for the background error covariance to be estimated separately for the distinct spatial scales, and multi-decorrelation scales to be explicitly incorporated in the background error covariance. MS-DA minimizes the partitioned cost functions sequentially from large to small scales. The multi-decorrelation length scale background error covariance enhances the spreading of sparse observations and prevents fine structures in high-resolution observations from being overly smoothed. The decomposition of the cost function also provides an avenue for mitigating the effects of scale aliasing and representativeness errors that inherently exist in a multiscale system, thus further improving the effectiveness of the assimilation of high-resolution observations. A set of one-dimensional experiments is performed to examine the properties of the MS-DA scheme. Emphasis is placed on the assimilation of patchy high-resolution observations representing radar and satellite measurements, alongside sparse observations representing those from conventional in situ platforms. The results illustrate how MS-DA improves the effectiveness of the assimilation of both these types of observations simultaneously.


2021 ◽  
Vol 25 (3) ◽  
pp. 1569-1586
Author(s):  
Jianxiu Qiu ◽  
Jianzhi Dong ◽  
Wade T. Crow ◽  
Xiaohu Zhang ◽  
Rolf H. Reichle ◽  
...  

Abstract. The Soil Moisture Active Passive (SMAP) Level-4 (L4) product provides global estimates of surface soil moisture (SSM) and root-zone soil moisture (RZSM) via the assimilation of SMAP brightness temperature (Tb) observations into the NASA Catchment Land Surface Model (CLSM). Here, using in situ measurements from 2474 sites in China, we evaluate the performance of soil moisture estimates from the L4 data assimilation (DA) system and from a baseline “open-loop” (OL) simulation of CLSM without Tb assimilation. Using random forest regression, the efficiency of the L4 DA system (i.e., the performance improvement in DA relative to OL) is attributed to eight control factors related to the CLSM as well as τ–ω radiative transfer model (RTM) components of the L4 system. Results show that the Spearman rank correlation (R) for L4 SSM with in situ measurements increases for 77 % of the in situ measurement locations (relative to that of OL), with an average R increase of approximately 14 % (ΔR=0.056). RZSM skill is improved for about 74 % of the in situ measurement locations, but the average R increase for RZSM is only 7 % (ΔR=0.034). Results further show that the SSM DA skill improvement is most strongly related to the difference between the RTM-simulated Tb and the SMAP Tb observation, followed by the error in precipitation forcing data and estimated microwave soil roughness parameter h. For the RZSM DA skill improvement, these three dominant control factors remain the same, although the importance of soil roughness exceeds that of the Tb simulation error, as the soil roughness strongly affects the ingestion of DA increments and further propagation to the subsurface. For the skill of the L4 and OL estimates themselves, the top two control factors are the precipitation error and the SSM–RZSM coupling strength error, both of which are related to the CLSM component of the L4 system. Finally, we find that the L4 system can effectively filter out errors in precipitation. Therefore, future development of the L4 system should focus on improving the characterization of the SSM–RZSM coupling strength.


2017 ◽  
Vol 18 (10) ◽  
pp. 2621-2645 ◽  
Author(s):  
Rolf H. Reichle ◽  
Gabrielle J. M. De Lannoy ◽  
Qing Liu ◽  
Joseph V. Ardizzone ◽  
Andreas Colliander ◽  
...  

Abstract The Soil Moisture Active Passive (SMAP) mission Level-4 Surface and Root-Zone Soil Moisture (L4_SM) data product is generated by assimilating SMAP L-band brightness temperature observations into the NASA Catchment land surface model. The L4_SM product is available from 31 March 2015 to present (within 3 days from real time) and provides 3-hourly, global, 9-km resolution estimates of surface (0–5 cm) and root-zone (0–100 cm) soil moisture and land surface conditions. This study presents an overview of the L4_SM algorithm, validation approach, and product assessment versus in situ measurements. Core validation sites provide spatially averaged surface (root zone) soil moisture measurements for 43 (17) “reference pixels” at 9- and 36-km gridcell scales located in 17 (7) distinct watersheds. Sparse networks provide point-scale measurements of surface (root zone) soil moisture at 406 (311) locations. Core validation site results indicate that the L4_SM product meets its soil moisture accuracy requirement, specified as an unbiased RMSE (ubRMSE, or standard deviation of the error) of 0.04 m3 m−3 or better. The ubRMSE for L4_SM surface (root zone) soil moisture is 0.038 m3 m−3 (0.030 m3 m−3) at the 9-km scale and 0.035 m3 m−3 (0.026 m3 m−3) at the 36-km scale. The L4_SM estimates improve (significantly at the 5% level for surface soil moisture) over model-only estimates, which do not benefit from the assimilation of SMAP brightness temperature observations and have a 9-km surface (root zone) ubRMSE of 0.042 m3 m−3 (0.032 m3 m−3). Time series correlations exhibit similar relative performance. The sparse network results corroborate these findings over a greater variety of climate and land cover conditions.


2017 ◽  
Vol 53 (2) ◽  
pp. 1309-1335 ◽  
Author(s):  
Liao‐Fan Lin ◽  
Ardeshir M. Ebtehaj ◽  
Jingfeng Wang ◽  
Rafael L. Bras

2015 ◽  
Vol 12 (8) ◽  
pp. 7971-8004 ◽  
Author(s):  
C. Draper ◽  
R. Reichle

Abstract. Nine years of Advanced Microwave Scanning Radiometer – Earth Observing System (AMSR-E) soil moisture retrievals are assimilated into the Catchment land surface model at four locations in the US. The assimilation is evaluated using the unbiased Mean Square Error (ubMSE) relative to watershed-scale in situ observations, with the ubMSE separated into contributions from the subseasonal (SMshort), mean seasonal (SMseas) and inter-annual (SMlong) soil moisture dynamics. For near-surface soil moisture, the average ubMSE for Catchment without assimilation was (1.8 × 10−3 m3 m−3)2, of which 19 % was in SMlong, 26 % in SMseas, and 55 % in SMshort. The AMSR-E assimilation significantly reduced the total ubMSE at every site, with an average reduction of 33 %. Of this ubMSE reduction, 37 % occurred in SMlong, 24 % in SMseas, and 38 % in SMshort. For root-zone soil moisture, in situ observations were available at one site only, and the near-surface and root-zone results were very similar at this site. These results suggest that, in addition to the well-reported improvements in SMshort, assimilating a sufficiently long soil moisture data record can also improve the model representation of important long term events, such as droughts. The improved agreement between the modeled and in situ SMseas is harder to interpret, given that mean seasonal cycle errors are systematic, and systematic errors are not typically targeted by (bias-blind) data assimilation. Finally, the use of one year subsets of the AMSR-E and Catchment soil moisture for estimating the observation-bias correction (rescaling) parameters is investigated. It is concluded that when only one year of data is available, the associated uncertainty in the rescaling parameters should not greatly reduce the average benefit gained from data assimilation, but locally and in extreme years there is a risk of increased errors.


Sign in / Sign up

Export Citation Format

Share Document