Review of hess-2020-359, Using data assimilation to optimize pedotransfer functions using large-scale in-situ soil moisture observations by Cooper et al.

Abstract. Soil moisture predictions from land surface models are important in hydrological, ecological and meteorological applications. In recent years the availability of wide-area soil-moisture measurements has increased, but few studies have combined model-based soil moisture predictions with in-situ observations beyond the point scale. Here we show that we can markedly improve soil moisture estimates from the JULES land surface model using field scale observations and data assimilation techniques. Rather than directly updating soil moisture estimates towards observed values, we optimize constants in the underlying pedotransfer functions, which relate soil texture to JULES soil physics parameters. In this way we generate a single set of newly calibrated pedotransfer functions based on observations from a number of UK sites with different soil textures. We demonstrate that calibrating a pedotransfer function in this way can improve the performance of land surface models, leading to the potential for better flood, drought and climate projections.

Download Full-text

Using data assimilation to optimize pedotransfer functions using field-scale in situ soil moisture observations

Hydrology and Earth System Sciences ◽

10.5194/hess-25-2445-2021 ◽

2021 ◽

Vol 25 (5) ◽

pp. 2445-2458

Author(s):

Elizabeth Cooper ◽

Eleanor Blyth ◽

Hollie Cooper ◽

Rich Ellis ◽

Ewan Pinnington ◽

...

Keyword(s):

Soil Moisture ◽

Data Assimilation ◽

Land Surface ◽

Land Surface Model ◽

Pedotransfer Functions ◽

Surface Model ◽

Climate Projections ◽

Soil Physics ◽

Field Scale

Abstract. Soil moisture predictions from land surface models are important in hydrological, ecological, and meteorological applications. In recent years, the availability of wide-area soil moisture measurements has increased, but few studies have combined model-based soil moisture predictions with in situ observations beyond the point scale. Here we show that we can markedly improve soil moisture estimates from the Joint UK Land Environment Simulator (JULES) land surface model using field-scale observations and data assimilation techniques. Rather than directly updating soil moisture estimates towards observed values, we optimize constants in the underlying pedotransfer functions, which relate soil texture to JULES soil physics parameters. In this way, we generate a single set of newly calibrated pedotransfer functions based on observations from a number of UK sites with different soil textures. We demonstrate that calibrating a pedotransfer function in this way improves the soil moisture predictions of a land surface model at 16 UK sites, leading to the potential for better flood, drought, and climate projections.

Download Full-text

Mapping High Spatiotemporal-Resolution Soil Moisture by Upscaling Sparse Ground-Based Observations Using a Bayesian Linear Regression Method for Comparison with Microwave Remotely Sensed Soil Moisture Products

Remote Sensing ◽

10.3390/rs13020228 ◽

2021 ◽

Vol 13 (2) ◽

pp. 228

Author(s):

Jian Kang ◽

Rui Jin ◽

Xin Li ◽

Yang Zhang

Keyword(s):

Soil Moisture ◽

Large Scale ◽

Spatial Scales ◽

Microwave Remote Sensing ◽

In Situ Measurements ◽

Spatial Density ◽

Linear Regression Method ◽

Spatiotemporal Resolution ◽

Pixel Scale

In recent decades, microwave remote sensing (RS) has been used to measure soil moisture (SM). Long-term and large-scale RS SM datasets derived from various microwave sensors have been used in environmental fields. Understanding the accuracies of RS SM products is essential for their proper applications. However, due to the mismatched spatial scale between the ground-based and RS observations, the truth at the pixel scale may not be accurately represented by ground-based observations, especially when the spatial density of in situ measurements is low. Because ground-based observations are often sparsely distributed, temporal upscaling was adopted to transform a few in situ measurements into SM values at a pixel scale of 1 km by introducing the temperature vegetation dryness index (TVDI) related to SM. The upscaled SM showed high consistency with in situ SM observations and could accurately capture rainfall events. The upscaled SM was considered as the reference data to evaluate RS SM products at different spatial scales. In regard to the validation results, in addition to the correlation coefficient (R) of the Soil Moisture Active Passive (SMAP) SM being slightly lower than that of the Climate Change Initiative (CCI) SM, SMAP had the best performance in terms of the root-mean-square error (RMSE), unbiased RMSE and bias, followed by the CCI. The Soil Moisture and Ocean Salinity (SMOS) products were in worse agreement with the upscaled SM and were inferior to the R value of the X-band SM of the Advanced Microwave Scanning Radiometer 2 (AMSR2). In conclusion, in the study area, the SMAP and CCI SM are more reliable, although both products were underestimated by 0.060 cm3 cm−3 and 0.077 cm3 cm−3, respectively. If the biases are corrected, then the improved SMAP with an RMSE of 0.043 cm3 cm−3 and the CCI with an RMSE of 0.039 cm3 cm−3 will hopefully reach the application requirement for an accuracy with an RMSE less than 0.040 cm3 cm−3.

Download Full-text

Global soil moisture data derived through machine learning trained with in-situ measurements

Scientific Data ◽

10.1038/s41597-021-00964-1 ◽

2021 ◽

Vol 8 (1) ◽

Author(s):

Sungmin O. ◽

Rene Orth

Keyword(s):

Machine Learning ◽

Soil Moisture ◽

Large Scale ◽

Short Term Memory ◽

Temporal Dynamics ◽

Soil Moisture Data ◽

Wide Range ◽

Global Soil

AbstractWhile soil moisture information is essential for a wide range of hydrologic and climate applications, spatially-continuous soil moisture data is only available from satellite observations or model simulations. Here we present a global, long-term dataset of soil moisture derived through machine learning trained with in-situ measurements, SoMo.ml. We train a Long Short-Term Memory (LSTM) model to extrapolate daily soil moisture dynamics in space and in time, based on in-situ data collected from more than 1,000 stations across the globe. SoMo.ml provides multi-layer soil moisture data (0–10 cm, 10–30 cm, and 30–50 cm) at 0.25° spatial and daily temporal resolution over the period 2000–2019. The performance of the resulting dataset is evaluated through cross validation and inter-comparison with existing soil moisture datasets. SoMo.ml performs especially well in terms of temporal dynamics, making it particularly useful for applications requiring time-varying soil moisture, such as anomaly detection and memory analyses. SoMo.ml complements the existing suite of modelled and satellite-based datasets given its distinct derivation, to support large-scale hydrological, meteorological, and ecological analyses.

Download Full-text

Evaluating Machine Learning and Geostatistical Methods for Spatial Gap-filling of Monthly ESA CCI Soil Moisture in China

Remote Sensing ◽

10.3390/rs13142848 ◽

2021 ◽

Vol 13 (14) ◽

pp. 2848

Author(s):

Hao Sun ◽

Qian Xu

Keyword(s):

Machine Learning ◽

Soil Moisture ◽

Water Resource Management ◽

Large Scale ◽

Gap Filling ◽

Spatial Continuity ◽

Study Results ◽

Data Gaps

Obtaining large-scale, long-term, and spatial continuous soil moisture (SM) data is crucial for climate change, hydrology, and water resource management, etc. ESA CCI SM is such a large-scale and long-term SM (longer than 40 years until now). However, there exist data gaps, especially for the area of China, due to the limitations in remote sensing of SM such as complex topography, human-induced radio frequency interference (RFI), and vegetation disturbances, etc. The data gaps make the CCI SM data cannot achieve spatial continuity, which entails the study of gap-filling methods. In order to develop suitable methods to fill the gaps of CCI SM in the whole area of China, we compared typical Machine Learning (ML) methods, including Random Forest method (RF), Feedforward Neural Network method (FNN), and Generalized Linear Model (GLM) with a geostatistical method, i.e., Ordinary Kriging (OK) in this study. More than 30 years of passive–active combined CCI SM from 1982 to 2018 and other biophysical variables such as Normalized Difference Vegetation Index (NDVI), precipitation, air temperature, Digital Elevation Model (DEM), soil type, and in situ SM from International Soil Moisture Network (ISMN) were utilized in this study. Results indicated that: 1) the data gap of CCI SM is frequent in China, which is found not only in cold seasons and areas but also in warm seasons and areas. The ratio of gap pixel numbers to the whole pixel numbers can be greater than 80%, and its average is around 40%. 2) ML methods can fill the gaps of CCI SM all up. Among the ML methods, RF had the best performance in fitting the relationship between CCI SM and biophysical variables. 3) Over simulated gap areas, RF had a comparable performance with OK, and they outperformed the FNN and GLM methods greatly. 4) Over in situ SM networks, RF achieved better performance than the OK method. 5) We also explored various strategies for gap-filling CCI SM. Results demonstrated that the strategy of constructing a monthly model with one RF for simulating monthly average SM and another RF for simulating monthly SM disturbance achieved the best performance. Such strategy combining with the ML method such as the RF is suggested in this study for filling the gaps of CCI SM in China.

Download Full-text

Use of satellite and modeled soil moisture data for predicting event soil loss at plot scale

Hydrology and Earth System Sciences ◽

10.5194/hess-19-3845-2015 ◽

2015 ◽

Vol 19 (9) ◽

pp. 3845-3856 ◽

Cited By ~ 9

Author(s):

F. Todisco ◽

L. Brocca ◽

L. F. Termite ◽

W. Wagner

Keyword(s):

Soil Moisture ◽

Soil Loss ◽

Large Scale ◽

Central Italy ◽

Remote Sensing Data ◽

Loss Estimation ◽

Balance Model ◽

Estimation Accuracy ◽

Soil Losses

Abstract. The potential of coupling soil moisture and a Universal Soil Loss Equation-based (USLE-based) model for event soil loss estimation at plot scale is carefully investigated at the Masse area, in central Italy. The derived model, named Soil Moisture for Erosion (SM4E), is applied by considering the unavailability of in situ soil moisture measurements, by using the data predicted by a soil water balance model (SWBM) and derived from satellite sensors, i.e., the Advanced SCATterometer (ASCAT). The soil loss estimation accuracy is validated using in situ measurements in which event observations at plot scale are available for the period 2008–2013. The results showed that including soil moisture observations in the event rainfall–runoff erosivity factor of the USLE enhances the capability of the model to account for variations in event soil losses, the soil moisture being an effective alternative to the estimated runoff, in the prediction of the event soil loss at Masse. The agreement between observed and estimated soil losses (through SM4E) is fairly satisfactory with a determination coefficient (log-scale) equal to ~ 0.35 and a root mean square error (RMSE) of ~ 2.8 Mg ha−1. These results are particularly significant for the operational estimation of soil losses. Indeed, currently, soil moisture is a relatively simple measurement at the field scale and remote sensing data are also widely available on a global scale. Through satellite data, there is the potential of applying the SM4E model for large-scale monitoring and quantification of the soil erosion process.

Download Full-text

Data assimilation for volcanic ash plumes using a satellite observational operator: a case study on the 2010 Eyjafjallajökull volcanic eruption

Atmospheric Chemistry and Physics ◽

10.5194/acp-17-1187-2017 ◽

2017 ◽

Vol 17 (2) ◽

pp. 1187-1205 ◽

Cited By ~ 11

Author(s):

Guangliang Fu ◽

Fred Prata ◽

Hai Xiang Lin ◽

Arnold Heemink ◽

Arjo Segers ◽

...

Keyword(s):

Data Assimilation ◽

Volcanic Ash ◽

Three Dimensional ◽

Forecast Accuracy ◽

Improve Model ◽

Powerful Approach ◽

Using Data ◽

D Model

Abstract. Using data assimilation (DA) to improve model forecast accuracy is a powerful approach that requires available observations. Infrared satellite measurements of volcanic ash mass loadings are often used as input observations for the assimilation scheme. However, because these primary satellite-retrieved data are often two-dimensional (2-D) and the ash plume is usually vertically located in a narrow band, directly assimilating the 2-D ash mass loadings in a three-dimensional (3-D) volcanic ash model (with an integral observational operator) can usually introduce large artificial/spurious vertical correlations.In this study, we look at an approach to avoid the artificial vertical correlations by not involving the integral operator. By integrating available data of ash mass loadings and cloud top heights, as well as data-based assumptions on thickness, we propose a satellite observational operator (SOO) that translates satellite-retrieved 2-D volcanic ash mass loadings to 3-D concentrations. The 3-D SOO makes the analysis step of assimilation comparable in the 3-D model space.Ensemble-based DA is used to assimilate the extracted measurements of ash concentrations. The results show that satellite DA with SOO can improve the estimate of volcanic ash state and the forecast. Comparison with both satellite-retrieved data and aircraft in situ measurements shows that the effective duration of the improved volcanic ash forecasts for the distal part of the Eyjafjallajökull volcano is about 6 h.

Download Full-text

Spatial variability and its scale dependency of observed and modeled soil moisture over different climate regions

Hydrology and Earth System Sciences ◽

10.5194/hess-17-1177-2013 ◽

2013 ◽

Vol 17 (3) ◽

pp. 1177-1188 ◽

Cited By ~ 45

Author(s):

B. Li ◽

M. Rodell

Keyword(s):

Soil Moisture ◽

Spatial Variability ◽

Land Surface ◽

Large Scale ◽

Warm Season ◽

Scale Dependency ◽

Convex Shape ◽

Spatial Moments ◽

Environmental Controls

Abstract. Past studies on soil moisture spatial variability have been mainly conducted at catchment scales where soil moisture is often sampled over a short time period; as a result, the observed soil moisture often exhibited smaller dynamic ranges, which prevented the complete revelation of soil moisture spatial variability as a function of mean soil moisture. In this study, spatial statistics (mean, spatial variability and skewness) of in situ soil moisture, modeled and satellite-retrieved soil moisture obtained in a warm season (198 days) were examined over three large climate regions in the US. The study found that spatial moments of in situ measurements strongly depend on climates, with distinct mean, spatial variability and skewness observed in each climate zone. In addition, an upward convex shape, which was revealed in several smaller scale studies, was observed for the relationship between spatial variability of in situ soil moisture and its spatial mean when statistics from dry, intermediate, and wet climates were combined. This upward convex shape was vaguely or partially observable in modeled and satellite-retrieved soil moisture estimates due to their smaller dynamic ranges. Despite different environmental controls on large-scale soil moisture spatial variability, the correlation between spatial variability and mean soil moisture remained similar to that observed at small scales, which is attributed to the boundedness of soil moisture. From the smaller support (effective area or volume represented by a measurement or estimate) to larger ones, soil moisture spatial variability decreased in each climate region. The scale dependency of spatial variability all followed the power law, but data with large supports showed stronger scale dependency than those with smaller supports. The scale dependency of soil moisture variability also varied with climates, which may be linked to the scale dependency of precipitation spatial variability. Influences of environmental controls on soil moisture spatial variability at large scales are discussed. The results of this study should be useful for diagnosing large scale soil moisture estimates and for improving the estimation of land surface processes.

Download Full-text