scholarly journals Generating seamless global daily AMSR2 soil moisture (SGD-SM) long-term products for the years 2013–2019

2021 ◽  
Vol 13 (3) ◽  
pp. 1385-1401
Author(s):  
Qiang Zhang ◽  
Qiangqiang Yuan ◽  
Jie Li ◽  
Yuan Wang ◽  
Fujun Sun ◽  
...  
Keyword(s):  
Time Series ◽  
Soil Moisture ◽  
Spatial Information ◽  
Mean Squared Error ◽  
Spatial Continuity ◽  
Coverage Ratio ◽  
Original Dataset ◽  
Verification Methods

Abstract. High-quality and long-term soil moisture products are significant for hydrologic monitoring and agricultural management. However, the acquired daily Advanced Microwave Scanning Radiometer 2 (AMSR2) soil moisture products are incomplete in global land (just about 30 %–80 % coverage ratio), due to the satellite orbit coverage and the limitations of soil moisture retrieval algorithms. To solve this inevitable problem, we develop a novel spatio-temporal partial convolutional neural network (CNN) for AMSR2 soil moisture product gap-filling. Through the proposed framework, we generate the seamless daily global (SGD) AMSR2 long-term soil moisture products from 2013 to 2019. To further validate the effectiveness of these products, three verification methods are used as follows: (1) in situ validation, (2) time-series validation, and (3) simulated missing-region validation. Results show that the seamless global daily soil moisture products have reliable cooperativity with the selected in situ values. The evaluation indexes of the reconstructed (original) dataset are a correlation coefficient (R) of 0.685 (0.689), root-mean-squared error (RMSE) of 0.097 (0.093), and mean absolute error (MAE) of 0.079 (0.077). The temporal consistency of the reconstructed daily soil moisture products is ensured with the original time-series distribution of valid values. The spatial continuity of the reconstructed regions is in accordance with the spatial information (R: 0.963–0.974, RMSE: 0.065–0.073, and MAE: 0.044–0.052). This dataset can be downloaded at https://doi.org/10.5281/zenodo.4417458 (Zhang et al., 2021).

scholarly journals SGD-SM: Generating Seamless Global Daily AMSR2 Soil Moisture Long-term Productions (2013–2019)

2020 ◽  
Author(s):  
Qiang Zhang ◽  
Qiangqiang Yuan ◽  
Jie Li ◽  
Yuan Wang ◽  
Fujun Sun ◽  
...  
Keyword(s):  
Time Series ◽  
Soil Moisture ◽  
Satellite Orbit ◽  
Temporal Consistency ◽  
Spatial Continuity ◽  
Coverage Ratio ◽  
Original Dataset ◽  
Original Time

Abstract. High quality and long-term soil moisture productions are significant for hydrologic monitoring and agricultural management. However, the acquired daily soil moisture productions are incomplete in global land (just about 30 %∼80 % coverage ratio), due to the satellite orbit coverage and the limitations of soil moisture retrieving algorithms. To solve this inevitable problem, we develop a novel 3D spatio-temporal partial convolutional neural network (CNN) for Advanced Microwave Scanning Radiometer 2 (AMSR2) soil moisture productions gap-filling. Through the proposed framework, we generate the seamless global daily (SGD) AMSR2 soil moisture long-term productions from 2013 to 2019. To further validate the effectiveness of these productions, three verification ways are employed as follow: 1) In-situ validation; 2) Time-series validation; And 3) simulated missing regions validation. Results show that the seamless global daily soil moisture productions have reliable cooperativity with the selected in-situ values. The evaluation indexes of the reconstructed (original) dataset are R: 0.683 (0.687), RMSE: 0.099 m3/m3 (0.095 m3/m3), and MAE: 0.081 m3/m3 (0.078 m3/m3), respectively. Temporal consistency of the reconstructed daily soil moisture productions is ensured with the original time-series distribution of valid values. Besides, the spatial continuity of the reconstructed regions is also accorded with the context information (R: 0.963∼0.974, RMSE: 0.065∼0.073 m3/m3, and MAE: 0.044∼0.052 m3/m3). More details of this work are released at https://qzhang95.github.io/Projects/Global-Daily-Seamless-AMSR2/. This dataset can be downloaded at https://zenodo.org/record/3960425 (Zhang et al., 2020. DOI:https://doi.org/10.5281/zenodo.3960425).

scholarly journals Evaluating Machine Learning and Geostatistical Methods for Spatial Gap-filling of Monthly ESA CCI Soil Moisture in China

2021 ◽  
Vol 13 (14) ◽  
pp. 2848
Author(s):  
Hao Sun ◽  
Qian Xu
Keyword(s):  
Machine Learning ◽  
Soil Moisture ◽  
Water Resource Management ◽  
Large Scale ◽  
Gap Filling ◽  
Spatial Continuity ◽  
Study Results ◽  
Data Gaps

Obtaining large-scale, long-term, and spatial continuous soil moisture (SM) data is crucial for climate change, hydrology, and water resource management, etc. ESA CCI SM is such a large-scale and long-term SM (longer than 40 years until now). However, there exist data gaps, especially for the area of China, due to the limitations in remote sensing of SM such as complex topography, human-induced radio frequency interference (RFI), and vegetation disturbances, etc. The data gaps make the CCI SM data cannot achieve spatial continuity, which entails the study of gap-filling methods. In order to develop suitable methods to fill the gaps of CCI SM in the whole area of China, we compared typical Machine Learning (ML) methods, including Random Forest method (RF), Feedforward Neural Network method (FNN), and Generalized Linear Model (GLM) with a geostatistical method, i.e., Ordinary Kriging (OK) in this study. More than 30 years of passive–active combined CCI SM from 1982 to 2018 and other biophysical variables such as Normalized Difference Vegetation Index (NDVI), precipitation, air temperature, Digital Elevation Model (DEM), soil type, and in situ SM from International Soil Moisture Network (ISMN) were utilized in this study. Results indicated that: 1) the data gap of CCI SM is frequent in China, which is found not only in cold seasons and areas but also in warm seasons and areas. The ratio of gap pixel numbers to the whole pixel numbers can be greater than 80%, and its average is around 40%. 2) ML methods can fill the gaps of CCI SM all up. Among the ML methods, RF had the best performance in fitting the relationship between CCI SM and biophysical variables. 3) Over simulated gap areas, RF had a comparable performance with OK, and they outperformed the FNN and GLM methods greatly. 4) Over in situ SM networks, RF achieved better performance than the OK method. 5) We also explored various strategies for gap-filling CCI SM. Results demonstrated that the strategy of constructing a monthly model with one RF for simulating monthly average SM and another RF for simulating monthly SM disturbance achieved the best performance. Such strategy combining with the ML method such as the RF is suggested in this study for filling the gaps of CCI SM in China.

scholarly journals Global soil moisture data derived through machine learning trained with in-situ measurements

2021 ◽  
Vol 8 (1) ◽  
Author(s):  
Sungmin O. ◽  
Rene Orth
Keyword(s):  
Machine Learning ◽  
Soil Moisture ◽  
Large Scale ◽  
Short Term Memory ◽  
Temporal Dynamics ◽  
Soil Moisture Data ◽  
Wide Range ◽  
Global Soil

AbstractWhile soil moisture information is essential for a wide range of hydrologic and climate applications, spatially-continuous soil moisture data is only available from satellite observations or model simulations. Here we present a global, long-term dataset of soil moisture derived through machine learning trained with in-situ measurements, SoMo.ml. We train a Long Short-Term Memory (LSTM) model to extrapolate daily soil moisture dynamics in space and in time, based on in-situ data collected from more than 1,000 stations across the globe. SoMo.ml provides multi-layer soil moisture data (0–10 cm, 10–30 cm, and 30–50 cm) at 0.25° spatial and daily temporal resolution over the period 2000–2019. The performance of the resulting dataset is evaluated through cross validation and inter-comparison with existing soil moisture datasets. SoMo.ml performs especially well in terms of temporal dynamics, making it particularly useful for applications requiring time-varying soil moisture, such as anomaly detection and memory analyses. SoMo.ml complements the existing suite of modelled and satellite-based datasets given its distinct derivation, to support large-scale hydrological, meteorological, and ecological analyses.

scholarly journals Mediterranean Sea climatic indices: monitoring long term variability and climate changes

2018 ◽  
Author(s):  
Athanasia Iona ◽  
Athanasios Theodorou ◽  
Sarantis Sofianos ◽  
Sylvain Watelet ◽  
Charles Troupin ◽  
...  
Keyword(s):  
Climate Change ◽  
Time Series ◽  
Mediterranean Sea ◽  
Climate Changes ◽  
Salt Content ◽  
Climatic Indices ◽  
In Situ Observations ◽  
The Mediterranean

Abstract. We present a new product composed of a set of thermohaline climatic indices from 1950 to 2015 for the Mediterranean Sea such as decadal temperature and salinity anomalies, their mean values over selected depths, decadal ocean heat and salt content anomalies at selected depth layers as well as their long times series. It is produced from a new high-resolution climatology of temperature and salinity on a 1/8° regular grid based on historical high quality in situ observations. Ocean heat and salt content differences between 1980–2015 and 1950–1979 are compared for evaluation of the climate shift in the Mediterranean Sea. The spatial patterns of heat and salt content shifts demonstrate in greater detail than ever before that the climate changes differently in the several regions of the basin. Long time series of heat and salt content for the period 1950 to 2015 are also provided which indicate that in the Mediterranean Sea there is a net mean volume warming and salting since 1950 with acceleration during the last two decades. The time series also show that the ocean heat content seems to fluctuate on a cycle of about 40 years and seems to follow the Atlantic Multidecadal Oscillation climate cycle indicating that the natural large scale atmospheric variability could be superimposed on to the warming trend. This product is an observations-based estimation of the Mediterranean climatic indices. It relies solely on spatially interpolated data produced from in-situ observations averaged over decades in order to smooth the decadal variability and reveal the long term trends with more accuracy. It can provide a valuable contribution to the modellers' community, next to the satellite-based products and serve as a baseline for the evaluation of climate-change model simulations contributing thus to a better understanding of the complex response of the Mediterranean Sea to the ongoing global climate change. The product is available here: https://doi.org/10.5281/zenodo.1210100.

scholarly journals Towards a long-term dataset of ELBARA-II measurements assisting SMOS level-3 land product and algorithm validation at the Valencia Anchor Station

2015 ◽  
pp. 55
Author(s):  
R. Fernandez Moran ◽  
J. P. Wigneron ◽  
E. Lopez-Baeza ◽  
M. Miernecki ◽  
P. Salgado-Hernanz ◽  
...  
Keyword(s):  
Soil Moisture ◽  
Anchor Station ◽  
Ocean Salinity ◽  
Algorithm Validation ◽  
Level 3

La misión de SMOS (Soil Moisture and Ocean Salinity) se lanzó el 2 de Noviembre de 2009 con el objetivo de proporcionar datos de humedad del suelo y salinidad del mar. La principal actividad de la conocida como Valencia Anchor Station (VAS) es asistir en la validación a largo plazo de productos de suelo de SMOS. El presente estudio se centra en una validación de datos de nivel 3 de SMOS en la VAS con medidas in situ tomadas en el periodo 2010-2012. El radiómetro Elbara-II está situado dentro de los confines de la VAS, observando un campo de viñedos que se considera representativo de una gran proporción de un área de 50×50 km, suficiente para cubrir un footprint de SMOS. Las temperaturas de brillo (TB) adquiridas por ELBARA-II se compararon con las observadas por SMOS en las mismas fechas y horas. También se utilizó la inversión del modelo L-MEB con el fin de obtener humedades de suelo (SM) que, posteriormente, se compararon con datos de nivel 3 de SMOS. Se ha encontrado una buena correlación entre ambas series de TB, con mejoras año tras año, achacable fundamentalmente a la disminución de precipitaciones en el periodo objeto de estudio y a la mitigación de las interferencias por radiofrecuencia en banda L. La mayor homogeneidad del footprint del radiómetro ELBARA-II frente al de SMOS explica la mayor variabilidad de sus TB. Los periodos de precipitación más intensa (primavera y otoño) también son de mayor SM, lo que corrobora la consistencia de los resultados de SM simulados a través de las observaciones del radiómetro. Sin embargo, se debe resaltar una subestimación por parte de SMOS de los valores de SM respecto a los obtenidos por ELBARA-II, presumiblemente debido a la influencia que la pequeña fracción de suelo no destinado al cultivo de la vid tiene sobre SMOS. Las estimaciones por parte de SMOS en órbita descendente (6 p.m.) resultaron de mayor calidad (mayor correlación y menores RMSE y bias) que en órbita ascendente (6 a.m., momento de mayor humedad de suelo).

scholarly journals Evaluation of Seven Atmospheric Profiles from Reanalysis and Satellite-Derived Products: Implication for Single-Channel Land Surface Temperature Retrieval

2020 ◽  
Vol 12 (5) ◽  
pp. 791 ◽  
Author(s):  
Jingjing Yang ◽  
Si-Bo Duan ◽  
Xiaoyu Zhang ◽  
Penghai Wu ◽  
Cheng Huang ◽  
...  
Keyword(s):  
Time Series ◽  
Surface Temperature ◽  
Land Surface Temperature ◽  
Land Surface ◽  
Single Channel ◽  
Landsat 8 ◽  
Atmospheric Profiles ◽  
Atmospheric Profile

Land surface temperature (LST) is vital for studies of hydrology, ecology, climatology, and environmental monitoring. The radiative-transfer-equation-based single-channel algorithm, in conjunction with the atmospheric profile, is regarded as the most suitable one with which to produce long-term time series LST products from Landsat thermal infrared (TIR) data. In this study, the performances of seven atmospheric profiles from different sources (the MODerate-resolution Imaging Spectroradiomete atmospheric profile product (MYD07), the Atmospheric Infrared Sounder atmospheric profile product (AIRS), the European Centre for Medium-range Weather Forecasts (ECMWF), the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA2), the National Centers for Environmental Prediction (NCEP)/Global Forecasting System (GFS), NCEP/Final Operational Global Analysis (FNL), and NCEP/Department of Energy (DOE)) were comprehensively evaluated in the single-channel algorithm for LST retrieval from Landsat 8 TIR data. Results showed that when compared with the radio sounding profile downloaded from the University of Wyoming (UWYO), the worst accuracies of atmospheric parameters were obtained for the MYD07 profile. Furthermore, the root-mean-square error (RMSE) values (approximately 0.5 K) of the retrieved LST when using the ECMWF, MERRA2, NCEP/GFS, and NCEP/FNL profiles were smaller than those but greater than 0.8 K when the MYD07, AIRS, and NCEP/DOE profiles were used. Compared with the in situ LST measurements that were collected at the Hailar, Urad Front Banner, and Wuhai sites, the RMSE values of the LST that were retrieved by using the ECMWF, MERRA2, NCEP/GFS, and NCEP/FNL profiles were approximately 1.0 K. The largest discrepancy between the retrieved and in situ LST was obtained for the NCEP/DOE profile, with an RMSE value of approximately 1.5 K. The results reveal that the ECMWF, MERRA2, NCEP/GFS, and NCEP/FNL profiles have great potential to perform accurate atmospheric correction and generate long-term time series LST products from Landsat TIR data by using a single-channel algorithm.

scholarly journals Novel FTLRNN with Gamma Memory for Short-Term and Long-Term Predictions of Chaotic Time Series

2009 ◽  
Vol 2009 ◽  
pp. 1-21
Author(s):  
Sanjay L. Badjate ◽  
Sanjay V. Dudul
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Mean Squared Error ◽  
Chaotic Time Series ◽  
Nonstationary Time Series ◽  
Medium Term ◽  
Short Term ◽  
Squared Error ◽  
Wide Range

Multistep ahead prediction of a chaotic time series is a difficult task that has attracted increasing interest in the recent years. The interest in this work is the development of nonlinear neural network models for the purpose of building multistep chaotic time series prediction. In the literature there is a wide range of different approaches but their success depends on the predicting performance of the individual methods. Also the most popular neural models are based on the statistical and traditional feed forward neural networks. But it is seen that this kind of neural model may present some disadvantages when long-term prediction is required. In this paper focused time-lagged recurrent neural network (FTLRNN) model with gamma memory is developed for different prediction horizons. It is observed that this predictor performs remarkably well for short-term predictions as well as medium-term predictions. For coupled partial differential equations generated chaotic time series such as Mackey Glass and Duffing, FTLRNN-based predictor performs consistently well for different depths of predictions ranging from short term to long term, with only slight deterioration after k is increased beyond 50. For real-world highly complex and nonstationary time series like Sunspots and Laser, though the proposed predictor does perform reasonably for short term and medium-term predictions, its prediction ability drops for long term ahead prediction. However, still this is the best possible prediction results considering the facts that these are nonstationary time series. As a matter of fact, no other NN configuration can match the performance of FTLRNN model. The authors experimented the performance of this FTLRNN model on predicting the dynamic behavior of typical Chaotic Mackey-Glass time series, Duffing time series, and two real-time chaotic time series such as monthly sunspots and laser. Static multi layer perceptron (MLP) model is also attempted and compared against the proposed model on the performance measures like mean squared error (MSE), Normalized mean squared error (NMSE), and Correlation Coefficient (r). The standard back-propagation algorithm with momentum term has been used for both the models.

scholarly journals Comparison of in situ time-series of temperature with gridded sea surface temperature datasets in the North Atlantic

2009 ◽  
Vol 66 (7) ◽  
pp. 1467-1479 ◽  
Author(s):  
Sarah L. Hughes ◽  
N. Penny Holliday ◽  
Eugene Colbourne ◽  
Vladimir Ozhigin ◽  
Hedinn Valdimarsson ◽  
...  
Keyword(s):  
Time Series ◽  
Surface Temperature ◽  
Sea Surface Temperature ◽  
North Atlantic ◽  
Sea Surface ◽  
The North ◽  
Spatial Coverage ◽  
The North Atlantic

Abstract Hughes, S. L., Holliday, N. P., Colbourne, E., Ozhigin, V., Valdimarsson, H., Østerhus, S., and Wiltshire, K. 2009. Comparison of in situ time-series of temperature with gridded sea surface temperature datasets in the North Atlantic. – ICES Journal of Marine Science, 66: 1467–1479. Analysis of the effects of climate variability and climate change on the marine ecosystem is difficult in regions where long-term observations of ocean temperature are sparse or unavailable. Gridded sea surface temperature (SST) products, based on a combination of satellite and in situ observations, can be used to examine variability and long-term trends because they provide better spatial coverage than the limited sets of long in situ time-series. SST data from three gridded products (Reynolds/NCEP OISST.v2., Reynolds ERSST.v3, and the Hadley Centre HadISST1) are compared with long time-series of in situ measurements from ICES standard sections in the North Atlantic and Nordic Seas. The variability and trends derived from the two data sources are examined, and the usefulness of the products as a proxy for subsurface conditions is discussed.

Towards a long term global snow climate data record from satellite data generated within the Snow Climate Change Initiative

2020 ◽  
Author(s):  
Gabriele Schwaizer ◽  
Lars Keuris ◽  
Thomas Nagler ◽  
Chris Derksen ◽  
Kari Luojus ◽  
...  
Keyword(s):  
Time Series ◽  
Satellite Data ◽  
Snow Water Equivalent ◽  
Climate Model ◽  
Process Models ◽  
Climate Data ◽  
Seasonal Snow ◽  
Snow Water

<p>Seasonal snow is an important component of the global climate system. It is highly variable in space and time and sensitive to short term synoptic scale processes and long term climate-induced changes of temperature and precipitation. Current snow products derived from various satellite data applying different algorithms show significant discrepancies in extent and snow mass, a potential source for biases in climate monitoring and modelling. The recently launched ESA CCI+ Programme addresses seasonal snow as one of 9 Essential Climate Variables to be derived from satellite data.</p><p>In the snow_cci project, scheduled for 2018 to 2021 in its first phase, reliable fully validated processing lines are developed and implemented. These tools are used to generate homogeneous multi-sensor time series for the main parameters of global snow cover focusing on snow extent and snow water equivalent. Using GCOS guidelines, the requirements for these parameters are assessed and consolidated using the outcome of workshops and questionnaires addressing users dealing with different climate applications. Snow extent product generation applies algorithms accounting for fractional snow extent and cloud screening in order to generate consistent daily products for snow on the surface (viewable snow) and snow on the surface corrected for forest masking (snow on ground) with global coverage. Input data are medium resolution optical satellite images (AVHRR-2/3, AATSR, MODIS, VIIRS, SLSTR/OLCI) from 1981 to present. An iterative development cycle is applied including homogenisation of the snow extent products from different sensors by minimizing the bias. Independent validation of the snow products is performed for different seasons and climate zones around the globe from 1985 onwards, using as reference high resolution snow maps from Landsat and Sentinel- 2as well as in-situ snow data following standardized validation protocols.</p><p>Global time series of daily snow water equivalent (SWE) products are generated from passive microwave data from SMMR, SSM/I, and AMSR from 1978 onwards, combined with in-situ snow depth measurements. Long-term stability and quality of the product is assessed using independent snow survey data and by intercomparison with the snow information from global land process models.</p><p>The usability of the snow_cci products is ensured through the Climate Research Group, which performs case studies related to long term trends of seasonal snow, performs evaluations of CMIP-6 and other snow-focused climate model experiments, and applies the data for simulation of Arctic hydrological regimes.</p><p>In this presentation, we summarize the requirements and product specifications for the snow extent and SWE products, with a focus on climate applications. We present an overview of the algorithms and systems for generation of the time series. The 40 years (from 1980 onwards) time series of daily fractional snow extent products from AVHRR with 5 km pixel spacing, and the 20-year time series from MODIS (1 km pixel spacing) as well as the coarse resolution (25 km pixel spacing) of daily SWE products from 1978 onwards will be presented along with first results of the multi-sensor consistency checks and validation activities.</p>

Sign in / Sign up

Export Citation Format

Share Document