scholarly journals Cosmic-Ray neutron Sensor PYthon tool (crspy 1.2.1): an open-source tool for the processing of cosmic-ray neutron and soil moisture data

2021 ◽  
Vol 14 (12) ◽  
pp. 7287-7307
Author(s):  
Daniel Power ◽  
Miguel Angel Rico-Ramirez ◽  
Sharon Desilets ◽  
Darin Desilets ◽  
Rafael Rosolem

Abstract. Understanding soil moisture dynamics at the sub-kilometre scale is increasingly important, especially with the continuous development of hyper-resolution land surface and hydrological models. Cosmic-ray neutron sensors (CRNSs) are able to provide estimates of soil moisture at this elusive scale, and networks of these sensors have been expanding across the world over the previous decade. However, each network currently implements its own protocol when processing raw data into soil moisture estimates. As a consequence, this lack of a harmonised global data set can ultimately lead to limitations in the global assessment of the CRNS technology from multiple networks. Here, we present crspy, an open-source Python tool that is designed to facilitate the processing of raw CRNS data into soil moisture estimates in an easy and harmonised way. We outline the basic structure of this tool, discussing the correction methods used as well as the metadata that crspy can create about each site. Metadata can add value to global-scale studies of field-scale soil moisture estimates by providing additional routes to understanding catchment similarities and differences. We demonstrate that current differences in processing methodologies can lead to misinterpretations when comparing sites from different networks and that having a tool to provide a harmonised data set can help to mitigate these issues. By being open source, crspy can also serve as a development and testing tool for new understanding of the CRNS technology as well as being used as a teaching tool for the community.

2021 ◽  
Author(s):  
Daniel Power ◽  
Miguel Angel Rico-Ramirez ◽  
Sharon Desilets ◽  
Darin Desilets ◽  
Rafael Rosolem

Abstract. Understanding soil moisture dynamics at the sub-kilometre scale is increasingly important especially with continuous development of hyper-resolution land-surface and hydrological models. Cosmic Ray Neutron Sensors (CRNS) are able to provide estimates of soil moisture at this elusive scale and networks of these sensors have been expanding across the world over the previous decade. However, each network currently implements its own protocol when processing raw data into soil moisture estimates. As a consequence, this lack of a harmonized global dataset can ultimately lead to limitations in the global assessment of the CRNS technology from multiple networks. Here we present crspy, an open-source python tool that is designed to facilitate the processing of raw CRNS data into soil moisture estimates in an easy and harmonized way. We outline the basic structure of this tool discussing the correction methods used as well as discussing the metadata that crspy can create about each site. Metadata can add value to global scale studies of field scale soil moisture estimates by providing additional routes to understanding catchment similarities and differences. We demonstrate that current differences in processing methodologies can lead to misinterpretations when comparing sites from different networks and having a tool to provide a harmonized dataset can help to mitigate these issues. By being open source, crspy can also serve as a development and testing tool for new understanding of the CRNS technology as well as being used as a teaching tool for the community.


2017 ◽  
Author(s):  
David McJannet ◽  
Aaron Hawdon ◽  
Brett Baker ◽  
Luigi Renzullo ◽  
Ross Searle

Abstract. Soil moisture plays a critical role in land surface processes and as such there has been a recent increase in the number and resolution of satellite soil moisture observations and development of land surface process models with ever increasing resolution. Despite these developments, validation and calibration of these products has been limited because of a lack of observations at corresponding scales. A recently developed mobile soil moisture monitoring platform, known as the rover, offers opportunities to overcome this scale issue. This paper describes a research project aimed at producing soil moisture estimates at a range of scales that are commensurate with model and satellite retrievals. Our investigation involved static cosmic ray neutron sensors and rover surveys across both broad (36 × 36 km at 9 km resolution) and intensive (10 × 10 km at 1 km resolution) scales in a cropping district in the Mallee region of Victoria, Australia. We describe approaches for converting rover survey neutron counts to soil moisture and discuss the factors controlling soil moisture variability. Measurements revealed that temporal patterns in soil moisture were preserved through time and regression modelling approaches were utilised to produce time series of property scale soil moisture which may also have application in calibration and validation studies or local farm management. Intensive scale rover surveys produced reliable soil moisture estimates at 1 km resolution while broad scale surveys produced soil moisture estimates at 9 km resolution. We conclude that the multiscale soil moisture products produced in this study are well suited to future analysis of satellite soil moisture retrievals and finer scale soil moisture models.


2017 ◽  
Vol 21 (12) ◽  
pp. 6049-6067 ◽  
Author(s):  
David McJannet ◽  
Aaron Hawdon ◽  
Brett Baker ◽  
Luigi Renzullo ◽  
Ross Searle

Abstract. Soil moisture plays a critical role in land surface processes and as such there has been a recent increase in the number and resolution of satellite soil moisture observations and the development of land surface process models with ever increasing resolution. Despite these developments, validation and calibration of these products has been limited because of a lack of observations on corresponding scales. A recently developed mobile soil moisture monitoring platform, known as the rover, offers opportunities to overcome this scale issue. This paper describes methods, results and testing of soil moisture estimates produced using rover surveys on a range of scales that are commensurate with model and satellite retrievals. Our investigation involved static cosmic-ray neutron sensors and rover surveys across both broad (36 × 36 km at 9 km resolution) and intensive (10 × 10 km at 1 km resolution) scales in a cropping district in the Mallee region of Victoria, Australia. We describe approaches for converting rover survey neutron counts to soil moisture and discuss the factors controlling soil moisture variability. We use independent gravimetric and modelled soil moisture estimates collected across both space and time to validate rover soil moisture products. Measurements revealed that temporal patterns in soil moisture were preserved through time and regression modelling approaches were utilised to produce time series of property-scale soil moisture which may also have applications in calibration and validation studies or local farm management. Intensive-scale rover surveys produced reliable soil moisture estimates at 1 km resolution while broad-scale surveys produced soil moisture estimates at 9 km resolution. We conclude that the multiscale soil moisture products produced in this study are well suited to future analysis of satellite soil moisture retrievals and finer-scale soil moisture models.


2017 ◽  
Vol 21 (10) ◽  
pp. 5009-5030 ◽  
Author(s):  
Martin Schrön ◽  
Markus Köhli ◽  
Lena Scheiffele ◽  
Joost Iwema ◽  
Heye R. Bogena ◽  
...  

Abstract. In the last few years the method of cosmic-ray neutron sensing (CRNS) has gained popularity among hydrologists, physicists, and land-surface modelers. The sensor provides continuous soil moisture data, averaged over several hectares and tens of decimeters in depth. However, the signal still may contain unidentified features of hydrological processes, and many calibration datasets are often required in order to find reliable relations between neutron intensity and water dynamics. Recent insights into environmental neutrons accurately described the spatial sensitivity of the sensor and thus allowed one to quantify the contribution of individual sample locations to the CRNS signal. Consequently, data points of calibration and validation datasets are suggested to be averaged using a more physically based weighting approach. In this work, a revised sensitivity function is used to calculate weighted averages of point data. The function is different from the simple exponential convention by the extraordinary sensitivity to the first few meters around the probe, and by dependencies on air pressure, air humidity, soil moisture, and vegetation. The approach is extensively tested at six distinct monitoring sites: two sites with multiple calibration datasets and four sites with continuous time series datasets. In all cases, the revised averaging method improved the performance of the CRNS products. The revised approach further helped to reveal hidden hydrological processes which otherwise remained unexplained in the data or were lost in the process of overcalibration. The presented weighting approach increases the overall accuracy of CRNS products and will have an impact on all their applications in agriculture, hydrology, and modeling.


2018 ◽  
Vol 114 (7/8) ◽  
Author(s):  
Thigesh Vather ◽  
Colin Everson ◽  
Michael Mengistu ◽  
Trenton Franz

Soil moisture is an important hydrological parameter, which is essential for a variety of applications, thereby extending to numerous disciplines. Currently, there are three methods of estimating soil moisture: ground-based (in-situ) measurements; remote sensing based methods and land surface models. In recent years, the cosmic ray probe (CRP), which is an in-situ technique, has been implemented in several countries across the globe. The CRP provides area-averaged soil moisture at an intermediate scale and thus bridges the gap between in-situ point measurements and global satellite-based soil moisture estimates. The aim of this study was to test the suitability of the CRP to provide spatial estimates of soil moisture. The CRP was set up and calibrated in Cathedral Peak Catchment VI. An in-situ soil moisture network consisting of time-domain reflectometry and Echo probes was created in Catchment VI, and was used to validate the CRP soil moisture estimates. Once calibrated, the CRP was found to provide spatial estimates of soil moisture, which correlated well with the in-situ soil moisture network data set and yielded an R2 value of 0.845. The use of the CRP for soil moisture monitoring provided reliable, accurate and continuous soil moisture estimates over the catchment area. The wealth of current and potential applications makes the CRP very appealing for scientists and engineers in various fields. Significance: • The cosmic ray probe provides spatial estimates of surface soil moisture at an intermediate scale of 18 hectares. • A single cosmic ray probe can replace a network of conventional in-situ instruments to provide reliable soil moisture estimates. • The cosmic ray probe is capable of estimating soil moisture in previously problematic areas (saline soil, wetlands, rocky soil). • Cosmic ray probes can provide data for hydro-meteorologists interested in land–atmosphere interactions. • The cosmic ray probe estimates can be promising for remote sensing scientists for product calibration and validation.


2015 ◽  
Vol 8 (8) ◽  
pp. 7395-7444 ◽  
Author(s):  
X. Han ◽  
X. Li ◽  
G. He ◽  
P. Kumbhar ◽  
C. Montzka ◽  
...  

Abstract. Data assimilation has become a popular method to integrate observations from multiple sources with land surface models to improve predictions of the water and energy cycles of the soil-vegetation-atmosphere continuum. Multivariate data assimilation refers to the simultaneous assimilation of observation data from multiple model state variables into a simulation model. In recent years, several land data assimilation systems have been developed in different research agencies. Because of the software availability or adaptability, these systems are not easy to apply for the purpose of multivariate land data assimilation research. We developed an open source multivariate land data assimilation framework (DasPy) which is implemented using the Python script language mixed with the C++ and Fortran programming languages. LETKF (Local Ensemble Transform Kalman Filter) is implemented as the main data assimilation algorithm, and uncertainties in the data assimilation can be introduced by perturbed atmospheric forcing data, and represented by perturbed soil and vegetation parameters and model initial conditions. The Community Land Model (CLM) was integrated as the model operator. The implementation allows also parameter estimation (soil properties and/or leaf area index) on the basis of the joint state and parameter estimation approach. The Community Microwave Emission Modelling platform (CMEM), COsmic-ray Soil Moisture Interaction Code (COSMIC) and the Two-Source Formulation (TSF) were integrated as observation operators for the assimilation of L-band passive microwave, cosmic-ray soil moisture probe and land surface temperature measurements, respectively. DasPy has been evaluated in several assimilation studies of neutron count intensity (soil moisture), L-band brightness temperature and land surface temperature. DasPy is parallelized using the hybrid Message Passing Interface and Open Multi-Processing techniques. All the input and output data flows are organized efficiently using the commonly used NetCDF file format. Online 1-D and 2-D visualization of data assimilation results is also implemented to facilitate the post simulation analysis. In summary, DasPy is a ready to use open source parallel multivariate land data assimilation framework.


2013 ◽  
Vol 17 (7) ◽  
pp. 2781-2796 ◽  
Author(s):  
S. Shukla ◽  
J. Sheffield ◽  
E. F. Wood ◽  
D. P. Lettenmaier

Abstract. Global seasonal hydrologic prediction is crucial to mitigating the impacts of droughts and floods, especially in the developing world. Hydrologic predictability at seasonal lead times (i.e., 1–6 months) comes from knowledge of initial hydrologic conditions (IHCs) and seasonal climate forecast skill (FS). In this study we quantify the contributions of two primary components of IHCs – soil moisture and snow water content – and FS (of precipitation and temperature) to seasonal hydrologic predictability globally on a relative basis throughout the year. We do so by conducting two model-based experiments using the variable infiltration capacity (VIC) macroscale hydrology model, one based on ensemble streamflow prediction (ESP) and another based on Reverse-ESP (Rev-ESP), both for a 47 yr re-forecast period (1961–2007). We compare cumulative runoff (CR), soil moisture (SM) and snow water equivalent (SWE) forecasts from each experiment with a VIC model-based reference data set (generated using observed atmospheric forcings) and estimate the ratio of root mean square error (RMSE) of both experiments for each forecast initialization date and lead time, to determine the relative contribution of IHCs and FS to the seasonal hydrologic predictability. We find that in general, the contributions of IHCs to seasonal hydrologic predictability is highest in the arid and snow-dominated climate (high latitude) regions of the Northern Hemisphere during forecast periods starting on 1 January and 1 October. In mid-latitude regions, such as the Western US, the influence of IHCs is greatest during the forecast period starting on 1 April. In the arid and warm temperate dry winter regions of the Southern Hemisphere, the IHCs dominate during forecast periods starting on 1 April and 1 July. In equatorial humid and monsoonal climate regions, the contribution of FS is generally higher than IHCs through most of the year. Based on our findings, we argue that despite the limited FS (mainly for precipitation) better estimates of the IHCs could lead to improvement in the current level of seasonal hydrologic forecast skill over many regions of the globe at least during some parts of the year.


Water ◽  
2019 ◽  
Vol 11 (7) ◽  
pp. 1362 ◽  
Author(s):  
Mustafa Berk Duygu ◽  
Zuhal Akyürek

Soil moisture content is one of the most important parameters of hydrological studies. Cosmic-ray neutron sensing is a promising proximal soil moisture sensing technique at intermediate scale and high temporal resolution. In this study, we validate satellite soil moisture products for the period of March 2015 and December 2018 by using several existing Cosmic Ray Neutron Probe (CRNP) stations of the COSMOS database and a CRNP station that was installed in the south part of Turkey in October 2016. Soil moisture values, which were inferred from the CRNP station in Turkey, are also validated using a time domain reflectometer (TDR) installed at the same location and soil water content values obtained from a land surface model (Noah LSM) at various depths (0.1 m, 0.3 m, 0.6 m and 1.0 m). The CRNP has a very good correlation with TDR where both measurements show consistent changes in soil moisture due to storm events. Satellite soil moisture products obtained from the Soil Moisture and Ocean Salinity (SMOS), the METOP-A/B Advanced Scatterometer (ASCAT), Soil Moisture Active Passive (SMAP), Advanced Microwave Scanning Radiometer 2 (AMSR2), Climate Change Initiative (CCI) and a global land surface model Global Land Data Assimilation System (GLDAS) are compared with the soil moisture values obtained from CRNP stations. Coefficient of determination ( r 2 ) and unbiased root mean square error (ubRMSE) are used as the statistical measures. Triple Collocation (TC) was also performed by considering soil moisture values obtained from different soil moisture products and the CRNPs. The validation results are mainly influenced by the location of the sensor and the soil moisture retrieval algorithm of satellite products. The SMAP surface product produces the highest correlations and lowest errors especially in semi-arid areas whereas the ASCAT product provides better results in vegetated areas. Both global and local land surface models’ outputs are highly compatible with the CRNP soil moisture values.


2019 ◽  
Vol 11 (1) ◽  
pp. 101-110 ◽  
Author(s):  
James W. Roche ◽  
Robert Rice ◽  
Xiande Meng ◽  
Daniel R. Cayan ◽  
Michael D. Dettinger ◽  
...  

Abstract. We present hourly climate data to force land surface process models and assessments over the Merced and Tuolumne watersheds in the Sierra Nevada, California, for the water year 2010–2014 period. Climate data (38 stations) include temperature and humidity (23), precipitation (13), solar radiation (8), and wind speed and direction (8), spanning an elevation range of 333 to 2987 m. Each data set contains raw data as obtained from the source (Level 0), data that are serially continuous with noise and nonphysical points removed (Level 1), and, where possible, data that are gap filled using linear interpolation or regression with a nearby station record (Level 2). All stations chosen for this data set were known or documented to be regularly maintained and components checked and calibrated during the period. Additional time-series data included are available snow water equivalent records from automated stations (8) and manual snow courses (22), as well as distributed snow depth and co-located soil moisture measurements (2–6) from four locations spanning the rain–snow transition zone in the center of the domain. Spatial data layers pertinent to snowpack modeling in this data set are basin polygons and 100 m resolution rasters of elevation, vegetation type, forest canopy cover, tree height, transmissivity, and extinction coefficient. All data are available from online data repositories (https://doi.org/10.6071/M3FH3D).


2021 ◽  
Author(s):  
Maria Piles ◽  
Roberto Fernandez-Moran ◽  
Luis Gómez-Chova ◽  
Gustau Camps-Valls ◽  
Dara Entekhabi ◽  
...  

<p>The Copernicus Imaging Microwave Radiometer (CIMR) mission is currently being developed as a High Priority Copernicus Mission to support the Integrated European Policy for the Arctic. Due to its measurement characteristics, CIMR has exciting capabilities to enable a unique set of land surface products and science applications at a global scale. These characteristics go beyond what previous microwave radiometers (e.g. AMSR series, SMAP and SMOS) provide, and therefore allow for entirely new approaches to the estimation of bio-geophysical products from brightness temperature observations. Most notably, CIMR channels (L-,C-,X-,Ka-,Ku-bands) are very well fit for the simultaneous retrieval of soil moisture and vegetation properties, like biomass and moisture of different plant components such as leaves, stems or trunks. Also, the distinct spatial resolution of each frequency band allows for the development of approaches to cascade information and obtain these properties at multiple spatial scales. From a temporal perspective, CIMR has a higher revisit time than previous L-band missions dedicated to soil moisture monitoring (about 1 day global, sub-daily at the poles). This improved temporal resolution could allow resolving critical time scales of water processes, which is relevant to better model and understand land-atmosphere exchanges and feedbacks. In this presentation, new opportunities for soil moisture remote sensing made possible by the CIMR mission, as well as synergies and cross-sensor opportunities will be discussed.  </p>


Sign in / Sign up

Export Citation Format

Share Document