scholarly journals SC-Earth: A Station-based Serially Complete Earth Dataset from 1950 to 2019

2021 ◽  
pp. 1-47
Author(s):  
Guoqiang Tang ◽  
Martyn P. Clark ◽  
Simon Michael Papalexiou
Keyword(s):  
Missing Values ◽  
Meteorological Data ◽  
Oceanic Islands ◽  
Dew Point ◽  
Time Shift ◽  
Gap Filling ◽  
Quantile Mapping ◽  
Station Data ◽  
Historical Climatology ◽  
The Tropics

AbstractMeteorological data from ground stations suffer from temporal discontinuities caused by missing values and short measurement periods. Gap filling and reconstruction techniques have proven to be effective in producing serially complete station datasets (SCDs) that are used for a myriad of meteorological applications (e.g., developing gridded meteorological datasets and validating models). To our knowledge, all SCDs are developed at regional scales. In this study, we developed the serially complete Earth (SC-Earth) dataset, which provides daily precipitation, mean temperature, temperature range, dew-point temperature, and wind speed data from 1950 to 2019. SC-Earth utilizes raw station data from the Global Historical Climatology Network-Daily (GHCN-D) and the Global Surface Summary of the Day (GSOD). A unified station repository is generated based on GHCN-D and GSOD after station merging and strict quality control. ERA5 is optimally matched with station data considering the time shift issue and then used to assist the global gap filling. SC-Earth is generated by merging estimates from 15 strategies based on quantile mapping, spatial interpolation, machine learning, and multi-strategy merging. The final estimates are bias corrected using a combination of quantile mapping and quantile delta mapping. Comprehensive validation demonstrates that SC-Earth has high accuracy around the globe, with degraded quality in the tropics and oceanic islands due to sparse station networks, strong spatial precipitation gradients, and degraded ERA5 estimates. Meanwhile, SC-Earth inherits potential limitations such as inhomogeneity and precipitation undercatch from raw station data, which may affect its application in some cases. Overall, the high-quality and high-density SC-Earth dataset will benefit research in fields of hydrology, ecology, meteorology, and climate.

scholarly journals Evaluation of Seven Gap-Filling Techniques for Daily Station-Based Rainfall Datasets in South Ethiopia

2021 ◽  
Vol 2021 ◽  
pp. 1-15
Author(s):  
Alefu Chinasho ◽  
Bobe Bedadi ◽  
Tesfaye Lemma ◽  
Tamado Tana ◽  
Tilahun Hordofa ◽  
...  
Keyword(s):  
Time Series ◽  
Missing Values ◽  
Daily Rainfall ◽  
Substantial Contribution ◽  
Ratio Method ◽  
Rainfall Time Series ◽  
Gap Filling ◽  
Quantile Mapping ◽  
South Ethiopia ◽  
Skill Scores

Meteorological stations, mainly located in developing countries, have gigantic missing values in the climate dataset (rainfall and temperature). Ignoring the missing values from analyses has been used as a technique to manage it. However, it leads to partial and biased results in data analyses. Instead, filling the data gaps using the reference datasets is a better and widely used approach. Thus, this study was initiated to evaluate the seven gap-filling techniques in daily rainfall datasets in five meteorological stations of Wolaita Zone and the surroundings in South Ethiopia. The considered gap-filling techniques in this study were simple arithmetic means (SAM), normal ratio method (NRM), correlation coefficient weighing (CCW), inverse distance weighting (IDW), multiple linear regression (MLR), empirical quantile mapping (EQM), and empirical quantile mapping plus (EQM+). The techniques were preferred because of their computational simplicity and appreciable accuracies. Their performance was evaluated against mean absolute error (MAE), root mean square error (RMSE), skill scores (SS), and Pearson’s correlation coefficients (R). The results indicated that MLR outperformed other techniques in all of the five meteorological stations. It showed the lowest RMSE and the highest SS and R in all stations. Four techniques (SAM, NRM, CCW, and IDW) showed similar performance and were second-ranked in all of the stations with little exceptions in time series. EQM+ improved (not substantial) the performance levels of gap-filling techniques in some stations. In general, MLR is suggested to fill in the missing values of the daily rainfall time series. However, the second-ranked techniques could also be used depending on the required time series (period) of each station. The techniques have better performance in stations located in higher altitudes. The authors expect a substantial contribution of this paper to the achievement of sustainable development goal thirteen (climate action) through the provision of gap-filling techniques with better accuracy.

scholarly journals Application of Artificial Neural Networks (ANNs) in the Gap Filling of Meteorological Time Series

2018 ◽  
Vol 33 (2) ◽  
pp. 317-328 ◽  
Author(s):  
Eluã Ramos Coutinho ◽  
Robson Mariano da Silva ◽  
Jonni Guiller Ferreira Madeira ◽  
Pollyanna Rodrigues de Oliveira dos Santos Coutinho ◽  
Ronney Arismel Mancebo Boloy ◽  
...  
Keyword(s):  
Air Temperature ◽  
Missing Values ◽  
Meteorological Data ◽  
Percentage Error ◽  
Gap Filling ◽  
Relative Air Humidity ◽  
Recorded Data ◽  
Artificial Neural ◽  
Artificial Neural Network Ann ◽  
Maximum Air Temperature

Abstract This study estimates and fills real flaws in a series of meteorological data belonging to four regions of the state of Rio de Janeiro. For this, an Artificial Neural Network (ANN) of Multilayer Perceptron (MLP) was applied. In order to evaluate its adequacy, the monthly variables of maximum air temperature and relative humidity of the period between 05/31/2002 and 12/31/2014 were estimated and compared with the results obtained by Multiple Linear Regression (MLR) and Regions Average (RA), and still faced with the recorded data. To analyze the estimated values and define the best model for filling, statistical techniques were applied such as correlation coefficient (r), Mean Percentage Error (MPE) and others. The results showed a high relation with the recorded data, presenting indexes between 0.94 to 0.98 of (r) for maximum air temperature and between 2.32% to 1.05% of (MPE), maintaining the precision between 97% A 99%. For the relative air humidity, the index (r) with MLP remained between 0.77 and 0.94 and (MPE) between 2.41% and 1.85%, maintaining estimates between 97% and 98%. These results highlight MLP as being effective in estimating and filling missing values.

The use of serially complete station data to improve the temporal continuity of gridded precipitation and temperature estimates

2021 ◽  
Author(s):  
Guoqiang Tang ◽  
Martyn P. Clark ◽  
Simon Michael Papalexiou
Keyword(s):  
North America ◽  
Spatial Interpolation ◽  
Missing Values ◽  
Meteorological Data ◽  
Maximum Temperature ◽  
Spatial Density ◽  
Gap Filling ◽  
Station Network ◽  
Interpolation Methods ◽  
Precipitation And Temperature

AbstractStations are an important source of meteorological data, but often suffer from missing values and short observation periods. Gap filling is widely used to generate serially complete datasets (SCDs), which are subsequently used to produce gridded meteorological estimates. However, the value of SCDs in spatial interpolation is scarcely studied. Based on our recent efforts to develop a SCD over North America (SCDNA), we explore the extent to which gap filling improves gridded precipitation and temperature estimates. We address two specific questions: (1) Can SCDNA improve the statistical accuracy of gridded estimates in North America? (2) Can SCDNA improve estimates of trends on gridded data? In addressing these questions, we also evaluate the extent to which results depend on the spatial density of the station network and the spatial interpolation methods used. Results show that the improvement in statistical interpolation due to gap filling is more obvious for precipitation, followed by minimum temperature and maximum temperature. The improvement is larger when the station network is sparse and when simpler interpolation methods are used. SCDs can also notably reduce the uncertainties in spatial interpolation. Our evaluation across North America from 1979 to 2018 demonstrates that SCDs improve the accuracy of interpolated estimates for most stations and days. SCDNA-based interpolation also obtains better trend estimation than observation-based interpolation. This occurs because stations used for interpolation could change during a specific period, causing changepoints in interpolated temperature estimates and affect the long-term trends of observation-based interpolation, which can be avoided using SCDNA. Overall, SCDs improve the performance of gridded precipitation and temperature estimates.

Comparison of two gap-filling techniques for nitrous oxide fluxes from agricultural soil

2019 ◽  
Vol 99 (1) ◽  
pp. 12-24 ◽  
Author(s):  
Rezvan Taki ◽  
Claudia Wagner-Riddle ◽  
Gary Parkin ◽  
Rob Gordon ◽  
Andrew VanderZaag
Keyword(s):  
Missing Values ◽  
Interpolation Method ◽  
Weather Conditions ◽  
Linear Interpolation ◽  
Bias Error ◽  
Research Station ◽  
Ann Model ◽  
Gap Filling ◽  
Adverse Weather ◽  
The Impact

Micrometeorological methods are ideally suited for continuous measurements of N2O fluxes, but gaps in the time series occur due to low-turbulence conditions, power failures, and adverse weather conditions. Two gap-filling methods including linear interpolation and artificial neural networks (ANN) were utilized to reconstruct missing N2O flux data from a corn–soybean–wheat rotation and evaluate the impact on annual N2O emissions from 2001 to 2006 at the Elora Research Station, ON, Canada. The single-year ANN method is recommended because this method captured flux variability better than the linear interpolation method (average R2 of 0.41 vs. 0.34). Annual N2O emission and annual bias resulting from linear and single-year ANN were compatible with each other when there were few and short gaps (i.e., percentage of missing values <30%). However, with longer gaps (>20 d), the bias error in annual fluxes varied between 0.082 and 0.344 kg N2O-N ha−1 for linear and 0.069 and 0.109 kg N2O-N ha−1 for single-year ANN. Hence, the single-year ANN with lower annual bias and stable approach over various years is recommended, if the appropriate driving inputs (i.e., soil temperature, soil water content, precipitation, N mineral content, and snow depth) needed for the ANN model are available.

scholarly journals Constructing High-Resolution, Bias-Corrected Climate Products: A Comparison of Methods

2021 ◽  
Vol 60 (4) ◽  
pp. 455-475
Author(s):  
Maike F. Holthuijzen ◽  
Brian Beckage ◽  
Patrick J. Clemins ◽  
Dave Higdon ◽  
Jonathan M. Winter
Keyword(s):  
High Resolution ◽  
Bias Correction ◽  
Climate Model ◽  
Maximum Temperature ◽  
Daily Maximum Temperature ◽  
Model Output ◽  
Quantile Mapping ◽  
Station Data ◽  
Climate Model Output ◽  
Mapping Techniques

AbstractHigh-resolution, bias-corrected climate data are necessary for climate impact studies at local scales. Gridded historical data are convenient for bias correction but may contain biases resulting from interpolation. Long-term, quality-controlled station data are generally superior climatological measurements, but because the distribution of climate stations is irregular, station data are challenging to incorporate into downscaling and bias-correction approaches. Here, we compared six novel methods for constructing full-coverage, high-resolution, bias-corrected climate products using daily maximum temperature simulations from a regional climate model (RCM). Only station data were used for bias correction. We quantified performance of the six methods with the root-mean-square-error (RMSE) and Perkins skill score (PSS) and used two ANOVA models to analyze how performance varied among methods. We validated the six methods using two calibration periods of observed data (1980–89 and 1980–2014) and two testing sets of RCM data (1990–2014 and 1980–2014). RMSE for all methods varied throughout the year and was larger in cold months, whereas PSS was more consistent. Quantile-mapping bias-correction techniques substantially improved PSS, while simple linear transfer functions performed best in improving RMSE. For the 1980–89 calibration period, simple quantile-mapping techniques outperformed empirical quantile mapping (EQM) in improving PSS. When calibration and testing time periods were equivalent, EQM resulted in the largest improvements in PSS. No one method performed best in both RMSE and PSS. Our results indicate that simple quantile-mapping techniques are less prone to overfitting than EQM and are suitable for processing future climate model output, whereas EQM is ideal for bias correcting historical climate model output.

scholarly journals Soil, snow, weather, and sub-surface storage data from a mountain catchment in the rain–snow transition zone

2013 ◽  
Vol 6 (2) ◽  
pp. 811-835 ◽  
Author(s):  
P. R. Kormos ◽  
D. Marks ◽  
C. J. Williams ◽  
H. P. Marshall ◽  
P. Aishlin ◽  
...  
Keyword(s):  
Soil Moisture ◽  
Transition Zone ◽  
Soil Texture ◽  
Soil Depth ◽  
Meteorological Data ◽  
Dew Point ◽  
Soil Profiles ◽  
Data Set ◽  
Hydrologic Condition ◽  
Wide Range

Abstract. A comprehensive hydroclimatic data set is presented for the 2011 water year to improve understanding of hydrologic processes in the rain-snow transition zone. This type of dataset is extremely rare in scientific literature because of the quality and quantity of soil depth, soil texture, soil moisture, and soil temperature data. Standard meteorological and snow cover data for the entire 2011 water year are included, which include several rain-on-snow events. Surface soil textures and soil depths from 57 points are presented as well as soil texture profiles from 14 points. Meteorological data include continuous hourly shielded, unshielded, and wind corrected precipitation, wind speed, air temperature, relative humidity, dew point temperature, and incoming solar and thermal radiation data. Sub-surface data included are hourly soil moisture data from multiple depths from 7 soil profiles within the catchment, and soil temperatures from multiple depths from 2 soil profiles. Hydrologic response data include hourly stream discharge from the catchment outlet weir, continuous snow depths from one location, intermittent snow depths from 5 locations, and snow depth and density data from ten weekly snow surveys. Though it represents only a single water year, the presentation of both above and below ground hydrologic condition makes it one of the most detailed and complete hydro-climatic datasets from the climatically sensitive rain-snow transition zone for a wide range of modeling and descriptive studies. Data are available at doi:10.1594/PANGAEA.819837.

scholarly journals A Quantile Mapping Method to Fill in Discontinued Daily Precipitation Time Series

Water ◽  
2020 ◽  
Vol 12 (8) ◽  
pp. 2304
Author(s):  
Manolis G. Grillakis ◽  
Christos Polykretis ◽  
Stelios Manoudakis ◽  
Konstantinos D. Seiradakis ◽  
Dimitrios D. Alexakis
Keyword(s):  
Time Series ◽  
Missing Values ◽  
Climate Models ◽  
Daily Precipitation ◽  
Mapping Method ◽  
Precipitation Time Series ◽  
Quantile Mapping ◽  
Step Procedure ◽  
Mediterranean Island ◽  
Data Statistics

We present and assess a method to estimate missing values in daily precipitation time series for the Mediterranean island of Crete. The method involves a quantile mapping methodology originally developed for the bias correction of climate models’ output. The overall methodology is based on a two-step procedure: (a) assessment of missing values from nearby stations and (b) adjustment of the biases in the probability density function of the filled values towards the existing data of the target. The methodology is assessed for its performance in filling-in the time series of a dense precipitation station network with large gaps on the island of Crete, Greece. The results indicate that quantile mapping can benefit the filled-in missing data statistics, as well as the wet day fraction. Conceptual limitations of the method are discussed, and correct methodology application guidance is provided.

scholarly journals Performance of Alternative “Normals” for Tracking Climate Changes, Using Homogenized and Nonhomogenized Seasonal U.S. Surface Temperatures

2013 ◽  
Vol 52 (8) ◽  
pp. 1677-1687 ◽  
Author(s):  
Daniel S. Wilks ◽  
Robert E. Livezey
Keyword(s):  
Continuous Functions ◽  
Optimal Choice ◽  
Aggregated Data ◽  
Station Data ◽  
Specification Method ◽  
Historical Climatology ◽  
Single Method ◽  
Temperature Climate ◽  
Network Station ◽  
Climate Prediction Center

AbstractEleven alternatives to the annually updated 30-yr average for specifying climate “normals” are considered for the purpose of projecting nonstationarity in the mean U.S. temperature climate during 2006–12. Comparisons are made for homogenized U.S. Historical Climatology Network station data, corresponding nonhomogenized station data, and spatially aggregated (“megadivision”) data. The use of homogenized station data shows clear improvement over nonhomogenized station data and spatially aggregated data in terms of mean-squared specification errors on independent data. The best single method overall was the most recent 15-yr average as implemented by the Climate Prediction Center (CPC15), consistent with previous work using nonhomogenized and spatially aggregated data, although “hinge” functions with the change point fixed at 1975 performed well for the spring and summer seasons. A hybrid normals-specification method, using one of these piecewise continuous functions when the regressions are sufficiently strong and the CPC15 otherwise, exhibits a favorable trade-off between squared error and bias that may make it an optimal choice for some users.

Sign in / Sign up

Export Citation Format

Share Document