scholarly journals Correction of Systematic Error in Global Temperature Analysis Related to Aging Effects

2021 ◽  
Author(s):  
Moritz Büsing
Keyword(s):  
Systematic Error ◽  
Small Error ◽  
Temperature Data ◽  
Data Series ◽  
Data Sets ◽  
Weather Station ◽  
Aging Effects ◽  
Depth Analysis ◽  
Data Points ◽  
Corrected Data

The white paint or white plastic of the housings of weather stations ages which leads to increased absorption of solar radiation and to increased temperature measurements. This alone would be a small error. However, the homogenization algorithms used by many different organizations repeatedly add this small value each time a weather station is renovated, renewed or replaced, which results in a substantial systematic error. This error occurs, because steps in the temperature data series are corrected as if they were permanent, but this is not always the case, particularly not in case of weather station aging and renewal.An in-depth analysis of the weather station data sets (homogenized and non-homogenized) confirmed the presence of the systematic error, proved the existence of statistically significant aging effects and allowed to quantify the size of the aging effects.I have quantified the effect of the aging effects on the climate curves by adding the aging functions to the temperature data points in the intervals between homogenizations. This corrected data base is analyzed using the GISTEMP tool.Here I show a reduction of the temperature change between the decades 1880-1890 and 2010-2020 from 1.43°C to 0.83°C CI(95%) [0.46°C; 1.19°C].

scholarly journals The Influence of Dust Levels on Atmospheric Carbon Dioxide and Global Temperature

2020 ◽  
Author(s):  
David Allen ◽  
Danail Sandakchiev ◽  
VINCENT HOOPER ◽  
Ivan Ivanov
Keyword(s):  
Atmospheric Carbon Dioxide ◽  
Ice Core ◽  
Linear Interpolation ◽  
Data Series ◽  
Data Sets ◽  
Dynamic Correlations ◽  
Statistical Measures ◽  
Causality Tests ◽  
Data Points ◽  
Non Parametric

Abstract The purpose of this paper is to examine the causality between DUST, CO2 and temperature for the Vostok ice core data series [Vostok Data Series], dating from 420 000 years ago, and the EPICA C Dome data going back 800 000 years. In addition, the time-varying volatility and coefficient of variation in the CO2, dust and temperature is examined, as well as their dynamic correlations and interactions. We find a clear link between atmospheric C02 levels, dust and temperature, together with a bi-directional causality effects when applying both Granger Causality Tests (1969) and multi-directional Non-Linear analogues, i.e. Generalized Correlation. We apply both parametric and non-parametric statistical measures and testing. Linear interpolation with 100 years and 1000 years is applied to the three variables, in order to solve the problem of data points mismatch among them. The visualizations and descriptive statistics of the interpolated variables (using the two periods) show robustness in the results. The data analysis points out that variables are volatile, but their respective rolling mean and standard deviation remain stable. Additionally, 1000 years interpolated data suggests positive correlation between temperature and CO2, while dust is negatively correlated with both temperature and CO2. The application of the non-parametric Generalized Measure of Correlation to our data sets, in a pairwise fashion suggested that CO2 better explains temperature than temperature does CO2, that temperature better explains dust than dust does temperature, and finally that CO2 better explains dust than vice -versa. The latter two pairs of relationships are negative. The summary of the paper presents some avenues for further research, as well as some policy relevant suggestions.

scholarly journals ON GENERATING DIGITAL ELEVATION MODELS FROM LIDAR DATA – RESOLUTION VERSUS ACCURACY AND TOPOGRAPHIC WETNESS INDEX INDICES IN NORTHERN PEATLANDS

2012 ◽  
Vol 38 (2) ◽  
pp. 57-69 ◽  
Author(s):  
Abdulghani Hasan ◽  
Petter Pilesjö ◽  
Andreas Persson
Keyword(s):  
Large Scale ◽  
Drainage Area ◽  
Data Sets ◽  
Topographic Wetness Index ◽  
Absolute Deviation ◽  
Digital Elevation ◽  
Elevation Data ◽  
Scale Modelling ◽  
Data Points ◽  
Emission Modelling

Global change and GHG emission modelling are dependent on accurate wetness estimations for predictions of e.g. methane emissions. This study aims to quantify how the slope, drainage area and the TWI vary with the resolution of DEMs for a flat peatland area. Six DEMs with spatial resolutions from 0.5 to 90 m were interpolated with four different search radiuses. The relationship between accuracy of the DEM and the slope was tested. The LiDAR elevation data was divided into two data sets. The number of data points facilitated an evaluation dataset with data points not more than 10 mm away from the cell centre points in the interpolation dataset. The DEM was evaluated using a quantile-quantile test and the normalized median absolute deviation. It showed independence of the resolution when using the same search radius. The accuracy of the estimated elevation for different slopes was tested using the 0.5 meter DEM and it showed a higher deviation from evaluation data for steep areas. The slope estimations between resolutions showed differences with values that exceeded 50%. Drainage areas were tested for three resolutions, with coinciding evaluation points. The model ability to generate drainage area at each resolution was tested by pair wise comparison of three data subsets and showed differences of more than 50% in 25% of the evaluated points. The results show that consideration of DEM resolution is a necessity for the use of slope, drainage area and TWI data in large scale modelling.

scholarly journals Inter- and Intralaboratory Comparison of JC Polyomavirus Antibody Testing Using Two Different Virus-Like Particle-Based Assays

2014 ◽  
Vol 21 (11) ◽  
pp. 1581-1588 ◽  
Author(s):  
Piotr Kardas ◽  
Mohammadreza Sadeghi ◽  
Fabian H. Weissbach ◽  
Tingting Chen ◽  
Lea Hedman ◽  
...  
Keyword(s):  
Risk Stratification ◽  
Data Sets ◽  
Antibody Testing ◽  
Jc Polyomavirus ◽  
Virus Like Particle ◽  
Interlaboratory Variability ◽  
Increased Risk ◽  
Basic Protocol ◽  
Data Points ◽  
Reference Serum

ABSTRACTJC polyomavirus (JCPyV) can cause progressive multifocal leukoencephalopathy (PML), a debilitating, often fatal brain disease in immunocompromised patients. JCPyV-seropositive multiple sclerosis (MS) patients treated with natalizumab have a 2- to 10-fold increased risk of developing PML. Therefore, JCPyV serology has been recommended for PML risk stratification. However, different antibody tests may not be equivalent. To study intra- and interlaboratory variability, sera from 398 healthy blood donors were compared in 4 independent enzyme-linked immunoassay (ELISA) measurements generating >1,592 data points. Three data sets (Basel1, Basel2, and Basel3) used the same basic protocol but different JCPyV virus-like particle (VLP) preparations and introduced normalization to a reference serum. The data sets were also compared with an independent method using biotinylated VLPs (Helsinki1). VLP preadsorption reducing ≥35% activity was used to identify seropositive sera. The results indicated that Basel1, Basel2, Basel3, and Helsinki1 were similar regarding overall data distribution (P= 0.79) and seroprevalence (58.0, 54.5, 54.8, and 53.5%, respectively;P= 0.95). However, intra-assay intralaboratory comparison yielded 3.7% to 12% discordant results, most of which were close to the cutoff (0.080 < optical density [OD] < 0.250) according to Bland-Altman analysis. Introduction of normalization improved overall performance and reduced discordance. The interlaboratory interassay comparison between Basel3 and Helsinki1 revealed only 15 discordant results, 14 (93%) of which were close to the cutoff. Preadsorption identified specificities of 99.44% and 97.78% and sensitivities of 99.54% and 95.87% for Basel3 and Helsinki1, respectively. Thus, normalization to a preferably WHO-approved reference serum, duplicate testing, and preadsorption for samples around the cutoff may be necessary for reliable JCPyV serology and PML risk stratification.

A Support Based Initialization Algorithm for Categorical Data Clustering

2018 ◽  
Vol 11 (2) ◽  
pp. 53-67
Author(s):  
Ajay Kumar ◽  
Shishir Kumar
Keyword(s):  
Categorical Data ◽  
Selection Process ◽  
Numerical Data ◽  
Real Data ◽  
Data Sets ◽  
Data Set ◽  
Data Object ◽  
Data Points ◽  
Wu Method ◽  
Selection Algorithms

Several initial center selection algorithms are proposed in the literature for numerical data, but the values of the categorical data are unordered so, these methods are not applicable to a categorical data set. This article investigates the initial center selection process for the categorical data and after that present a new support based initial center selection algorithm. The proposed algorithm measures the weight of unique data points of an attribute with the help of support and then integrates these weights along the rows, to get the support of every row. Further, a data object having the largest support is chosen as an initial center followed by finding other centers that are at the greatest distance from the initially selected center. The quality of the proposed algorithm is compared with the random initial center selection method, Cao's method, Wu method and the method introduced by Khan and Ahmad. Experimental analysis on real data sets shows the effectiveness of the proposed algorithm.

Mahalanobis distance informed by clustering

2018 ◽  
Vol 8 (2) ◽  
pp. 377-406
Author(s):  
Almog Lahav ◽  
Ronen Talmon ◽  
Yuval Kluger
Keyword(s):  
Mahalanobis Distance ◽  
High Dimensional Data ◽  
Hidden Variables ◽  
Real Data ◽  
Risk Groups ◽  
High Dimensional ◽  
Data Sets ◽  
Kaplan Meier ◽  
Data Points ◽  
Survival Plot

Abstract A fundamental question in data analysis, machine learning and signal processing is how to compare between data points. The choice of the distance metric is specifically challenging for high-dimensional data sets, where the problem of meaningfulness is more prominent (e.g. the Euclidean distance between images). In this paper, we propose to exploit a property of high-dimensional data that is usually ignored, which is the structure stemming from the relationships between the coordinates. Specifically, we show that organizing similar coordinates in clusters can be exploited for the construction of the Mahalanobis distance between samples. When the observable samples are generated by a nonlinear transformation of hidden variables, the Mahalanobis distance allows the recovery of the Euclidean distances in the hidden space. We illustrate the advantage of our approach on a synthetic example where the discovery of clusters of correlated coordinates improves the estimation of the principal directions of the samples. Our method was applied to real data of gene expression for lung adenocarcinomas (lung cancer). By using the proposed metric we found a partition of subjects to risk groups with a good separation between their Kaplan–Meier survival plot.

scholarly journals Computer simulation modeling of Leaf Area Index (LAI) in maize

2014 ◽  
pp. 5-8
Author(s):  
Károly Bakó ◽  
László Huzsvai
Keyword(s):  
Leaf Area Index ◽  
Leaf Area ◽  
Leaf Development ◽  
Simulation Modeling ◽  
Data Series ◽  
Weather Station ◽  
Area Index ◽  
Average Temperature ◽  
Set Up ◽  
The University

This study presents a PHP-based model capable of calculating maize leaf area index. The model calculates LAI from emergence to 75% silking. The basis of calculation is represented by the daily average temperature values. The usability of the model was tested using three years' temperature and LAI data series from the values obtained by the weather station set up at the Látókép Experiment Site of the University of Debrecen, Centre for Agricultural Sciences between 1994 and 1996. During the running of the model, it was observed that temperature affects the intensity of leaf development to a various extent.

scholarly journals Effect of Glaciers on Annual Run-Off, Johan Dahl Land, South Greenland

1988 ◽  
Vol 34 (117) ◽  
pp. 200-207 ◽  
Author(s):  
R. J. Braithwaite ◽  
Ole B. Olesen
Keyword(s):  
Statistical Model ◽  
Negative Correlation ◽  
Seasonal Variations ◽  
Data Sets ◽  
Weather Station ◽  
Moderate Amount ◽  
Run Off ◽  
Few Data

AbstractRun-off data for two basins in south Greenland, one of which contains glaciers, are compared with precipitation at a nearby weather station and with ablation measured in the glacier basin. Seasonal variations of run-off for the two basins are broadly similar while run-off from the glacier basin has smaller year-to-year variations. A simple statistical model shows that this is the result of a negative correlation between ablation and precipitation, which has the effect of reducing run-off variations in basins with a moderate amount of glacier cover although run-off variations may become large again for highly glacierized basins. The model also predicts an increasing run-off with ablation correlation and a decreasing run-off with precipitation correlation as the amount of glacier cover increases. Although there are still too few data sets from other parts of Greenland for final conclusions, there are indications that the present findings may be applicable to other Greenland basins.

scholarly journals Analysis of erroneous data entries in paper based and electronic data collection

2019 ◽  
Author(s):  
Benedikt Ley ◽  
Komal Raj Rijal ◽  
Jutta Marfurt ◽  
Nabaraj Adhikari ◽  
Megha Banjara ◽  
...  
Keyword(s):  
Data Collection ◽  
Data Entry ◽  
Categorical Variables ◽  
Data Sets ◽  
Continuous Variables ◽  
Electronic Data ◽  
Suitable Alternative ◽  
Electronic Data Collection ◽  
Data Points ◽  
Time Variables

Abstract Objective: Electronic data collection (EDC) has become a suitable alternative to paper based data collection (PBDC) in biomedical research even in resource poor settings. During a survey in Nepal, data were collected using both systems and data entry errors compared between both methods. Collected data were checked for completeness, values outside of realistic ranges, internal logic and date variables for reasonable time frames. Variables were grouped into 5 categories and the number of discordant entries were compared between both systems, overall and per variable category. Results: Data from 52 variables collected from 358 participants were available. Discrepancies between both data sets were found in 12.6% of all entries (2352/18,616). Differences between data points were identified in 18.0% (643/3,580) of continuous variables, 15.8% of time variables (113/716), 13.0% of date variables (140/1,074), 12.0% of text variables (86/716), and 10.9% of categorical variables (1,370/12,530). Overall 64% (1,499/2,352) of all discrepancies were due to data omissions, 76.6% (1,148/1,499) of missing entries were among categorical data. Omissions in PBDC (n=1002) were twice as frequent as in EDC (n=497, p<0.001). Data omissions, specifically among categorical variables were identified as the greatest source of error. If designed accordingly, EDC can address this short fall effectively.

scholarly journals VOLUME BASED DTM GENERATION FROM VERY HIGH RESOLUTION PHOTOGRAMMETRIC DSMS

2016 ◽  
Vol XLI-B3 ◽  
pp. 83-90 ◽  
Author(s):  
B. Piltz ◽  
S. Bayer ◽  
A. M. Poznanska
Keyword(s):  
Ground Surface ◽  
Processing Parameters ◽  
Data Sets ◽  
Maximum Width ◽  
Directional Filtering ◽  
Very High Spatial Resolution ◽  
Efficient Scheme ◽  
Data Points ◽  
Minimum Height ◽  
Very High

In this paper we propose a new algorithm for digital terrain (DTM) model reconstruction from very high spatial resolution digital surface models (DSMs). It represents a combination of multi-directional filtering with a new metric which we call &lt;i&gt;normalized volume above ground&lt;/i&gt; to create an above-ground mask containing buildings and elevated vegetation. This mask can be used to interpolate a ground-only DTM. The presented algorithm works fully automatically, requiring only the processing parameters &lt;i&gt;minimum height&lt;/i&gt; and &lt;i&gt;maximum width&lt;/i&gt; in metric units. Since slope and breaklines are not decisive criteria, low and smooth and even very extensive flat objects are recognized and masked. The algorithm was developed with the goal to generate the normalized DSM for automatic 3D building reconstruction and works reliably also in environments with distinct hillsides or terrace-shaped terrain where conventional methods would fail. A quantitative comparison with the ISPRS data sets &lt;i&gt;Potsdam&lt;/i&gt; and &lt;i&gt;Vaihingen&lt;/i&gt; show that 98-99% of all building data points are identified and can be removed, while enough ground data points (~66%) are kept to be able to reconstruct the ground surface. Additionally, we discuss the concept of &lt;i&gt;size dependent height thresholds&lt;/i&gt; and present an efficient scheme for pyramidal processing of data sets reducing time complexity to linear to the number of pixels, &lt;i&gt;O(WH)&lt;/i&gt;.

Summary of Affinity Propagation

2011 ◽  
Vol 268-270 ◽  
pp. 811-816
Author(s):  
Yong Zhou ◽  
Yan Xing
Keyword(s):  
Clustering Algorithm ◽  
Large Data ◽  
Large Data Sets ◽  
Affinity Propagation ◽  
Damping Factor ◽  
Data Sets ◽  
Similarity Matrix ◽  
Data Points

Affinity Propagation(AP)is a new clustering algorithm, which is based on the similarity matrix between pairs of data points and messages are exchanged between data points until clustering result emerges. It is efficient and fast , and it can solve the clustering on large data sets. But the traditional Affinity Propagation has many limitations, this paper introduces the Affinity Propagation, and analyzes in depth the advantages and limitations of it, focuses on the improvements of the algorithm — improve the similarity matrix, adjust the preference and the damping-factor, combine with other algorithms. Finally, discusses the development of Affinity Propagation.

Sign in / Sign up

Export Citation Format

Share Document