scholarly journals Evaluation of break detection methods for snow data series

2021 ◽  
Author(s):  
Moritz Buchmann ◽  
Michael Begert ◽  
Stefan Brönnimann ◽  
Gernot Resch ◽  
Christoph Marty

<p>Measurements of snow depth and snowfall can vary dramatically over small distances. However, it is not clear if this applies to all derived variables and is the same for all seasons. Almost all meteorological time series incorporate some sort of inhomogeneities. Complete metadata and existing “parallel” stations in close proximity are not always available.<br>First, we analyse the impacts of local-scale variations based on a unique set of parallel manual snow measurements for the Swiss Alps consisting of 30 station pairs with up to 70 years of parallel data. Station pairs are mostly located in the same villages (or within 3km horizontal and 150m vertical distances). <br>Seasonal analysis of derived snow climate indicators such as maximum seasonal snow depth, sum of new snow, or days with snow on the ground shows that largest differences occur in spring and the smallest ones are found in DJF and NDJFMA. Relative inter-pair differences (uncertainties) for days with snow on the ground (average snow depth) are below 15% for 90% (30%) .<br>Second, in view of any homogenization efforts of snow data series, it is paramount to understand the impacts of inhomogeneities. Using state-of-the-art break detection algorithms, we strive to investigate which method works best for detecting breaks in snow data series. The results can then be used on time series with insufficient metadata or no neighbouring stations in order to include them in future homogenization processes.<br>Furthermore, the knowledge about inhomogeneities and breakpoints paves the way for new applications such as the reliable combination of two parallel series into one single series.</p>

2021 ◽  
Vol 15 (10) ◽  
pp. 4625-4636
Author(s):  
Moritz Buchmann ◽  
Michael Begert ◽  
Stefan Brönnimann ◽  
Christoph Marty

Abstract. Daily measurements of snow depth and snowfall can vary strongly over short distances. However, it is not clear if there is a seasonal dependence in these variations and how they impact common snow climate indicators based on mean values, as well as estimated return levels of extreme events based on maximum values. To analyse the impacts of local-scale variations we compiled a unique set of parallel snow measurements from the Swiss Alps consisting of 30 station pairs with up to 77 years of parallel data. Station pairs are usually located in the same villages (or within 3 km horizontal and 150 m vertical distances). Investigated snow climate indicators include average snow depth, maximum snow depth, sum of new snow, days with snow on the ground, days with snowfall, and snow onset and disappearance dates, which are calculated for various seasons (December to February (DJF), November to April (NDJFMA), and March to April (MA)). We computed relative and absolute error metrics for all these indicators at each station pair to demonstrate the potential variability. We found the largest relative inter-pair differences for all indicators in spring (MA) and the smallest in DJF. Furthermore, there is hardly any difference between DJF and NDJFMA, which show median variations of less than 5 % for all indicators. Local-scale variability ranges between less than 24 % (DJF) and less than 43 % (MA) for all indicators and 75 % of all station pairs. The highest percentage (90 %) of station pairs with variability of less than 15 % is observed for days with snow on the ground. The lowest percentage (30 %) of station pairs with variability of less than 15 % is observed for average snow depth. Median differences of snow disappearance dates are rather small (3 d) and similar to the ones found for snow onset dates (2 d). An analysis of potential sunshine duration could not explain the higher variabilities in spring. To analyse the impact of local-scale variations on the estimation of extreme events, 50-year return levels were quantified for maximum snow depth and maximum 3 d new snow sum, which are often used for avalanche prevention measures. The found return levels are within each other's 95 % confidence intervals for all (but three) station pairs, revealing no striking differences. The findings serve as an important basis for our understanding of variabilities of commonly used snow indicators and extremal indices. Knowledge about such variabilities in combination with break-detection methods is the groundwork in view of any homogenization efforts regarding snow time series.


2021 ◽  
Author(s):  
Moritz Buchmann ◽  
Michael Begert ◽  
Stefan Brönnimann ◽  
Christoph Marty

Abstract. Measurements of snow depth and snowfall on the daily scale can vary strongly over short distances. However, it is not clear if there is a seasonal dependence in these variations and how they impact common snow climate indicators based on mean values, as well as estimated return levels of extreme events based on maximum values. To analyse the impacts of local-scale variations we compiled a unique set of parallel snow measurements from the Swiss Alps consisting of 30 station pairs with up to 77 years of parallel data. Station pairs are mostly located in the same villages (or within 3 km horizontal and 150 m vertical distances). Investigated snow climate indicators include average snow depth, maximum snow depth, sum of new snow, days with snow on the ground, days with snowfall as well as snow onset and disappearance dates, which are calculated for various seasons (December to February (DFJ), November to April (NDJFMA), and March to April (MA)). We computed relative and absolute error metrics for all these indicators at each station pair to demonstrate the potential uncertainty. We found the largest relative inter-pair differences for all indicators in spring (MA) and the smallest in DJF. Furthermore, there is hardly any difference between DJF and NDJFMA which show median uncertainties of less than 5 % for all indicators. Local-scale uncertainty ranges between less than 24 % (DJF) and less than 43 % (MA) for all indicators and 75 % of all station pairs. Highest (lowest) percentage of station pairs with uncertainty less than 15 % is observed for days with snow on the ground with 90 % (average snow depth, 30 %). Median differences of snow disappearance dates are rather small (three days) and similar to the ones found for snow onset dates (two days). An analysis of potential sunshine duration could not explain the higher uncertainties in spring. To analyse the impact of local-scale variations on the estimation of extreme events, 50-year return levels were quantified for maximum snow depth and maximum 3-day new snow sum, which are often used for prevention measures. The found return levels are within each other’s 95 % confidence intervals for all (but two) station pairs, revealing no striking differences. The findings serve as an important basis for our understanding of uncertainties of commonly used snow indicators and extremal indices. Knowledge about such uncertainties in combination with break-detection methods is the groundwork in view of any homogenization efforts regarding snow time series.


2021 ◽  
Author(s):  
Moritz Buchmann ◽  
Michael Begert ◽  
Stefan Brönnimann ◽  
Christoph Marty

<p>Measurements of snow depth and snowfall can vary dramatically over small distances. However, it is not clear if this applies to all derived variables and is the same for all seasons.</p><p>To analyse the impacts of local-scale variations we compiled a unique set of parallel snow measurements for the Swiss Alps consisting of 30 station pairs with up to 50 years of parallel data. Station pairs are mostly located in the same villages or within close proximity (less than 3km horizontally and 100m vertically).</p><p>We calculated a series of snow climate indicators as derived values from the daily snow depth and snowfall measurements for various seasons (DJF, MA, and November-April). Snow climate indicators include average snow depth, max. snow depth, sum of new snow as well as snow onset and disappearance dates. Further, we quantified the return levels of a 10- and 50-year event for max. snow depth and the 3-day new snow sum to investigate the impact of local-scale variations on the estimation of extreme events, which are often used for prevention measures. We computed the relative differences for all these indicators at each station pair to demonstrate the potential uncertainty. <br>To address the local-scale variations of the measurement sites, we calculated the potential sunshine duration for each known location using GIS and a DEM. However, information from metadata (including the exact coordinates) has to be treated with caution as it can be correct, incomplete, incorrect or simply missing at all.</p><p>We found the largest differences for all indicators in spring and the smallest in DJF and Nov-Apr. Furthermore, there is hardly any difference between DJF and Nov-Apr. Surprisingly, median differences of snow disappearance dates are rather small (three days) and similar to the ones found for snow onset dates (two days).<br>We tried to explain the variations of snow disappearance dates with accumulated potential sunshine duration during March and April, however, no clear relationship could be found. This suggests that the potential sunshine duration is not an appropriate proxy for local-scale variations, mainly because vegetation, buildings and the like are not available in a DEM.</p>


2021 ◽  
Vol 72 ◽  
pp. 849-899
Author(s):  
Cynthia Freeman ◽  
Jonathan Merriman ◽  
Ian Beaver ◽  
Abdullah Mueen

The existence of an anomaly detection method that is optimal for all domains is a myth. Thus, there exists a plethora of anomaly detection methods which increases every year for a wide variety of domains. But a strength can also be a weakness; given this massive library of methods, how can one select the best method for their application? Current literature is focused on creating new anomaly detection methods or large frameworks for experimenting with multiple methods at the same time. However, and especially as the literature continues to expand, an extensive evaluation of every anomaly detection method is simply not feasible. To reduce this evaluation burden, we present guidelines to intelligently choose the optimal anomaly detection methods based on the characteristics the time series displays such as seasonality, trend, level change concept drift, and missing time steps. We provide a comprehensive experimental validation and survey of twelve anomaly detection methods over different time series characteristics to form guidelines based on several metrics: the AUC (Area Under the Curve), windowed F-score, and Numenta Anomaly Benchmark (NAB) scoring model. Applying our methodologies can save time and effort by surfacing the most promising anomaly detection methods instead of experimenting extensively with a rapidly expanding library of anomaly detection methods, especially in an online setting.


Vestnik MEI ◽  
2021 ◽  
Vol 3 (3) ◽  
pp. 67-77
Author(s):  
Gennadiy F. Filaretov ◽  
◽  
Zineddin Bouchaala ◽  

The solution of the problem of detecting, in the online mode, a spontaneous change in the probabilistic characteristics (“disorder” or “breakdown”) of a time series is given. It is pointed out that there is a growing interest in the development of so-called nonparametric disorder detection methods, i.e., methods the application of which does not require the knowledge of the probability distribution function of the controlled process values. It is stated that the majority of the known versions of such methods are based on using a number of standard nonparametric criteria transformed for solving disorder detection problems. It is proposed to use the signs criterion, the series criterion, and the Ramachandran–Ranganathan criterion as a basis for construction of disorder detection algorithms. The methodical aspects of studying the statistical properties and efficiency of the disorder detection algorithms built on their basis are considered. The simulation method was used as a study tool. The plan of carrying out simulation experiments was developed separately for each of the proposed algorithms, taking into account their individual characteristics, but based on the general requirement of fully reproducing the monitoring algorithm performance dynamics under real conditions, when a disorder can appear at any time and there is a transient in the values of the decisive function. By using a simulation experiment for each of the algorithms under consideration, data on their statistical characteristics were obtained and systematized in a scope sufficient for synthesizing a monitoring procedure with the specified properties.


2020 ◽  
Vol 9 (s1) ◽  
Author(s):  
Babak Jamshidi ◽  
Shahriar Jamshidi Zargaran ◽  
Mansour Rezaei

AbstractIntroductionTime series models are one of the frequently used methods to describe the pattern of spreading an epidemic.MethodsWe presented a new family of time series models able to represent the cumulative number of individuals that contracted an infectious disease from the start to the end of the first wave of spreading. This family is flexible enough to model the propagation of almost all infectious diseases. After a general discussion on competent time series to model the outbreak of a communicable disease, we introduced the new family through one of its examples.ResultsWe estimated the parameters of two samples of the novel family to model the spreading of COVID-19 in China.DiscussionOur model does not work well when the decreasing trend of the rate of growth is absent because it is the main presumption of the model. In addition, since the information on the initial days is of the utmost importance for this model, one of the challenges about this model is modifying it to get qualified to model datasets that lack the information on the first days.


2021 ◽  
Vol 165 (3-4) ◽  
Author(s):  
Maria Vorkauf ◽  
Christoph Marty ◽  
Ansgar Kahmen ◽  
Erika Hiltbrunner

AbstractThe start of the growing season for alpine plants is primarily determined by the date of snowmelt. We analysed time series of snow depth at 23 manually operated and 15 automatic (IMIS) stations between 1055 and 2555 m asl in the Swiss Central Alps. Between 1958 and 2019, snowmelt dates occurred 2.8 ± 1.3 days earlier in the year per decade, with a strong shift towards earlier snowmelt dates during the late 1980s and early 1990s, but non-significant trends thereafter. Snowmelt dates at high-elevation automatic stations strongly correlated with snowmelt dates at lower-elevation manual stations. At all elevations, snowmelt dates strongly depended on spring air temperatures. More specifically, 44% of the variance in snowmelt dates was explained by the first day when a three-week running mean of daily air temperatures passed a 5 °C threshold. The mean winter snow depth accounted for 30% of the variance. We adopted the effects of air temperature and snowpack height to Swiss climate change scenarios to explore likely snowmelt trends throughout the twenty-first century. Under a high-emission scenario (RCP8.5), we simulated snowmelt dates to advance by 6 days per decade by the end of the century. By then, snowmelt dates could occur one month earlier than during the reference periods (1990–2019 and 2000–2019). Such early snowmelt may extend the alpine growing season by one third of its current duration while exposing alpine plants to shorter daylengths and adding a higher risk of freezing damage.


Water ◽  
2021 ◽  
Vol 13 (13) ◽  
pp. 1723
Author(s):  
Ana Gonzalez-Nicolas ◽  
Marc Schwientek ◽  
Michael Sinsbeck ◽  
Wolfgang Nowak

Currently, the export regime of a catchment is often characterized by the relationship between compound concentration and discharge in the catchment outlet or, more specifically, by the regression slope in log-concentrations versus log-discharge plots. However, the scattered points in these plots usually do not follow a plain linear regression representation because of different processes (e.g., hysteresis effects). This work proposes a simple stochastic time-series model for simulating compound concentrations in a river based on river discharge. Our model has an explicit transition parameter that can morph the model between chemostatic behavior and chemodynamic behavior. As opposed to the typically used linear regression approach, our model has an additional parameter to account for hysteresis by including correlation over time. We demonstrate the advantages of our model using a high-frequency data series of nitrate concentrations collected with in situ analyzers in a catchment in Germany. Furthermore, we identify event-based optimal scheduling rules for sampling strategies. Overall, our results show that (i) our model is much more robust for estimating the export regime than the usually used regression approach, and (ii) sampling strategies based on extreme events (including both high and low discharge rates) are key to reducing the prediction uncertainty of the catchment behavior. Thus, the results of this study can help characterize the export regime of a catchment and manage water pollution in rivers at lower monitoring costs.


Sensors ◽  
2021 ◽  
Vol 21 (10) ◽  
pp. 3536
Author(s):  
Jakub Górski ◽  
Adam Jabłoński ◽  
Mateusz Heesch ◽  
Michał Dziendzikowski ◽  
Ziemowit Dworakowski

Condition monitoring is an indispensable element related to the operation of rotating machinery. In this article, the monitoring system for the parallel gearbox was proposed. The novelty detection approach is used to develop the condition assessment support system, which requires data collection for a healthy structure. The measured signals were processed to extract quantitative indicators sensitive to the type of damage occurring in this type of structure. The indicator’s values were used for the development of four different novelty detection algorithms. Presented novelty detection models operate on three principles: feature space distance, probability distribution, and input reconstruction. One of the distance-based models is adaptive, adjusting to new data flowing in the form of a stream. The authors test the developed algorithms on experimental and simulation data with a similar distribution, using the training set consisting mainly of samples generated by the simulator. Presented in the article results demonstrate the effectiveness of the trained models on both data sets.


2021 ◽  
Vol 13 (15) ◽  
pp. 2869
Author(s):  
MohammadAli Hemati ◽  
Mahdi Hasanlou ◽  
Masoud Mahdianpari ◽  
Fariba Mohammadimanesh

With uninterrupted space-based data collection since 1972, Landsat plays a key role in systematic monitoring of the Earth’s surface, enabled by an extensive and free, radiometrically consistent, global archive of imagery. Governments and international organizations rely on Landsat time series for monitoring and deriving a systematic understanding of the dynamics of the Earth’s surface at a spatial scale relevant to management, scientific inquiry, and policy development. In this study, we identify trends in Landsat-informed change detection studies by surveying 50 years of published applications, processing, and change detection methods. Specifically, a representative database was created resulting in 490 relevant journal articles derived from the Web of Science and Scopus. From these articles, we provide a review of recent developments, opportunities, and trends in Landsat change detection studies. The impact of the Landsat free and open data policy in 2008 is evident in the literature as a turning point in the number and nature of change detection studies. Based upon the search terms used and articles included, average number of Landsat images used in studies increased from 10 images before 2008 to 100,000 images in 2020. The 2008 opening of the Landsat archive resulted in a marked increase in the number of images used per study, typically providing the basis for the other trends in evidence. These key trends include an increase in automated processing, use of analysis-ready data (especially those with atmospheric correction), and use of cloud computing platforms, all over increasing large areas. The nature of change methods has evolved from representative bi-temporal pairs to time series of images capturing dynamics and trends, capable of revealing both gradual and abrupt changes. The result also revealed a greater use of nonparametric classifiers for Landsat change detection analysis. Landsat-9, to be launched in September 2021, in combination with the continued operation of Landsat-8 and integration with Sentinel-2, enhances opportunities for improved monitoring of change over increasingly larger areas with greater intra- and interannual frequency.


Sign in / Sign up

Export Citation Format

Share Document