CELL: Counter Estimation for Per-flow Traffic in Streams and Sliding Windows

Author(s):  
Rana Shahout ◽  
Roy Friedman ◽  
Dolev Adas
Keyword(s):  
2020 ◽  
Author(s):  
Bo Zhang ◽  
Hongyu Zhang ◽  
Pablo Moscato

<div>Complex software intensive systems, especially distributed systems, generate logs for troubleshooting. The logs are text messages recording system events, which can help engineers determine the system's runtime status. This paper proposes a novel approach named ADR (stands for Anomaly Detection by workflow Relations) that employs matrix nullspace to mine numerical relations from log data. The mined relations can be used for both offline and online anomaly detection and facilitate fault diagnosis. We have evaluated ADR on log data collected from two distributed systems, HDFS (Hadoop Distributed File System) and BGL (IBM Blue Gene/L supercomputers system). ADR successfully mined 87 and 669 numerical relations from the logs and used them to detect anomalies with high precision and recall. For online anomaly detection, ADR employs PSO (Particle Swarm Optimization) to find the optimal sliding windows' size and achieves fast anomaly detection.</div><div>The experimental results confirm that ADR is effective for both offline and online anomaly detection. </div>


2020 ◽  
pp. 1-17
Author(s):  
Haiying Liu ◽  
Jingqi Wang ◽  
Jianxin Feng ◽  
Xinyao Wang

Abstract Visual–Inertial Navigation Systems (VINS) plays an important role in many navigation applications. In order to improve the performance of VINS, a new visual/inertial integrated navigation method, named Sliding-Window Factor Graph optimised algorithm with Dynamic prior information (DSWFG), is proposed. To bound computational complexity, the algorithm limits the scale of data operations through sliding windows, and constructs the states to be optimised in the window with factor graph; at the same time, the prior information for sliding windows is set dynamically to maintain interframe constraints and ensure the accuracy of the state estimation after optimisation. First, the dynamic model of vehicle and the observation equation of VINS are introduced. Next, as a contrast, an Invariant Extended Kalman Filter (InEKF) is constructed. Then, the DSWFG algorithm is described in detail. Finally, based on the test data, the comparison experiments of Extended Kalman Filter (EKF), InEKF and DSWFG algorithms in different motion scenes are presented. The results show that the new method can achieve superior accuracy and stability in almost all motion scenes.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Halit Cinarka ◽  
Mehmet Atilla Uysal ◽  
Atilla Cifter ◽  
Elif Yelda Niksarlioglu ◽  
Aslı Çarkoğlu

AbstractThis study aims to evaluate the monitoring and predictive value of web-based symptoms (fever, cough, dyspnea) searches for COVID-19 spread. Daily search interests from Turkey, Italy, Spain, France, and the United Kingdom were obtained from Google Trends (GT) between January 1, 2020, and August 31, 2020. In addition to conventional correlational models, we studied the time-varying correlation between GT search and new case reports; we used dynamic conditional correlation (DCC) and sliding windows correlation models. We found time-varying correlations between pulmonary symptoms on GT and new cases to be significant. The DCC model proved more powerful than the sliding windows correlation model. This model also provided better at time-varying correlations (r ≥ 0.90) during the first wave of the pandemic. We used a root means square error (RMSE) approach to attain symptom-specific shift days and showed that pulmonary symptom searches on GT should be shifted separately. Web-based search interest for pulmonary symptoms of COVID-19 is a reliable predictor of later reported cases for the first wave of the COVID-19 pandemic. Illness-specific symptom search interest on GT can be used to alert the healthcare system to prepare and allocate resources needed ahead of time.


Sign in / Sign up

Export Citation Format

Share Document