Data streams anomaly detection algorithm based on self-set threshold

Author(s):  
Luo Yuanyan ◽  
Du Xuehui ◽  
Sun Yi
Entropy ◽  
2021 ◽  
Vol 23 (8) ◽  
pp. 1093
Author(s):  
Guang Li ◽  
Jing Liang ◽  
Caitong Yue

Trend anomaly detection is the practice of comparing and analyzing current and historical data trends to detect real-time abnormalities in online industrial data-streams. It has the advantages of tracking a concept drift automatically and predicting trend changes in the shortest time, making it important both for algorithmic research and industry. However, industrial data streams contain considerable noise that interferes with detecting weak anomalies. In this paper, the fastest detection algorithm “sliding nesting” is adopted. It is based on calculating the data weight in each window by applying variable weights, while maintaining the method of trend-effective integration accumulation. The new algorithm changes the traditional calculation method of the trend anomaly detection score, which calculates the score in a short window. This algorithm, SNWFD–DS, can detect weak trend abnormalities in the presence of noise interference. Compared with other methods, it has significant advantages. An on-site oil drilling data test shows that this method can significantly reduce delays compared with other methods and can improve the detection accuracy of weak trend anomalies under noise interference.


Author(s):  
Guangjun Wu ◽  
Zhihui Zhao ◽  
Ge Fu ◽  
Haiping Wang ◽  
Yong Wang ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document