Streaming data anomaly detection method based on hyper-grid structure and online ensemble learning

2016 ◽  
Vol 21 (20) ◽  
pp. 5905-5917 ◽  
Author(s):  
Zhiguo Ding ◽  
Minrui Fei ◽  
Dajun Du ◽  
Fan Yang
Author(s):  
Zhiguo Ding ◽  
Minrui Fei ◽  
Dajun Du

Online anomaly detection for stream data has been explored recently, where the detector is supposed to be able to perform an accurate and timely judgment for the upcoming observation. However, due to the inherent complex characteristics of stream data, such as quick generation, tremendous volume and dynamic evolution distribution, how to develop an effective online anomaly detection method is a challenge. The main objective of this paper is to propose an adaptive online anomaly detection method for stream data. This is achieved by combining isolation principle with online ensemble learning, which is then optimized by statistic histogram. Three main algorithms are developed, i.e., online detector building algorithm, anomaly detecting algorithm and adaptive detector updating algorithm. To evaluate our proposed method, four massive datasets from the UCI machine learning repository recorded from real events were adopted. Extensive simulations based on these datasets show that our method is effective and robust against different scenarios.


2016 ◽  
Vol 136 (3) ◽  
pp. 363-372
Author(s):  
Takaaki Nakamura ◽  
Makoto Imamura ◽  
Masashi Tatedoko ◽  
Norio Hirai

2015 ◽  
Vol 135 (12) ◽  
pp. 749-755
Author(s):  
Taiyo Matsumura ◽  
Ippei Kamihira ◽  
Katsuma Ito ◽  
Takashi Ono

2013 ◽  
Vol 32 (7) ◽  
pp. 2003-2006
Author(s):  
Kai WEN ◽  
Fan GUO ◽  
Min YU

Author(s):  
Yizhen Sun ◽  
Yiman Xie ◽  
Weiping Wang ◽  
Shigeng Zhang ◽  
Jun Gao ◽  
...  

IEEE Access ◽  
2021 ◽  
Vol 9 ◽  
pp. 28842-28855
Author(s):  
Shaowei Chen ◽  
Meng Wu ◽  
Pengfei Wen ◽  
Fangda Xu ◽  
Shengyue Wang ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document