Scalable Data Processing Approach and Anomaly Detection Method for User and Entity Behavior Analytics Platform

Author(s):  
Alexey Lukashin ◽  
Mikhail Popov ◽  
Anatoliy Bolshakov ◽  
Yuri Nikolashin
2021 ◽  
Vol 2021 ◽  
pp. 1-7
Author(s):  
Xuguang Liu

Aiming at the anomaly detection problem in sensor data, traditional algorithms usually only focus on the continuity of single-source data and ignore the spatiotemporal correlation between multisource data, which reduces detection accuracy to a certain extent. Besides, due to the rapid growth of sensor data, centralized cloud computing platforms cannot meet the real-time detection needs of large-scale abnormal data. In order to solve this problem, a real-time detection method for abnormal data of IoT sensors based on edge computing is proposed. Firstly, sensor data is represented as time series; K-nearest neighbor (KNN) algorithm is further used to detect outliers and isolated groups of the data stream in time series. Secondly, an improved DBSCAN (Density Based Spatial Clustering of Applications with Noise) algorithm is proposed by considering spatiotemporal correlation between multisource data. It can be set according to sample characteristics in the window and overcomes the slow convergence problem using global parameters and large samples, then makes full use of data correlation to complete anomaly detection. Moreover, this paper proposes a distributed anomaly detection model for sensor data based on edge computing. It performs data processing on computing resources close to the data source as much as possible, which improves the overall efficiency of data processing. Finally, simulation results show that the proposed method has higher computational efficiency and detection accuracy than traditional methods and has certain feasibility.


2016 ◽  
Vol 136 (3) ◽  
pp. 363-372
Author(s):  
Takaaki Nakamura ◽  
Makoto Imamura ◽  
Masashi Tatedoko ◽  
Norio Hirai

2015 ◽  
Vol 135 (12) ◽  
pp. 749-755
Author(s):  
Taiyo Matsumura ◽  
Ippei Kamihira ◽  
Katsuma Ito ◽  
Takashi Ono

2013 ◽  
Vol 32 (7) ◽  
pp. 2003-2006
Author(s):  
Kai WEN ◽  
Fan GUO ◽  
Min YU

Author(s):  
Yizhen Sun ◽  
Yiman Xie ◽  
Weiping Wang ◽  
Shigeng Zhang ◽  
Jun Gao ◽  
...  

IEEE Access ◽  
2021 ◽  
Vol 9 ◽  
pp. 28842-28855
Author(s):  
Shaowei Chen ◽  
Meng Wu ◽  
Pengfei Wen ◽  
Fangda Xu ◽  
Shengyue Wang ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document