Efficient Outlier Detection Algorithm for Heterogeneous Data Streams

Author(s):  
Jiadong Ren ◽  
Qunhui Wu ◽  
Jia Zhang ◽  
Changzhen Hu
2016 ◽  
Vol 12 (1) ◽  
pp. 35 ◽  
Author(s):  
Li Lian Sheng

Nowadays, Radio frequency identification (RFID) has been extensively deployed to retailing, supply chain management, object recognition, object monitoring and tracking and many other fields. Detecting outliers in RFID data streams can help us find abnormal activities and thus avoid disasters. In order to detect outliers in RFID data streams efficiently and effectively, we proposed a fractal based outlier detection algorithm. Firstly, we built a monotone searching space based on the self-similarity of fractal. Then, we proposed two piecewise fractal models for RFID data streams, and presented an outlier detection algorithm based on the piecewise fractal model. Finally, we validated the efficiency and effectiveness of the proposed algorithm by massive experiments.


Author(s):  
ZhongYu Zhou ◽  
DeChang Pi

Outlier detection is a common method for analyzing data streams. In the existing outlier detection methods, most of methods compute distance of points to solve certain specific outlier detection problems. However, these methods are computationally expensive and cannot process data streams quickly. The outlier detection method based on pattern mining resolves the aforementioned issues, but the existing methods are inefficient and cannot meet requirements of quickly mining data streams. In order to improve the efficiency of the method, a new outlier detection method is proposed in this paper. First, a fast minimal infrequent pattern mining method is proposed to mine the minimal infrequent pattern from data streams. Second, an efficient outlier detection algorithm based on minimal infrequent pattern is proposed for detecting the outliers in the data streams by mining minimal infrequent pattern. The algorithm proposed in this paper is demonstrated by real telemetry data of a satellite in orbit. The experimental results show that the proposed method not only can be applied to satellite outlier detection, but also is superior to the existing methods.


IEEE Access ◽  
2021 ◽  
Vol 9 ◽  
pp. 43271-43284
Author(s):  
Xite Wang ◽  
Jiafan Li ◽  
Mei Bai ◽  
Qian Ma

2021 ◽  
pp. 1-10
Author(s):  
Xuying Sun ◽  
Yu Zhang

The importance of the management of ideological and political theory courses in colleges and universities is objective to the importance of ideological and political theory courses. At present, the management of ideological and political theory courses in colleges and universities has big problems in both macro and micro aspects. This paper combines artificial intelligence technology to build an intelligent management system for ideological and political education in colleges and universities based on artificial intelligence, and conducts classroom supervision through intelligent recognition of student status. The KNN outlier detection algorithm based on KD-Tree is proposed to extract the state information of class students. Through data simulation, it can be known that the KD-KNN outlier detection algorithm proposed in this paper significantly improves the efficiency of the algorithm while ensuring the accuracy of the KNN algorithm classification. Through experimental research, it can be seen that the construction of this system not only clarifies the direction of management from a macro perspective, but also reveals specific methods of management from a micro perspective, and to a certain extent effectively solves the problems in the management of ideological and political theory courses in colleges and universities.


Sign in / Sign up

Export Citation Format

Share Document