Local outlier detection based on information entropy weighting

2019 ◽  
Vol 30 (4) ◽  
pp. 207
Author(s):  
Lina Wang ◽  
Chao Feng ◽  
Yongjun Ren ◽  
Jinyue Xia
Keyword(s):  
Outlier Detection ◽  
Information Entropy ◽  
Local Outlier

scholarly journals Outlier Detection Method for Flash Flood Disaster Monitoring Data based on Information Entropy

2021 ◽  
Vol 2138 (1) ◽  
pp. 012013
Author(s):  
Yongzhi Chen ◽  
Ziao Xu ◽  
Chaoqun Niu
Keyword(s):  
Outlier Detection ◽  
Information Entropy ◽  
Detection Method ◽  
Flash Flood ◽  
False Positive Rate ◽  
Flood Disaster ◽  
Detection Methods ◽  
Positive Rate ◽  
Disaster Monitoring ◽  
Local Outlier

Abstract In the research of flash flood disaster monitoring and early warning, the Internet of Things is widely used in real-time information collection. There are abnormal situations such as noise, repetition and errors in a large amount of data collected by sensors, which will lead to false alarm, lower prediction accuracy and other problems. Aiming at the characteristic that outliers flow of sensors will cause obvious fluctuation of information entropy, this paper proposes a local outlier detection method based on information entropy and optimized by sliding window and LOF (Local Outlier Factor). This method can be used to improve the data quality, thus improving the accuracy of disaster prediction. The method is applied to data stream processing of water sensor, and the experimental results show that the method can accurately detect outliers. Compared with the existing detection methods that only use data distance to determine, the test positive rate is improved and the false positive rate is reduced.

scholarly journals SDCOR: Scalable density-based clustering for local outlier detection in massive-scale datasets

2021 ◽  
pp. 107256
Author(s):  
Sayyed Ahmad Naghavi Nozad ◽  
Maryam Amir Haeri ◽  
Gianluigi Folino
Keyword(s):  
Outlier Detection ◽  
Density Based Clustering ◽  
Massive Scale ◽  
Local Outlier

Scalable KDE-based top-n local outlier detection over large-scale data streams

2020 ◽  
Vol 204 ◽  
pp. 106186 ◽  
Author(s):  
Fang Liu ◽  
Yanwei Yu ◽  
Peng Song ◽  
Yangyang Fan ◽  
Xiangrong Tong
Keyword(s):  
Outlier Detection ◽  
Data Streams ◽  
Large Scale ◽  
Large Scale Data ◽  
Scale Data ◽  
Local Outlier

Optimal KD-Partitioning for the Local Outlier Detection in Geo-Social Points

2017 ◽  
pp. 104-112
Author(s):  
Teerawat Kumrai ◽  
Kyoung-Sook Kim ◽  
Mianxiong Dong ◽  
Hirotaka Ogawa
Keyword(s):  
Outlier Detection ◽  
Local Outlier

An efficient local outlier detection optimized by rough clustering

2021 ◽  
pp. 1-12
Author(s):  
Chunyan She ◽  
Shaohua Zeng
Keyword(s):  
Outlier Detection ◽  
False Positive Rate ◽  
Time Cost ◽  
Local Distribution ◽  
Running Speed ◽  
Local Outlier Factor ◽  
Real World Applications ◽  
Positive Rate ◽  
Nearest Neighborhood ◽  
Local Outlier

Outlier detection is a hot issue in data mining, which has plenty of real-world applications. LOF (Local Outlier Factor) can capture the abnormal degree of objects in the dataset with different density levels, and many extended algorithms have been proposed in recent years. However, the LOF needs to search the nearest neighborhood of each object on the whole dataset, which greatly increases the time cost. Most of these extended algorithms only consider the distance between an object and its neighborhood, but ignore the local distribution of an object within its neighborhood, resulting in a high false-positive rate. To improve the running speed, a rough clustering based on triple fusion is proposed, which divides a dataset into several subsets and outlier detection is performed only on each subset. Then, considering the local distribution of an object within its neighborhood, a new local outlier factor is constructed to estimate the abnormal degree of each object. Finally, the experimental results indicate that the proposed algorithm has better performance and lower running time than the others.

Sign in / Sign up

Export Citation Format

Share Document