Implementation of Infrastructure for Streaming Outlier Detection in Big Data

2017 ◽  
pp. 503-511 ◽  
Author(s):  
Zirije Hasani
Keyword(s):  
Big Data ◽  
Outlier Detection

Hilbert Index-based Outlier Detection Algorithm in Metric Space

2016 ◽  
Vol 8 (4) ◽  
pp. 34-54
Author(s):  
Honglong Xu ◽  
Haiwu Rong ◽  
Rui Mao ◽  
Guoliang Chen ◽  
Zhiguang Shan
Keyword(s):  
Big Data ◽  
Data Management ◽  
Outlier Detection ◽  
Metric Space ◽  
Detection Algorithm ◽  
Analysis Framework ◽  
Distance Calculation ◽  
The World ◽  
Speed Up ◽  
Detection Speed

Big data is profoundly changing the lifestyles of people around the world in an unprecedented way. Driven by the requirements of applications across many industries, research on big data has been growing. Methods to manage and analyze big data to extract valuable information are the key of big data research. Starting from the variety challenge of big data, this dissertation proposes a universal big data management and analysis framework based on metric space. In this framework, the Hilbert Index-based Outlier Detection (HIOD) algorithm is proposed. HIOD can handle all datatypes that can be abstracted to metric space and achieve higher detection speed. Experimental results indicate that HIOD can effectively overcome the variety challenge of big data and achieves a 2.02 speed up over iORCA on average and, in certain cases, up to 5.57. The distance calculation times are reduced by 47.57% on average and up to 89.10%.

Research on real-time outlier detection over big data streams

2017 ◽  
Vol 42 (1) ◽  
pp. 93-101
Author(s):  
Liangchen Chen ◽  
Shu Gao ◽  
Xiufeng Cao
Keyword(s):  
Big Data ◽  
Real Time ◽  
Outlier Detection ◽  
Data Streams ◽  
Big Data Streams

Big data driven outlier detection for soybean straw near infrared spectroscopy

2018 ◽  
Vol 26 ◽  
pp. 178-189 ◽  
Author(s):  
Yan Wang ◽  
Qingfen Liu ◽  
Han-dan Hou ◽  
Seungmin Rho ◽  
Brij Gupta ◽  
...  
Keyword(s):  
Big Data ◽  
Infrared Spectroscopy ◽  
Outlier Detection ◽  
Near Infrared Spectroscopy ◽  
Near Infrared ◽  
Data Driven ◽  
Soybean Straw
Sign in / Sign up

Export Citation Format

Share Document