Data stream mining based real-time highspeed traffic classification

Author(s):  
Guo Mingliang ◽  
Huang Xiaohong ◽  
Tian Xu ◽  
Ma Yan ◽  
Wang Zhenhua
Author(s):  
Prasanna Lakshmi Kompalli

Data coming from different sources is referred to as data streams. Data stream mining is an online learning technique where each data point must be processed as the data arrives and discarded as the processing is completed. Progress of technologies has resulted in the monitoring these data streams in real time. Data streams has created many new challenges to the researchers in real time. The main features of this type of data are they are fast flowing, large amounts of data which are continuous and growing in nature, and characteristics of data might change in course of time which is termed as concept drift. This chapter addresses the problems in mining data streams with concept drift. Due to which, isolating the correct literature would be a grueling task for researchers and practitioners. This chapter tries to provide a solution as it would be an amalgamation of all techniques used for data stream mining with concept drift.


2017 ◽  
pp. 1-1 ◽  
Author(s):  
Simon Fong ◽  
Jinan Fiaidhi ◽  
Sabah Mohammed ◽  
Luiz Moutinho

2015 ◽  
Vol 5 (5) ◽  
pp. 1108-1115 ◽  
Author(s):  
Simon Fong ◽  
Shirley W. I. Siu ◽  
Suzy Zhou ◽  
Jonathan H. Chan ◽  
Sabah Mohammed ◽  
...  

2016 ◽  
Vol 2016 ◽  
pp. 1-13 ◽  
Author(s):  
H. R. Loo ◽  
S. B. Joseph ◽  
M. N. Marsono

Data stream mining techniques are able to classify evolving data streams such as network traffic in the presence of concept drift. In order to classify high bandwidth network traffic in real-time, data stream mining classifiers need to be implemented on reconfigurable high throughput platform, such as Field Programmable Gate Array (FPGA). This paper proposes an algorithm for online network traffic classification based on the concept of incrementalk-means clustering to continuously learn from both labeled and unlabeled flow instances. Two distance measures for incrementalk-means (Euclidean and Manhattan) distance are analyzed to measure their impact on the network traffic classification in the presence of concept drift. The experimental results on real datasets show that the proposed algorithm exhibits consistency, up to 94% average accuracy for both distance measures, even in the presence of concept drifts. The proposed incrementalk-means classification using Manhattan distance can classify network traffic 3 times faster than Euclidean distance at 671 thousands flow instances per second.


Sign in / Sign up

Export Citation Format

Share Document