A Study of Apache Kafka in Big Data Stream Processing

2018 ◽  
Author(s):  
Bhole Rahul Hiraman ◽  
Chapte Viresh M. ◽  
Karve Abhijeet C.
Keyword(s):  
Big Data ◽  
Data Stream ◽  
Stream Processing ◽  
Data Stream Processing

scholarly journals A Survey on Data Analysis on Large-Scale Wireless Networks: Online Stream Processing, Trends, and Challenges

2020 ◽  
Author(s):  
Dianne Scherly Varela de Medeiros ◽  
Helio do Nascimento Cunha Neto ◽  
Martin Andreoni Lopez ◽  
Luiz Claudio Schara Magalhães ◽  
Natalia Castro Fernandes ◽  
...  
Keyword(s):  
Machine Learning ◽  
Wireless Networks ◽  
Big Data ◽  
Wireless Network ◽  
Data Stream ◽  
Large Scale ◽  
Stream Processing ◽  
Knowledge Extraction ◽  
Machine Learning Algorithms ◽  
Data Stream Processing

Abstract In this paper we focus on knowledge extraction from large-scale wireless networks through stream processing. We present the primary methods for sampling, data collection, and monitoring of wireless networks and we characterize knowledge extraction as a machine learning problem on big data stream processing. We show the main trends in big data stream processing frameworks. Additionally, we explore the data preprocessing, feature engineering, and the machine learning algorithms applied to the scenario of wireless network analytics. We address challenges and present research projects in wireless network monitoring and stream processing. Finally, future perspectives, such as deep learning and reinforcement learning in stream processing, are anticipated.

Sign in / Sign up

Export Citation Format

Share Document