Real-Time Big Data Warehousing

2019 ◽  
pp. 28-57
Author(s):  
Francisca Vale Lima ◽  
Carlos Costa ◽  
Maribel Yasmina Santos
Keyword(s):  
Decision Making ◽  
Big Data ◽  
Real Time ◽  
Large Volume ◽  
Data Warehousing ◽  
Methodological Approach ◽  
Big Data Analytics ◽  
Data Flows ◽  
Main Components ◽  
Batch Data

The large volume of data that is constantly being generated leads to the need of extracting useful patterns, trends, or insights from this data, raising the interest in business intelligence and big data analytics. The volume, velocity, and variety of data highlight the need for concepts like real-time big data warehouses (RTBDWs). The lack of guidelines or methodological approaches for implementing these systems requires further research in this recent topic. This chapter presents the proposal of a RTBDW architecture that includes the main components and data flows needed to collect, process, store, and analyze the available data, integrating streaming with batch data and enabling real-time decision making. Using Twitter data, several technologies were evaluated to understand their performance. The obtained results were satisfactory and allowed the identification of a methodological approach that can be followed for the implementation of this type of system.

scholarly journals Big Data Analytics Embedded Smart City Architecture for Performance Enhancement through Real-Time Data Processing and Decision-Making

2017 ◽  
Vol 2017 ◽  
pp. 1-12 ◽  
Author(s):  
Bhagya Nathali Silva ◽  
Murad Khan ◽  
Kijun Han
Keyword(s):  
Decision Making ◽  
Big Data ◽  
Data Processing ◽  
Real Time ◽  
Smart City ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Time Data ◽  
Real Time Data ◽  
Real Time Data Processing

The concept of the smart city is widely favored, as it enhances the quality of life of urban citizens, involving multiple disciplines, that is, smart community, smart transportation, smart healthcare, smart parking, and many more. Continuous growth of the complex urban networks is significantly challenged by real-time data processing and intelligent decision-making capabilities. Therefore, in this paper, we propose a smart city framework based on Big Data analytics. The proposed framework operates on three levels: (1) data generation and acquisition level collecting heterogeneous data related to city operations, (2) data management and processing level filtering, analyzing, and storing data to make decisions and events autonomously, and (3) application level initiating execution of the events corresponding to the received decisions. In order to validate the proposed architecture, we analyze a few major types of dataset based on the proposed three-level architecture. Further, we tested authentic datasets on Hadoop ecosystem to determine the threshold and the analysis shows that the proposed architecture offers useful insights into the community development authorities to improve the existing smart city architecture.

Examining the potential of textual big data analytics for public policy decision-making: A case study with driverless cars in Denmark

2020 ◽  
Vol 98 ◽  
pp. 68-78 ◽  
Author(s):  
Aseem Kinra ◽  
Samaneh Beheshti-Kashi ◽  
Rasmus Buch ◽  
Thomas Alexander Sick Nielsen ◽  
Francisco Pereira
Keyword(s):  
Public Policy ◽  
Decision Making ◽  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Policy Decision ◽  
Driverless Cars ◽  
Policy Decision Making

scholarly journals Light-Weight, Self-Powered Sensor Based on Triboelectric Nanogenerator for Big Data Analytics in Sports

Electronics ◽  
2021 ◽  
Vol 10 (19) ◽  
pp. 2322
Author(s):  
Xiaofei Ma ◽  
Xuan Liu ◽  
Xinxing Li ◽  
Yunfei Ma
Keyword(s):  
Big Data ◽  
Real Time ◽  
Data Analytics ◽  
Mechanical Energy ◽  
Rapid Development ◽  
Big Data Analytics ◽  
Triboelectric Nanogenerator ◽  
Light Weight ◽  
Table Tennis ◽  
Self Powered

With the rapid development of the Internet of Things (IoTs), big data analytics has been widely used in the sport field. In this paper, a light-weight, self-powered sensor based on a triboelectric nanogenerator for big data analytics in sports has been demonstrated. The weight of each sensing unit is ~0.4 g. The friction material consists of polyaniline (PANI) and polytetrafluoroethylene (PTFE). Based on the triboelectric nanogenerator (TENG), the device can convert small amounts of mechanical energy into the electrical signal, which contains information about the hitting position and hitting velocity of table tennis balls. By collecting data from daily table tennis training in real time, the personalized training program can be adjusted. A practical application has been exhibited for collecting table tennis information in real time and, according to these data, coaches can develop personalized training for an amateur to enhance the ability of hand control, which can improve their table tennis skills. This work opens up a new direction in intelligent athletic facilities and big data analytics.

Sign in / Sign up

Export Citation Format

Share Document