Overview of Big Data and Its Visualization

2022 ◽  
pp. 22-53
Author(s):  
Richard S. Segall ◽  
Gao Niu
Keyword(s):  
Big Data ◽  
Traffic Safety ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Real Data ◽  
Flow Diagram ◽  
Data Sets ◽  
United States Department ◽  
Big Data Visualization ◽  
Challenges And Opportunities

Big Data is data sets that are so voluminous and complex that traditional data processing application software are inadequate to deal with them. This chapter discusses what Big Data is and its characteristics, and how this information revolution of Big Data is transforming our lives and the new technology and methodologies that have been developed to process data of these huge dimensionalities. This chapter discusses the components of the Big Data stack interface, categories of Big Data analytics software and platforms, descriptions of the top 20 Big Data analytics software. Big Data visualization techniques are discussed with real data from fatality analysis reporting system (FARS) managed by National Highway Traffic Safety Administration (NHTSA) of the United States Department of Transportation. Big Data web-based visualization software are discussed that are both JavaScript-based and user-interface-based. This chapter also discusses the challenges and opportunities of using Big Data and presents a flow diagram of the 30 chapters within this handbook.

Overview of Big Data and Its Visualization

2018 ◽  
pp. 1-32 ◽  
Author(s):  
Richard S. Segall ◽  
Gao Niu
Keyword(s):  
Big Data ◽  
Traffic Safety ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Real Data ◽  
Flow Diagram ◽  
Data Sets ◽  
United States Department ◽  
Big Data Visualization ◽  
Challenges And Opportunities

Big Data is data sets that are so voluminous and complex that traditional data processing application software are inadequate to deal with them. This chapter discusses what Big Data is and its characteristics, and how this information revolution of Big Data is transforming our lives and the new technology and methodologies that have been developed to process data of these huge dimensionalities. This chapter discusses the components of the Big Data stack interface, categories of Big Data analytics software and platforms, descriptions of the top 20 Big Data analytics software. Big Data visualization techniques are discussed with real data from fatality analysis reporting system (FARS) managed by National Highway Traffic Safety Administration (NHTSA) of the United States Department of Transportation. Big Data web-based visualization software are discussed that are both JavaScript-based and user-interface-based. This chapter also discusses the challenges and opportunities of using Big Data and presents a flow diagram of the 30 chapters within this handbook.

Big Data and Its Visualization With Fog Computing

2020 ◽  
pp. 341-377
Author(s):  
Richard S. Segall ◽  
Gao Niu
Keyword(s):  
Big Data ◽  
Traffic Safety ◽  
New Technology ◽  
Fog Computing ◽  
Real Data ◽  
The United States ◽  
Data Sets ◽  
United States Department ◽  
Challenges And Opportunities ◽  
Continuous Stream

Big Data is data sets that are so voluminous and complex that traditional data processing application software are inadequate to deal with them. This article discusses what is Big Data, and its characteristics, and how this information revolution of Big Data is transforming our lives and the new technology and methodologies that have been developed to process data of these huge dimensionalities. Big Data can be discrete or a continuous stream of data, and can be accessed using many types and kinds of computing devices ranging from supercomputers, personal work stations, to mobile devices and tablets. Discussion is presented of how fog computing can be performed with cloud computing as a mechanism for visualization of Big Data. An example of visualization techniques for Big Data transmitted by devices connected by Internet of Things (IoT) is presented for real data from fatality analysis reporting system (FARS) managed by the National Highway Traffic Safety Administration (NHTSA) of the United States Department of Transportation (USDoT). Big Data web-based visualization software are discussed that are both JavaScript-based and user interface-based. Challenges and opportunities of using Big Data with fog computing are also discussed.

scholarly journals BIG DATA ANALYSIS IN HEALTH CARE DOMAIN: A SYSTEMATIC REVIEW

2020 ◽  
Vol 5 (2) ◽  
pp. 1-8
Author(s):  
Abhishek Bajpai ◽  
Dr. Sanjiv Sharma
Keyword(s):  
Health Care ◽  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Large Data ◽  
Large Data Sets ◽  
Data Sets ◽  
Healthcare Data ◽  
Challenges And Opportunities ◽  
Business Profit

As the Volume of the data produced is increasing day by day in our society, the exploration of big data in healthcare is increasing at an unprecedented rate. Now days, Big data is very popular buzzword concept in the various areas. This paper provide an effort is made to established that even the healthcare industries are stepping into big data pool to take all advantages from its various advanced tools and technologies. This paper provides the review of various research disciplines made in health care realm using big data approaches and methodologies. Big data methodologies can be used for the healthcare data analytics (which consist 4 V’s) which provide the better decision to accelerate the business profit and customer affection, acquire a better understanding of market behaviours and trends and to provide E-Health services using Digital imaging and communication in Medicine (DICOM).Big data Techniques like Map Reduce, Machine learning can be applied to develop system for early diagnosis of disease, i.e. analysis of the chronic disease like- heart disease, diabetes and stroke. The analysis on the data is performed using big data analytics framework Hadoop. Hadoop framework is used to process large data sets Further the paper present the various Big data tools , challenges and opportunities and various hurdles followed by the conclusion.                                      

scholarly journals A multilevel approach to big data analysis using analytic tools and actor network theory

2018 ◽  
Vol 20 (1) ◽  
Author(s):  
Tiko Iyamu
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Network Theory ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Actor Network Theory ◽  
Big Data Analysis ◽  
Data Sets ◽  
Multilevel Approach ◽  
Actor Network

Background: Over the years, big data analytics has been statically carried out in a programmed way, which does not allow for translation of data sets from a subjective perspective. This approach affects an understanding of why and how data sets manifest themselves into various forms in the way that they do. This has a negative impact on the accuracy, redundancy and usefulness of data sets, which in turn affects the value of operations and the competitive effectiveness of an organisation. Also, the current single approach lacks a detailed examination of data sets, which big data deserve in order to improve purposefulness and usefulness.Objective: The purpose of this study was to propose a multilevel approach to big data analysis. This includes examining how a sociotechnical theory, the actor network theory (ANT), can be complementarily used with analytic tools for big data analysis.Method: In the study, the qualitative methods were employed from the interpretivist approach perspective.Results: From the findings, a framework that offers big data analytics at two levels, micro- (strategic) and macro- (operational) levels, was developed. Based on the framework, a model was developed, which can be used to guide the analysis of heterogeneous data sets that exist within networks.Conclusion: The multilevel approach ensures a fully detailed analysis, which is intended to increase accuracy, reduce redundancy and put the manipulation and manifestation of data sets into perspectives for improved organisations’ competitiveness.

Semantic Technologies and Big Data Analytics for Cyber Defence

Web Services ◽  
2019 ◽  
pp. 1430-1443
Author(s):  
Louise Leenen ◽  
Thomas Meyer
Keyword(s):  
Decision Making ◽  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Future Research ◽  
Data Sets ◽  
Semantic Technologies ◽  
Data Types ◽  
Intelligent Decision Making ◽  
Big Data Technologies

The Governments, military forces and other organisations responsible for cybersecurity deal with vast amounts of data that has to be understood in order to lead to intelligent decision making. Due to the vast amounts of information pertinent to cybersecurity, automation is required for processing and decision making, specifically to present advance warning of possible threats. The ability to detect patterns in vast data sets, and being able to understanding the significance of detected patterns are essential in the cyber defence domain. Big data technologies supported by semantic technologies can improve cybersecurity, and thus cyber defence by providing support for the processing and understanding of the huge amounts of information in the cyber environment. The term big data analytics refers to advanced analytic techniques such as machine learning, predictive analysis, and other intelligent processing techniques applied to large data sets that contain different data types. The purpose is to detect patterns, correlations, trends and other useful information. Semantic technologies is a knowledge representation paradigm where the meaning of data is encoded separately from the data itself. The use of semantic technologies such as logic-based systems to support decision making is becoming increasingly popular. However, most automated systems are currently based on syntactic rules. These rules are generally not sophisticated enough to deal with the complexity of decisions required to be made. The incorporation of semantic information allows for increased understanding and sophistication in cyber defence systems. This paper argues that both big data analytics and semantic technologies are necessary to provide counter measures against cyber threats. An overview of the use of semantic technologies and big data technologies in cyber defence is provided, and important areas for future research in the combined domains are discussed.

Big Data Analytics

2019 ◽  
pp. 67-81
Author(s):  
Nitigya Sambyal ◽  
Poonam Saini ◽  
Rupali Syal
Keyword(s):  
Big Data ◽  
Open Problem ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Data Capture ◽  
Data Sets ◽  
Full Potential ◽  
Processing Application ◽  
Nosql Databases ◽  
The World

The world is increasingly driven by huge amounts of data. Big data refers to data sets that are so large or complex that traditional data processing application software are inadequate to deal with them. Healthcare analytics is a prominent area of big data analytics. It has led to significant reduction in morbidity and mortality associated with a disease. In order to harness full potential of big data, various tools like Apache Sentry, BigQuery, NoSQL databases, Hadoop, JethroData, etc. are available for its processing. However, with such enormous amounts of information comes the complexity of data management, other big data challenges occur during data capture, storage, analysis, search, transfer, information privacy, visualization, querying, and update. The chapter focuses on understanding the meaning and concept of big data, analytics of big data, its role in healthcare, various application areas, trends and tools used to process big data along with open problem challenges.

Big Data Storage for the Modeling of Historical Time Series Solar Irradiations

2018 ◽  
pp. 433-463
Author(s):  
Abid Ali ◽  
Nursyarizal Mohd Nor ◽  
Taib Ibrahim ◽  
Mohd Fakhizan Romlie ◽  
Kishore Bingi
Keyword(s):  
Big Data ◽  
Energy Loss ◽  
Data Analytics ◽  
Optimization Problem ◽  
Big Data Analytics ◽  
Distribution Networks ◽  
Data Sets ◽  
Voltage Dependent ◽  
Loss Index ◽  
Bus Voltage

This chapter proposes Big Data Analytics for the sizing and locating of solar photovoltaic farms to reduce the total energy loss in distribution networks. The Big Data Analytics, which uses the advance statistical and computational tools for the handling of large data sets, has been adopted for modeling the 15 years of solar weather data. Total Power Loss Index (TPLI) is formulated as the main objective function for the optimization problem and meanwhile bus voltage deviations and penetrations of the PV farms are calculated. To solve the optimization problem, this study adopts the Mixed Integer Optimization using Genetic Algorithm (MIOGA) technique. By considering different time varying voltage dependent load models, the proposed algorithm is applied on IEEE 33 bus and IEEE 69 bus test distribution networks and optimum results are acquired. From the results, it is revealed that compared to single PV farm, the integration of two PV farms reduced more energy loss and reduced the total size of PV farms. Big Data Analytics is found very effective for the storing, handling, processing and the visualizing of the weather Big Data.

Real Time Analysis Based on Intelligent Applications of Big Data and IoT in Smart Health Care Systems

2020 ◽  
pp. 1839-1857
Author(s):  
Mamata Rath
Keyword(s):  
Health Care ◽  
Big Data ◽  
Data Analytics ◽  
Treatment Plan ◽  
Big Data Analytics ◽  
Data Sets ◽  
Care Services ◽  
Real Time Analysis ◽  
Health Care Applications ◽  
Care Systems

Currently, there is an expanding interest for additional medical data from patients about their healthcare choices and related decisions, and they further need investment in their basic health issues. Big data provides patients presumptuous data to help them settle on the best choice and align with their medicinal treatment plan. One of the very advanced concepts related to the synthesis of big data sets to reveal the hidden pattern in them is big data analytics. It involves demanding techniques to mine and extract relevant data that includes the actions of piercing a database, effectively mine the data, query and inspect the data and is committed to enhance the technical execution of various task segments. The capacity to synthesize a lot of data can enable an association to manage data that can influence the business. In this way, the primary goal of big data analytics is to help business relationships to have enhanced comprehension of data, and subsequently, settle on proficient and very much educated decisions. Big data analytics empowers data diggers and researchers to examine an extensive volume of data that may not be outfit utilizing customary apparatuses. Big data analytics require advances and statistical instruments that can change a lot of organized, unstructured, and semi-organized data into more reasonable data and metadata designed for explanatory procedures. There is tremendous positive potential concerning the application of big data in human health care services and many related major applications are still in their developmental stages. The deployment of big data in health service demonstrates enhancing health care results and controlling the expenses of common people due to treatment, as proven by some developing use cases. Keeping in view such powerful processing capacity of big data analytics in various technical fields of modern civilization related to health care, the current research article presents a comprehensive study and investigation on big data analytics and its application in multiple sectors of society with significance in health care applications.

Sign in / Sign up

Export Citation Format

Share Document