The Gamma Matrix to Summarize Dense and Sparse Data Sets for Big Data Analytics

2016 ◽  
Vol 28 (7) ◽  
pp. 1905-1918 ◽  
Author(s):  
Carlos Ordonez ◽  
Yiqun Zhang ◽  
Wellington Cabrera
Keyword(s):  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Sparse Data ◽  
Data Sets ◽  
Sparse Data Sets

scholarly journals A multilevel approach to big data analysis using analytic tools and actor network theory

2018 ◽  
Vol 20 (1) ◽  
Author(s):  
Tiko Iyamu
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Network Theory ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Actor Network Theory ◽  
Big Data Analysis ◽  
Data Sets ◽  
Multilevel Approach ◽  
Actor Network

Background: Over the years, big data analytics has been statically carried out in a programmed way, which does not allow for translation of data sets from a subjective perspective. This approach affects an understanding of why and how data sets manifest themselves into various forms in the way that they do. This has a negative impact on the accuracy, redundancy and usefulness of data sets, which in turn affects the value of operations and the competitive effectiveness of an organisation. Also, the current single approach lacks a detailed examination of data sets, which big data deserve in order to improve purposefulness and usefulness.Objective: The purpose of this study was to propose a multilevel approach to big data analysis. This includes examining how a sociotechnical theory, the actor network theory (ANT), can be complementarily used with analytic tools for big data analysis.Method: In the study, the qualitative methods were employed from the interpretivist approach perspective.Results: From the findings, a framework that offers big data analytics at two levels, micro- (strategic) and macro- (operational) levels, was developed. Based on the framework, a model was developed, which can be used to guide the analysis of heterogeneous data sets that exist within networks.Conclusion: The multilevel approach ensures a fully detailed analysis, which is intended to increase accuracy, reduce redundancy and put the manipulation and manifestation of data sets into perspectives for improved organisations’ competitiveness.

Semantic Technologies and Big Data Analytics for Cyber Defence

Web Services ◽  
2019 ◽  
pp. 1430-1443
Author(s):  
Louise Leenen ◽  
Thomas Meyer
Keyword(s):  
Decision Making ◽  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Future Research ◽  
Data Sets ◽  
Semantic Technologies ◽  
Data Types ◽  
Intelligent Decision Making ◽  
Big Data Technologies

The Governments, military forces and other organisations responsible for cybersecurity deal with vast amounts of data that has to be understood in order to lead to intelligent decision making. Due to the vast amounts of information pertinent to cybersecurity, automation is required for processing and decision making, specifically to present advance warning of possible threats. The ability to detect patterns in vast data sets, and being able to understanding the significance of detected patterns are essential in the cyber defence domain. Big data technologies supported by semantic technologies can improve cybersecurity, and thus cyber defence by providing support for the processing and understanding of the huge amounts of information in the cyber environment. The term big data analytics refers to advanced analytic techniques such as machine learning, predictive analysis, and other intelligent processing techniques applied to large data sets that contain different data types. The purpose is to detect patterns, correlations, trends and other useful information. Semantic technologies is a knowledge representation paradigm where the meaning of data is encoded separately from the data itself. The use of semantic technologies such as logic-based systems to support decision making is becoming increasingly popular. However, most automated systems are currently based on syntactic rules. These rules are generally not sophisticated enough to deal with the complexity of decisions required to be made. The incorporation of semantic information allows for increased understanding and sophistication in cyber defence systems. This paper argues that both big data analytics and semantic technologies are necessary to provide counter measures against cyber threats. An overview of the use of semantic technologies and big data technologies in cyber defence is provided, and important areas for future research in the combined domains are discussed.

Big Data Analytics

2019 ◽  
pp. 67-81
Author(s):  
Nitigya Sambyal ◽  
Poonam Saini ◽  
Rupali Syal
Keyword(s):  
Big Data ◽  
Open Problem ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Data Capture ◽  
Data Sets ◽  
Full Potential ◽  
Processing Application ◽  
Nosql Databases ◽  
The World

The world is increasingly driven by huge amounts of data. Big data refers to data sets that are so large or complex that traditional data processing application software are inadequate to deal with them. Healthcare analytics is a prominent area of big data analytics. It has led to significant reduction in morbidity and mortality associated with a disease. In order to harness full potential of big data, various tools like Apache Sentry, BigQuery, NoSQL databases, Hadoop, JethroData, etc. are available for its processing. However, with such enormous amounts of information comes the complexity of data management, other big data challenges occur during data capture, storage, analysis, search, transfer, information privacy, visualization, querying, and update. The chapter focuses on understanding the meaning and concept of big data, analytics of big data, its role in healthcare, various application areas, trends and tools used to process big data along with open problem challenges.

Big Data Storage for the Modeling of Historical Time Series Solar Irradiations

2018 ◽  
pp. 433-463
Author(s):  
Abid Ali ◽  
Nursyarizal Mohd Nor ◽  
Taib Ibrahim ◽  
Mohd Fakhizan Romlie ◽  
Kishore Bingi
Keyword(s):  
Big Data ◽  
Energy Loss ◽  
Data Analytics ◽  
Optimization Problem ◽  
Big Data Analytics ◽  
Distribution Networks ◽  
Data Sets ◽  
Voltage Dependent ◽  
Loss Index ◽  
Bus Voltage

This chapter proposes Big Data Analytics for the sizing and locating of solar photovoltaic farms to reduce the total energy loss in distribution networks. The Big Data Analytics, which uses the advance statistical and computational tools for the handling of large data sets, has been adopted for modeling the 15 years of solar weather data. Total Power Loss Index (TPLI) is formulated as the main objective function for the optimization problem and meanwhile bus voltage deviations and penetrations of the PV farms are calculated. To solve the optimization problem, this study adopts the Mixed Integer Optimization using Genetic Algorithm (MIOGA) technique. By considering different time varying voltage dependent load models, the proposed algorithm is applied on IEEE 33 bus and IEEE 69 bus test distribution networks and optimum results are acquired. From the results, it is revealed that compared to single PV farm, the integration of two PV farms reduced more energy loss and reduced the total size of PV farms. Big Data Analytics is found very effective for the storing, handling, processing and the visualizing of the weather Big Data.

Real Time Analysis Based on Intelligent Applications of Big Data and IoT in Smart Health Care Systems

2020 ◽  
pp. 1839-1857
Author(s):  
Mamata Rath
Keyword(s):  
Health Care ◽  
Big Data ◽  
Data Analytics ◽  
Treatment Plan ◽  
Big Data Analytics ◽  
Data Sets ◽  
Care Services ◽  
Real Time Analysis ◽  
Health Care Applications ◽  
Care Systems

Currently, there is an expanding interest for additional medical data from patients about their healthcare choices and related decisions, and they further need investment in their basic health issues. Big data provides patients presumptuous data to help them settle on the best choice and align with their medicinal treatment plan. One of the very advanced concepts related to the synthesis of big data sets to reveal the hidden pattern in them is big data analytics. It involves demanding techniques to mine and extract relevant data that includes the actions of piercing a database, effectively mine the data, query and inspect the data and is committed to enhance the technical execution of various task segments. The capacity to synthesize a lot of data can enable an association to manage data that can influence the business. In this way, the primary goal of big data analytics is to help business relationships to have enhanced comprehension of data, and subsequently, settle on proficient and very much educated decisions. Big data analytics empowers data diggers and researchers to examine an extensive volume of data that may not be outfit utilizing customary apparatuses. Big data analytics require advances and statistical instruments that can change a lot of organized, unstructured, and semi-organized data into more reasonable data and metadata designed for explanatory procedures. There is tremendous positive potential concerning the application of big data in human health care services and many related major applications are still in their developmental stages. The deployment of big data in health service demonstrates enhancing health care results and controlling the expenses of common people due to treatment, as proven by some developing use cases. Keeping in view such powerful processing capacity of big data analytics in various technical fields of modern civilization related to health care, the current research article presents a comprehensive study and investigation on big data analytics and its application in multiple sectors of society with significance in health care applications.

Introduction to Big Data and Business Analytics

2022 ◽  
pp. 67-76
Author(s):  
Dineshkumar Bhagwandas Vaghela
Keyword(s):  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Data Sets ◽  
Complex Data ◽  
Business Analytics ◽  
Database Applications ◽  
Complex Data Sets ◽  
History Of ◽  
Rapid Generation

The term big data has come due to rapid generation of data in various organizations. In big data, the big is the buzzword. Here the data are so large and complex that the traditional database applications are not able to process (i.e., they are inadequate to deal with such volume of data). Usually the big data are described by 5Vs (volume, velocity, variety, variability, veracity). The big data can be structured, semi-structured, or unstructured. Big data analytics is the process to uncover hidden patterns, unknown correlations, predict the future values from large and complex data sets. In this chapter, the following topics will be covered more in detail. History of big data and business analytics, big data analytics technologies and tools, and big data analytics uses and challenges.

Research Challenges in Big Data Analytics

2017 ◽  
pp. 83-99
Author(s):  
Sivamathi Chokkalingam ◽  
Vijayarani S.
Keyword(s):  
Big Data ◽  
Data Analytics ◽  
Large Scale ◽  
New Technologies ◽  
Big Data Analytics ◽  
Large Data ◽  
Data Sets ◽  
Data Types ◽  
Customer Preferences ◽  
Research Challenges

The term Big Data refers to large-scale information management and analysis technologies that exceed the capability of traditional data processing technologies. Big Data is differentiated from traditional technologies in three ways: volume, velocity and variety of data. Big data analytics is the process of analyzing large data sets which contains a variety of data types to uncover hidden patterns, unknown correlations, market trends, customer preferences and other useful business information. Since Big Data is new emerging field, there is a need for development of new technologies and algorithms for handling big data. The main objective of this paper is to provide knowledge about various research challenges of Big Data analytics. A brief overview of various types of Big Data analytics is discussed in this paper. For each analytics, the paper describes process steps and tools. A banking application is given for each analytics. Some of research challenges and possible solutions for those challenges of big data analytics are also discussed.

scholarly journals An end-to-end Novel Forecasting Model for Crime Prediction based on Big Data

2020 ◽  
Vol 8 (6) ◽  
pp. 3704-3708
Keyword(s):  
Time Series ◽  
Big Data ◽  
Data Analytics ◽  
Linear Time ◽  
Big Data Analytics ◽  
Series Data ◽  
Data Sets ◽  
Data Set ◽  
Main Category ◽  
Crime Prediction

Big data analytics is a field in which we analyse and process information from large or convoluted data sets to be managed by methods of data-processing. Big data analytics is used in analysing the data and helps in predicting the best outcome from the data sets. Big data analytics can be very useful in predicting crime and also gives the best possible solution to solve that crime. In this system we will be using the past crime data set to find out the pattern and through that pattern we will be predicting the range of the incident. The range of the incident will be determined by the decision model and according to the range the prediction will be made. The data sets will be nonlinear and in the form of time series so in this system we will be using the prophet model algorithm which is used to analyse the non-linear time series data. The prophet model categories in three main category and i.e. trends, seasonality, and holidays. This system will help crime cell to predict the possible incident according to the pattern which will be developed by the algorithm and it also helps to deploy right number of resources to the highly marked area where there is a high chance of incidents to occur. The system will enhance the crime prediction system and will help the crime department to use their resources more efficiently.

scholarly journals Big Data on Machine Learning – A Review

2021 ◽  
Vol 8 (3) ◽  
Author(s):  
Balasree K ◽  
Dharmarajan K
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Data Storage ◽  
Data Analytics ◽  
Rapid Development ◽  
Learning Algorithms ◽  
Big Data Analytics ◽  
Machine Learning Algorithms ◽  
Data Sets ◽  
Big Data Technology

In rapid development of Big Data technology over the recent years, this paper discussing about the Machine Learning (ML) playing role that is based on methods and algorithms to Big Data Processing and Big Data Analytics. In evolutionary fields and computing fields of developments that both are complementing each other. Big Data: The rapid growth of such data solutions needed to be studied and provided to handle then to gain the knowledge from datasets and extracting values due to the data sets are very high in velocity and variety. The Big data analytics are involving and indicating the appropriate data storage and computational outline that enhanced by using Scalable Machine Learning Algorithms and Big Data Analytics then the analytics to reveal the massive amounts of hidden data’s and secret correlations. This type of Analytic information useful for organizations and companies to gain deeper knowledge, development and getting advantages over the competition. When using this Analytics we can predict the accurate implementation over the data. This paper presented about the detailed review of state-of-the-art developments and overview of advantages and challenges in Machine Learning Algorithms over big data analytics.

Investigation on Deep Learning Approach for Big Data

2018 ◽  
pp. 25-38
Author(s):  
Dharmendra Singh Rajput ◽  
T. Sunil Kumar Reddy ◽  
Dasari Naga Raju
Keyword(s):  
Big Data ◽  
Deep Learning ◽  
Data Analytics ◽  
Probabilistic Models ◽  
Big Data Analytics ◽  
Data Sets ◽  
Semantic Indexing ◽  
Learning Approaches ◽  
Data Sampling ◽  
Learning Mechanisms

In recent years, big data analytics is the major research area where the researchers are focused. Complex structures are trained at each level to simplify the data abstractions. Deep learning algorithms are one of the promising researches for automation of complex data extraction from large data sets. Deep learning mechanisms produce better results in machine learning, such as computer vision, improved classification modelling, probabilistic models of data samples, and invariant data sets. The challenges handled by the big data are fast information retrieval, semantic indexing, extracting complex patterns, and data tagging. Some investigations are concentrated on integration of deep learning approaches with big data analytics which pose some severe challenges like scalability, high dimensionality, data streaming, and distributed computing. Finally, the chapter concludes by posing some questions to develop the future work in semantic indexing, active learning, semi-supervised learning, domain adaptation modelling, data sampling, and data abstractions.

Sign in / Sign up

Export Citation Format

Share Document