Big data analytics for proactive industrial decision support

atp magazin ◽  
2016 ◽  
Vol 58 (09) ◽  
pp. 62 ◽  
Author(s):  
Martin Atzmueller ◽  
Benjamin Klöpper ◽  
Hassan Al Mawla ◽  
Benjamin Jäschke ◽  
Martin Hollender ◽  
...  
Keyword(s):  
Big Data ◽  
Data Analytics ◽  
Historical Data ◽  
Big Data Analytics ◽  
Lessons Learned ◽  
Support Functions ◽  
Big Data Applications ◽  
Big Data Technologies ◽  
Process Plants ◽  
Plant Data

Big data technologies offer new opportunities for analyzing historical data generated by process plants. The development of new types of operator support systems (OSS) which help the plant operators during operations and in dealing with critical situations is one of these possibilities. The project FEE has the objective to develop such support functions based on big data analytics of historical plant data. In this contribution, we share our first insights and lessons learned in the development of big data applications and outline the approaches and tools that we developed in the course of the project.

Semantic Technologies and Big Data Analytics for Cyber Defence

Web Services ◽  
2019 ◽  
pp. 1430-1443
Author(s):  
Louise Leenen ◽  
Thomas Meyer
Keyword(s):  
Decision Making ◽  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Future Research ◽  
Data Sets ◽  
Semantic Technologies ◽  
Data Types ◽  
Intelligent Decision Making ◽  
Big Data Technologies

The Governments, military forces and other organisations responsible for cybersecurity deal with vast amounts of data that has to be understood in order to lead to intelligent decision making. Due to the vast amounts of information pertinent to cybersecurity, automation is required for processing and decision making, specifically to present advance warning of possible threats. The ability to detect patterns in vast data sets, and being able to understanding the significance of detected patterns are essential in the cyber defence domain. Big data technologies supported by semantic technologies can improve cybersecurity, and thus cyber defence by providing support for the processing and understanding of the huge amounts of information in the cyber environment. The term big data analytics refers to advanced analytic techniques such as machine learning, predictive analysis, and other intelligent processing techniques applied to large data sets that contain different data types. The purpose is to detect patterns, correlations, trends and other useful information. Semantic technologies is a knowledge representation paradigm where the meaning of data is encoded separately from the data itself. The use of semantic technologies such as logic-based systems to support decision making is becoming increasingly popular. However, most automated systems are currently based on syntactic rules. These rules are generally not sophisticated enough to deal with the complexity of decisions required to be made. The incorporation of semantic information allows for increased understanding and sophistication in cyber defence systems. This paper argues that both big data analytics and semantic technologies are necessary to provide counter measures against cyber threats. An overview of the use of semantic technologies and big data technologies in cyber defence is provided, and important areas for future research in the combined domains are discussed.

Big Data Analytics in Aquaculture Using Hive and Hadoop Platform

2018 ◽  
pp. 29-35
Author(s):  
P. Venkateswara Rao ◽  
A. Ramamohan Reddy ◽  
V. Sucharita
Keyword(s):  
Big Data ◽  
Data Management ◽  
Single Machine ◽  
Data Analytics ◽  
Historical Data ◽  
Big Data Analytics ◽  
Huge Amount ◽  
Hadoop Platform ◽  
Different Sources

In the field of Aquaculture with the help of digital advancements huge amount of data is constantly produced for which the data of the aquaculture has entered in the big data world. The requirement for data management and analytics model is increased as the development progresses. Therefore, all the data cannot be stored on single machine. There is need for solution that stores and analyzes huge amounts of data which is nothing but Big Data. In this chapter a framework is developed that provides a solution for shrimp disease by using historical data based on Hive and Hadoop. The data regarding shrimps is acquired from different sources like aquaculture websites, various reports of laboratory etc. The noise is removed after the collection of data from various sources. Data is to be uploaded on HDFS after normalization is done and is to be put in a file that supports Hive. Finally classified data will be located in particular place. Based on the features extracted from aquaculture data, HiveQL can be used to analyze shrimp diseases symptoms.

Importance of Big Data and Hadoop in E-Servicing

2018 ◽  
pp. 39-52
Author(s):  
Karthiga Shankar ◽  
Suganya R.
Keyword(s):  
Big Data ◽  
Data Analytics ◽  
Opinion Mining ◽  
Big Data Analytics ◽  
Online Information ◽  
Campaign Strategies ◽  
Security Issues ◽  
Customer Group ◽  
Big Data Applications ◽  
The Web

Consumers are spending more and more time on the web to search information and receive e-services. E-commerce, e-government, e-business, e-learning, e-science, etc. reflect the growing importance of the web in all aspects of our lives. Along with the tremendous growth of online information, the use of big data has become a vital force in growing revenues. Consumers are today shopping multiple products across multiple channels online. This transformation is substantial and many of the e-commerce companies have now turned to big data analytics for focused customer group targeting using opinion mining for evaluating campaign strategies and maintaining a competitive advantage, especially during the festive shopping season. So, the role of intelligent techniques in e-servicing is massive. This chapter focuses on the importance of big data (since there is a large volume of data online) and big data analytics in the field of e-servicing and explains the various applications, platforms to implement the big data applications, and security issues in the era of big data and e-servicing.

Big Data Applications in Healthcare

Big Data ◽  
2016 ◽  
pp. 1247-1259 ◽  
Author(s):  
Jayanthi Ranjan
Keyword(s):  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Healthcare Industry ◽  
Big Data Applications ◽  
Business Functions ◽  
Automated Algorithms ◽  
Almost All ◽  
Tools And Techniques ◽  
Research Centres

Big data is in every industry. It is being utilized in almost all business functions within these industries. Basically, it creates value by converting human decisions into transformed automated algorithms using various tools and techniques. In this chapter, the authors look towards big data analytics from the healthcare perspective. Healthcare involves the whole supply chain of industries from the pharmaceutical companies to the clinical research centres, from the hospitals to individual physicians, and anyone who is involved in the medical arena right from the supplier to the consumer (i.e. the patient). The authors explore the growth of big data analytics in the healthcare industry including its limitations and potential.

Importance of Big Data and Hadoop in E-Servicing

2022 ◽  
pp. 1634-1644
Author(s):  
Karthiga Shankar ◽  
Suganya R.
Keyword(s):  
Big Data ◽  
Data Analytics ◽  
Opinion Mining ◽  
Big Data Analytics ◽  
Online Information ◽  
Campaign Strategies ◽  
Security Issues ◽  
Customer Group ◽  
Big Data Applications ◽  
The Web

Consumers are spending more and more time on the web to search information and receive e-services. E-commerce, e-government, e-business, e-learning, e-science, etc. reflect the growing importance of the web in all aspects of our lives. Along with the tremendous growth of online information, the use of big data has become a vital force in growing revenues. Consumers are today shopping multiple products across multiple channels online. This transformation is substantial and many of the e-commerce companies have now turned to big data analytics for focused customer group targeting using opinion mining for evaluating campaign strategies and maintaining a competitive advantage, especially during the festive shopping season. So, the role of intelligent techniques in e-servicing is massive. This chapter focuses on the importance of big data (since there is a large volume of data online) and big data analytics in the field of e-servicing and explains the various applications, platforms to implement the big data applications, and security issues in the era of big data and e-servicing.

IoT Based Agriculture as a Cloud and Big Data Service

2020 ◽  
pp. 1499-1521
Author(s):  
Sukhpal Singh Gill ◽  
Inderveer Chana ◽  
Rajkumar Buyya
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Cloud Services ◽  
Cloud Environment ◽  
Big Data Technologies ◽  
Sensor Networking ◽  
New Applications

Cloud computing has transpired as a new model for managing and delivering applications as services efficiently. Convergence of cloud computing with technologies such as wireless sensor networking, Internet of Things (IoT) and Big Data analytics offers new applications' of cloud services. This paper proposes a cloud-based autonomic information system for delivering Agriculture-as-a-Service (AaaS) through the use of cloud and big data technologies. The proposed system gathers information from various users through preconfigured devices and IoT sensors and processes it in cloud using big data analytics and provides the required information to users automatically. The performance of the proposed system has been evaluated in Cloud environment and experimental results show that the proposed system offers better service and the Quality of Service (QoS) is also better in terms of QoS parameters.

scholarly journals A Big Data Analytics Approach for the Development of Advanced Cardiology Applications

Information ◽  
2020 ◽  
Vol 11 (2) ◽  
pp. 60 ◽  
Author(s):  
Lorenzo Carnevale ◽  
Antonio Celesti ◽  
Maria Fazio ◽  
Massimo Villari
Keyword(s):  
Big Data ◽  
Data Analytics ◽  
Response Times ◽  
Distributed Processing ◽  
Big Data Analytics ◽  
Reliable System ◽  
Huge Amount ◽  
Ecg Signals ◽  
Big Data Applications ◽  
Electrocardiogram Ecg

Nowadays, we are observing a growing interest about Big Data applications in different healthcare sectors. One of this is definitely cardiology. In fact, electrocardiogram produces a huge amount of data about the heart health status that need to be stored and analysed in order to detect a possible issues. In this paper, we focus on the arrhythmia detection problem. Specifically, our objective is to address the problem of distributed processing considering big data generated by electrocardiogram (ECG) signals in order to carry out pre-processing analysis. Specifically, an algorithm for the identification of heartbeats and arrhythmias is proposed. Such an algorithm is designed in order to carry out distributed processing over the Cloud since big data could represent the bottleneck for cardiology applications. In particular, we implemented the Menard algorithm in Apache Spark in order to process big data coming form ECG signals in order to identify arrhythmias. Experiments conducted using a dataset provided by the Physionet.org European ST-T Database show an improvement in terms of response times. As highlighted by our outcomes, our solution provides a scalable and reliable system, which may address the challenges raised by big data in healthcare.

Novel Scalable Deep Learning Approaches for Big Data Analytics Applied to ECG Processing

2018 ◽  
Vol 9 (4) ◽  
pp. 33-51
Author(s):  
Rostom Mennour ◽  
Mohamed Batouche
Keyword(s):  
Big Data ◽  
Deep Learning ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Learning Approaches ◽  
Ecg Signals ◽  
Research Areas ◽  
Gradient Descent Algorithm ◽  
Big Data Technologies ◽  
Active Research

Big data analytics and deep learning are nowadays two of the most active research areas in computer science. As the data is becoming bigger and bigger, deep learning has a very important role to play in data analytics, and big data technologies will give it huge opportunities for different sectors. Deep learning brings new challenges especially when it comes to large amounts of data, the volume of datasets has to be processed and managed, also data in various applications come in a streaming way and deep learning approaches have to deal with this kind of applications. In this paper, the authors propose two novel approaches for discriminative deep learning, namely LS-DSN, and StreamDSN that are inspired from the deep stacking network algorithm. Two versions of the gradient descent algorithm were used to train the proposed algorithms. The experiment results have shown that the algorithms gave satisfying accuracy results and scale well when the size of data increases. In addition, StreamDSN algorithm have been applied to classify beats of ECG signals and provided good promising results.

scholarly journals Big Data Applications in Vaccinology

2021 ◽  
Vol 6 (2) ◽  
pp. 59-80
Author(s):  
Joseph E. Kasten
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Data Analytics ◽  
Human Race ◽  
Big Data Applications ◽  
The World ◽  
Big Data Technologies ◽  
History Of ◽  
Structured Literature Review ◽  
Over Time

The development of vaccines has been one of the most important medical and pharmacological breakthroughs in the history of the world. Besides saving untold lives, they have enabled the human race to live and thrive in conditions thought far too dangerous only a few centuries ago. In recent times, the development of the COVID-19 vaccine has captured the world’s attention as the primary tool to defeat the current pandemic. The tools used to develop these vaccines have changed dramatically over time, with the use of big data technologies becoming standard in many instances. This study performs a structured literature review centered on the development, distribution, and evaluation of vaccines and the role played by big data tools such as data analytics, datamining, and machine learning. Through this review, the paper identifies where these technologies have made important contributions and in what areas further research is likely to be useful.

Data Modeling and Knowledge Discovery in Process Industries

2016 ◽  
pp. 146-156
Author(s):  
Benjamin Klöpper ◽  
Marcel Dix ◽  
David Arnu ◽  
Dikshith Siddapura
Keyword(s):  
Big Data ◽  
Data Analytics ◽  
Model Building ◽  
Big Data Analytics ◽  
Human Consumption ◽  
Process Industries ◽  
Meta Information ◽  
Process Plants ◽  
Mining Projects ◽  
Machine Readable

Dispersed data sources, incompatible data formats and a lack of non-ambiguous and machine readable meta-data is a major obstacle in data analytics and data mining projects in process industries. Often, meta-information is only available in unstructured format optimized for human consumption. This contribution outlines a feasible methodology for organizing historical datasets extracted from process plants in a big data platform for the purpose of analytics and machine learning model building in an industrial big data analytics project.

Sign in / Sign up

Export Citation Format

Share Document