Using Exploratory Data Analysis and Big Data Analytics for Detecting Anomalies in Cloud Computing

2021 ◽  
Vol 3 (1) ◽  
Author(s):  
Ibrahim Muzaferija ◽  
Zerina Mašetić ◽  
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Data Analysis ◽  
Anomaly Detection ◽  
Data Analytics ◽  
Large Scale ◽  
Exploratory Data Analysis ◽  
Big Data Analytics ◽  
Detection Methods ◽  
Exploratory Data

While leveraging cloud computing for large-scale distributed applications allows seamless scaling, many companies struggle following up with the amount of data generated in terms of efficient processing and anomaly detection, which is a necessary part of the management of modern applications. As the record of user behavior, weblogs surely become the research item related to anomaly detection. Many anomaly detection methods based on automated log analysis have been proposed. However, not in the context of big data applications where anomalous behavior needs to be detected in understanding phases prior to modeling a system for such use. Big Data Analytics often ignores anomalous point due to high volume of data. To address this problem, we propose a complemented methodology for Big Data Analytics – the Exploratory Data Analysis, which assists in gaining insight into data relationships without the classical hypothesis modeling. In that way, we can gain better understanding of the patterns and spot anomalies. Results show that Exploratory Data Analysis facilitates anomaly detection and the CRISP-DM Business Understanding phase, making it one of the key steps in the Data Understanding phase.

scholarly journals Big Data Analytics: A Spotify Case Study

2021 ◽  
Vol 9 (10) ◽  
pp. 1823-1829
Author(s):  
Suraj Ingle
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Customer Satisfaction ◽  
Customer Loyalty ◽  
Data Analytics ◽  
Exploratory Data Analysis ◽  
Big Data Analytics ◽  
Exploratory Data ◽  
Insight Into

Abstract: By developing products that are in line with consumer needs, anticipating their profitability and manufacturing them, Big Data has opened up a lot of possibilities for building customer loyalty and commercial business by proactively engaging and comprehensively streamlining offers across all customer touch points. The use of big data to determine the best, most efficient ways to engage and interact with their customers will be discussed in this paper. An insight into how Spotify intends to provide music lovers additional ways to find their favourite songs, interact with artists, and improve Spotify recommendations has been provided. Keywords: Big Data, Data Analytics, Customer Satisfaction, Exploratory Data Analysis

Big Data and Cloud Computing

2018 ◽  
pp. 1-28 ◽  
Author(s):  
Marcus Tanque ◽  
Harry J Foxwell
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Supply Chain ◽  
Supply Chain Management ◽  
Data Analytics ◽  
Large Scale ◽  
Big Data Analytics ◽  
Chain Management ◽  
Computing Services ◽  
Cloud Computing Services

Big data and cloud computing are transforming information technology. These comparable technologies are the result of dramatic developments in computational power, virtualization, network bandwidth, availability, storage capability, and cyber-physical systems. The crossroads of these two areas, involves the use of cloud computing services and infrastructure, to support large-scale data analytics research, providing relevant solutions or future possibilities for supply chain management. This chapter broadens the current posture of cloud computing and big data, as associate with the supply chain solutions. This chapter focuses on areas of significant technology and scientific advancements, which are likely to enhance supply chain systems. This evaluation emphasizes the security challenges and mega-trends affecting cloud computing and big data analytics pertaining to supply chain management.

Research of Big Data Processing Platform

2014 ◽  
Vol 484-485 ◽  
pp. 922-926
Author(s):  
Xiang Ju Liu
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Data Analysis ◽  
Network Architecture ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Big Data Analysis ◽  
Computing Platform ◽  
Operational Characteristics ◽  
Analysis Platform

This paper introduces the operational characteristics of the era of big data and the current era of big data challenges, and exhaustive research and design of big data analytics platform based on cloud computing, including big data analytics platform architecture system, big data analytics platform software architecture , big data analytics platform network architecture big data analysis platform unified program features and so on. The paper also analyzes the cloud computing platform for big data analysis program unified competitive advantage and development of business telecom operators play a certain role in the future.

Big Data Analytics in Cloud Platform

2021 ◽  
pp. 159-179
Author(s):  
Sathishkumar S. ◽  
Devi Priya R. ◽  
Karthika K.
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Data Analytics ◽  
Large Scale ◽  
Big Data Analytics ◽  
New Paradigm ◽  
Data Types ◽  
Data Intensive ◽  
Service Oriented ◽  
Big Data Computing

Big data computing in clouds is a new paradigm for next-generation analytics development. It enables large-scale data organizations to share and explore large quantities of ever-increasing data types using cloud computing technology as a back-end. Knowledge exploration and decision-making from this rapidly increasing volume of data encourage data organization, access, and timely processing, an evolving trend known as big data computing. This modern paradigm incorporates large-scale computing, new data-intensive techniques, and mathematical models to create data analytics for intrinsic information extraction. Cloud computing emerged as a service-oriented computing model to deliver infrastructure, platform, and applications as services from the providers to the consumers meeting the QoS parameters by enabling the archival and processing of large volumes of rapidly growing data faster economy models.

Trends and Opportunities in Health Analytics as a Service and Implications for Use in Low Resource Settings: A Literature Review Abstract (Preprint)

2019 ◽  
Author(s):  
Meghana Bastwadkar ◽  
Carolyn McGregor ◽  
S Balaji
Keyword(s):  
Data Mining ◽  
Cloud Computing ◽  
Big Data ◽  
Intensive Care ◽  
Literature Review ◽  
Health Monitoring ◽  
Data Analytics ◽  
Neonatal Intensive Care ◽  
Big Data Analytics ◽  
Healthcare Facilities

BACKGROUND This paper presents a systematic literature review of existing remote health monitoring systems with special reference to neonatal intensive care (NICU). Articles on NICU clinical decision support systems (CDSSs) which used cloud computing and big data analytics were surveyed. OBJECTIVE The aim of this study is to review technologies used to provide NICU CDSS. The literature review highlights the gaps within frameworks providing HAaaS paradigm for big data analytics METHODS Literature searches were performed in Google Scholar, IEEE Digital Library, JMIR Medical Informatics, JMIR Human Factors and JMIR mHealth and only English articles published on and after 2015 were included. The overall search strategy was to retrieve articles that included terms that were related to “health analytics” and “as a service” or “internet of things” / ”IoT” and “neonatal intensive care unit” / ”NICU”. Title and abstracts were reviewed to assess relevance. RESULTS In total, 17 full papers met all criteria and were selected for full review. Results showed that in most cases bedside medical devices like pulse oximeters have been used as the sensor device. Results revealed a great diversity in data acquisition techniques used however in most cases the same physiological data (heart rate, respiratory rate, blood pressure, blood oxygen saturation) was acquired. Results obtained have shown that in most cases data analytics involved data mining classification techniques, fuzzy logic-NICU decision support systems (DSS) etc where as big data analytics involving Artemis cloud data analysis have used CRISP-TDM and STDM temporal data mining technique to support clinical research studies. In most scenarios both real-time and retrospective analytics have been performed. Results reveal that most of the research study has been performed within small and medium sized urban hospitals so there is wide scope for research within rural and remote hospitals with NICU set ups. Results have shown creating a HAaaS approach where data acquisition and data analytics are not tightly coupled remains an open research area. Reviewed articles have described architecture and base technologies for neonatal health monitoring with an IoT approach. CONCLUSIONS The current work supports implementation of the expanded Artemis cloud as a commercial offering to healthcare facilities in Canada and worldwide to provide cloud computing services to critical care. However, no work till date has been completed for low resource setting environment within healthcare facilities in India which results in scope for research. It is observed that all the big data analytics frameworks which have been reviewed in this study have tight coupling of components within the framework, so there is a need for a framework with functional decoupling of components.

Application of Big Data Analytics via Cloud Computing

2016 ◽  
Author(s):  
Yunus Yetis ◽  
Ruthvik Goud Sara ◽  
Berat A. Erol ◽  
Halid Kaplan ◽  
Abdurrahman Akuzum ◽  
...  
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics

scholarly journals A multilevel approach to big data analysis using analytic tools and actor network theory

2018 ◽  
Vol 20 (1) ◽  
Author(s):  
Tiko Iyamu
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Network Theory ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Actor Network Theory ◽  
Big Data Analysis ◽  
Data Sets ◽  
Multilevel Approach ◽  
Actor Network

Background: Over the years, big data analytics has been statically carried out in a programmed way, which does not allow for translation of data sets from a subjective perspective. This approach affects an understanding of why and how data sets manifest themselves into various forms in the way that they do. This has a negative impact on the accuracy, redundancy and usefulness of data sets, which in turn affects the value of operations and the competitive effectiveness of an organisation. Also, the current single approach lacks a detailed examination of data sets, which big data deserve in order to improve purposefulness and usefulness.Objective: The purpose of this study was to propose a multilevel approach to big data analysis. This includes examining how a sociotechnical theory, the actor network theory (ANT), can be complementarily used with analytic tools for big data analysis.Method: In the study, the qualitative methods were employed from the interpretivist approach perspective.Results: From the findings, a framework that offers big data analytics at two levels, micro- (strategic) and macro- (operational) levels, was developed. Based on the framework, a model was developed, which can be used to guide the analysis of heterogeneous data sets that exist within networks.Conclusion: The multilevel approach ensures a fully detailed analysis, which is intended to increase accuracy, reduce redundancy and put the manipulation and manifestation of data sets into perspectives for improved organisations’ competitiveness.

scholarly journals Data Lake Ecosystem Workflow

2021 ◽  
Author(s):  
R. Salter ◽  
Quyen Dong ◽  
Cody Coleman ◽  
Maria Seale ◽  
Alicia Ruvinsky ◽  
...  
Keyword(s):  
Big Data ◽  
Language Processing ◽  
Data Analytics ◽  
Large Scale ◽  
Big Data Analytics ◽  
Lake Ecosystem ◽  
Data Governance ◽  
Government Organizations ◽  
Large Scale Data ◽  
Scale Data

The Engineer Research and Development Center, Information Technology Laboratory’s (ERDC-ITL’s) Big Data Analytics team specializes in the analysis of large-scale datasets with capabilities across four research areas that require vast amounts of data to inform and drive analysis: large-scale data governance, deep learning and machine learning, natural language processing, and automated data labeling. Unfortunately, data transfer between government organizations is a complex and time-consuming process requiring coordination of multiple parties across multiple offices and organizations. Past successes in large-scale data analytics have placed a significant demand on ERDC-ITL researchers, highlighting that few individuals fully understand how to successfully transfer data between government organizations; future project success therefore depends on a small group of individuals to efficiently execute a complicated process. The Big Data Analytics team set out to develop a standardized workflow for the transfer of large-scale datasets to ERDC-ITL, in part to educate peers and future collaborators on the process required to transfer datasets between government organizations. Researchers also aim to increase workflow efficiency while protecting data integrity. This report provides an overview of the created Data Lake Ecosystem Workflow by focusing on the six phases required to efficiently transfer large datasets to supercomputing resources located at ERDC-ITL.

scholarly journals The Smart Triad : Big Data Analytics , Cloud Computing and Internet of Things to shape the Smart Home, Smart City, Smart Business & Smart Country

2019 ◽  
Vol 8 (2S11) ◽  
pp. 3594-3600 ◽  
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Internet Of Things ◽  
Data Analytics ◽  
Smart Home ◽  
Service Providers ◽  
Irrigation System ◽  
Electronic Devices ◽  
Big Data Analytics ◽  
User Privacy

Big data analytics, cloud computing & internet of things are a smart triad which have started shaping our future towards smart home, city, business, country. Internet of things is a convergence of intelligent networks, electronic devices, and cloud computing. The source of big data at different connected electronic devices is stored on cloud server for analytics. Cloud provides the readymade infrastructure, remote processing power to consumers of internet of things. Cloud computing also gives device manufacturers and service providers access to ―advanced analytics and monitoring‖, ―communication between services and devices‖, ―user privacy and security‖. This paper, presents an overview of internet of things, role of cloud computing & big data analytics towards IoT. In this paper IoT enabled automatic irrigation system is proposed that saves data over ―ThingSpeak‖ database an IoT analytics platform through ESP8266 wifi module. This paper also summarizes the application areas and discusses the challenges of IoT.

Sign in / Sign up

Export Citation Format

Share Document