RESEARCH OF DISTRIBUTED VIRTUAL SOFTWARE-DEFINED INFRASTRUCTURE PERFORMANCE FOR BIG DATA PROCESSING TASKS

2021 ◽  
Vol 77 ◽  
pp. 58-67
Author(s):  
Y. A. Ushakov ◽  
Keyword(s):  
Experimental Study ◽  
Cloud Computing ◽  
Big Data ◽  
Data Processing ◽  
Data Analytics ◽  
Distributed Processing ◽  
Big Data Analytics ◽  
Work Efficiency ◽  
Infrastructure Performance ◽  
Rapid Deployment

Container-based virtual software-defined virtual infrastructures have become an integral part of the underlying cloud computing engine and are used in a variety of distributed, scalable, resilient systems. But big data analytics tasks are mostly handled by traditional distributed clusters that require initial deployment, careful upgrades, and skilled maintenance. The aim of the work is to study the effectiveness of using software- defined virtual infrastructures based on containers and methods for their rapid deployment according to cloud principles for the implementation of automation platforms for distributed processing of big data. The schemes of Hadoop and Spark architecture deployment based on Docker Swarm and Kubernetes clusters are given. The development of criteria for evaluating the performance of distributed computing for processing big data was also carried out and an experimental study of the work efficiency was carried out.

Big Data Analytics in Cloud Computing

2019 ◽  
pp. 325-341
Author(s):  
Rajganesh Nagarajan ◽  
Ramkumar Thirunavukarasu
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Data Processing ◽  
Data Visualization ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Future Research ◽  
Big Data Processing ◽  
Investment Cost

In this chapter, the authors consider different categories of data, which are processed by the big data analytics tools. The challenges with respect to the big data processing are identified and a solution with the help of cloud computing is highlighted. Since the emergence of cloud computing is highly advocated because of its pay-per-use concept, the data processing tools can be effectively deployed within cloud computing and certainly reduce the investment cost. In addition, this chapter talks about the big data platforms, tools, and applications with data visualization concept. Finally, the applications of data analytics are discussed for future research.

Big Data Analytics in Cloud Computing

2022 ◽  
pp. 228-244
Author(s):  
Rajganesh Nagarajan ◽  
Ramkumar Thirunavukarasu
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Data Processing ◽  
Data Visualization ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Future Research ◽  
Big Data Processing ◽  
Investment Cost

In this chapter, the authors consider different categories of data, which are processed by the big data analytics tools. The challenges with respect to the big data processing are identified and a solution with the help of cloud computing is highlighted. Since the emergence of cloud computing is highly advocated because of its pay-per-use concept, the data processing tools can be effectively deployed within cloud computing and certainly reduce the investment cost. In addition, this chapter talks about the big data platforms, tools, and applications with data visualization concept. Finally, the applications of data analytics are discussed for future research.

Trends and Opportunities in Health Analytics as a Service and Implications for Use in Low Resource Settings: A Literature Review Abstract (Preprint)

2019 ◽  
Author(s):  
Meghana Bastwadkar ◽  
Carolyn McGregor ◽  
S Balaji
Keyword(s):  
Data Mining ◽  
Cloud Computing ◽  
Big Data ◽  
Intensive Care ◽  
Literature Review ◽  
Health Monitoring ◽  
Data Analytics ◽  
Neonatal Intensive Care ◽  
Big Data Analytics ◽  
Healthcare Facilities

BACKGROUND This paper presents a systematic literature review of existing remote health monitoring systems with special reference to neonatal intensive care (NICU). Articles on NICU clinical decision support systems (CDSSs) which used cloud computing and big data analytics were surveyed. OBJECTIVE The aim of this study is to review technologies used to provide NICU CDSS. The literature review highlights the gaps within frameworks providing HAaaS paradigm for big data analytics METHODS Literature searches were performed in Google Scholar, IEEE Digital Library, JMIR Medical Informatics, JMIR Human Factors and JMIR mHealth and only English articles published on and after 2015 were included. The overall search strategy was to retrieve articles that included terms that were related to “health analytics” and “as a service” or “internet of things” / ”IoT” and “neonatal intensive care unit” / ”NICU”. Title and abstracts were reviewed to assess relevance. RESULTS In total, 17 full papers met all criteria and were selected for full review. Results showed that in most cases bedside medical devices like pulse oximeters have been used as the sensor device. Results revealed a great diversity in data acquisition techniques used however in most cases the same physiological data (heart rate, respiratory rate, blood pressure, blood oxygen saturation) was acquired. Results obtained have shown that in most cases data analytics involved data mining classification techniques, fuzzy logic-NICU decision support systems (DSS) etc where as big data analytics involving Artemis cloud data analysis have used CRISP-TDM and STDM temporal data mining technique to support clinical research studies. In most scenarios both real-time and retrospective analytics have been performed. Results reveal that most of the research study has been performed within small and medium sized urban hospitals so there is wide scope for research within rural and remote hospitals with NICU set ups. Results have shown creating a HAaaS approach where data acquisition and data analytics are not tightly coupled remains an open research area. Reviewed articles have described architecture and base technologies for neonatal health monitoring with an IoT approach. CONCLUSIONS The current work supports implementation of the expanded Artemis cloud as a commercial offering to healthcare facilities in Canada and worldwide to provide cloud computing services to critical care. However, no work till date has been completed for low resource setting environment within healthcare facilities in India which results in scope for research. It is observed that all the big data analytics frameworks which have been reviewed in this study have tight coupling of components within the framework, so there is a need for a framework with functional decoupling of components.

Application of Big Data Analytics via Cloud Computing

2016 ◽  
Author(s):  
Yunus Yetis ◽  
Ruthvik Goud Sara ◽  
Berat A. Erol ◽  
Halid Kaplan ◽  
Abdurrahman Akuzum ◽  
...  
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Data Analytics ◽  
Big Data Analytics

scholarly journals The Smart Triad : Big Data Analytics , Cloud Computing and Internet of Things to shape the Smart Home, Smart City, Smart Business & Smart Country

2019 ◽  
Vol 8 (2S11) ◽  
pp. 3594-3600 ◽  
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Internet Of Things ◽  
Data Analytics ◽  
Smart Home ◽  
Service Providers ◽  
Irrigation System ◽  
Electronic Devices ◽  
Big Data Analytics ◽  
User Privacy

Big data analytics, cloud computing & internet of things are a smart triad which have started shaping our future towards smart home, city, business, country. Internet of things is a convergence of intelligent networks, electronic devices, and cloud computing. The source of big data at different connected electronic devices is stored on cloud server for analytics. Cloud provides the readymade infrastructure, remote processing power to consumers of internet of things. Cloud computing also gives device manufacturers and service providers access to ―advanced analytics and monitoring‖, ―communication between services and devices‖, ―user privacy and security‖. This paper, presents an overview of internet of things, role of cloud computing & big data analytics towards IoT. In this paper IoT enabled automatic irrigation system is proposed that saves data over ―ThingSpeak‖ database an IoT analytics platform through ESP8266 wifi module. This paper also summarizes the application areas and discusses the challenges of IoT.

Modeling Big Data Analytics with a Real-Time Executable Specification Language

2015 ◽  
pp. 289-312
Author(s):  
Amir A. Khwaja
Keyword(s):  
Big Data ◽  
Data Processing ◽  
Real Time ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Exception Handling ◽  
Specification Language ◽  
Big Data Processing ◽  
Business Decisions ◽  
Concurrent Processes

Big data explosion has already happened and the situation is only going to exacerbate with such a high number of data sources and high-end technology prevalent everywhere, generating data at a frantic pace. One of the most important aspects of big data is being able to capture, process, and analyze data as it is happening in real-time to allow real-time business decisions. Alternate approaches must be investigated especially consisting of highly parallel and real-time computations for big data processing. The chapter presents RealSpec real-time specification language that may be used for the modeling of big data analytics due to the inherent language features needed for real-time big data processing such as concurrent processes, multi-threading, resource modeling, timing constraints, and exception handling. The chapter provides an overview of RealSpec and applies the language to a detailed big data event recognition case study to demonstrate language applicability to big data framework and analytics modeling.

Big Data and Cloud Computing

2018 ◽  
pp. 1-28 ◽  
Author(s):  
Marcus Tanque ◽  
Harry J Foxwell
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Supply Chain ◽  
Supply Chain Management ◽  
Data Analytics ◽  
Large Scale ◽  
Big Data Analytics ◽  
Chain Management ◽  
Computing Services ◽  
Cloud Computing Services

Big data and cloud computing are transforming information technology. These comparable technologies are the result of dramatic developments in computational power, virtualization, network bandwidth, availability, storage capability, and cyber-physical systems. The crossroads of these two areas, involves the use of cloud computing services and infrastructure, to support large-scale data analytics research, providing relevant solutions or future possibilities for supply chain management. This chapter broadens the current posture of cloud computing and big data, as associate with the supply chain solutions. This chapter focuses on areas of significant technology and scientific advancements, which are likely to enhance supply chain systems. This evaluation emphasizes the security challenges and mega-trends affecting cloud computing and big data analytics pertaining to supply chain management.

Modeling Big Data Analytics with a Real-Time Executable Specification Language

Big Data ◽  
2016 ◽  
pp. 418-440
Author(s):  
Amir A. Khwaja
Keyword(s):  
Big Data ◽  
Data Processing ◽  
Real Time ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Exception Handling ◽  
Specification Language ◽  
Big Data Processing ◽  
Business Decisions ◽  
Concurrent Processes

Big data explosion has already happened and the situation is only going to exacerbate with such a high number of data sources and high-end technology prevalent everywhere, generating data at a frantic pace. One of the most important aspects of big data is being able to capture, process, and analyze data as it is happening in real-time to allow real-time business decisions. Alternate approaches must be investigated especially consisting of highly parallel and real-time computations for big data processing. The chapter presents RealSpec real-time specification language that may be used for the modeling of big data analytics due to the inherent language features needed for real-time big data processing such as concurrent processes, multi-threading, resource modeling, timing constraints, and exception handling. The chapter provides an overview of RealSpec and applies the language to a detailed big data event recognition case study to demonstrate language applicability to big data framework and analytics modeling.

Sign in / Sign up

Export Citation Format

Share Document