Examining Data Lake Design Principle for Cloud Computing Technology and IoT

2018 ◽  
pp. 228-250
Author(s):  
Deepak Saini ◽  
Jasmine Saini
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Design Principle ◽  
Business Value ◽  
Computing Technology ◽  
Multiple Systems ◽  
Good Design ◽  
The World ◽  
Data Files ◽  
Cloud Servers

In the Cloud-based IoT systems, the major issue is handling the data because IoT will deliver an abundance of data to the Cloud for computing. In this situation, the cloud servers will compute the big data and try to identify the relevant data and give decisions accordingly. In the world of big data, it is a herculean task to manage inflow, storage, and exploration of millions of data files and the volume of information coming from multiple systems. The growth of this information calls for good design principles so that it can leverage the different big data tools available in the market today. From the information consumption standpoint, business users are exploring new insights from the big data that can uncover potential business value. Data lake is a technology framework that helps to solve this big data challenge.

Trends and Technologies in Big Data Processing

2020 ◽  
pp. 17-42
Author(s):  
Amitava Choudhury ◽  
Kalpana Rangra
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Internet Of Things ◽  
Data Processing ◽  
Real Time ◽  
Computing Technology ◽  
Time Data ◽  
Big Data Processing ◽  
Real Time Data ◽  
Real Time Data Processing

Data type and amount in human society is growing at an amazing speed, which is caused by emerging new services such as cloud computing, internet of things, and location-based services. The era of big data has arrived. As data has been a fundamental resource, how to manage and utilize big data better has attracted much attention. Especially with the development of the internet of things, how to process a large amount of real-time data has become a great challenge in research and applications. Recently, cloud computing technology has attracted much attention to high performance, but how to use cloud computing technology for large-scale real-time data processing has not been studied. In this chapter, various big data processing techniques are discussed.

Research of Association Rules Algorithm Based on Matrix under Cloud Computing

2014 ◽  
Vol 568-570 ◽  
pp. 798-801
Author(s):  
Ye Qing Xiong ◽  
Shu Dong Zhang
Keyword(s):  
Data Mining ◽  
Cloud Computing ◽  
Big Data ◽  
Association Rules ◽  
Apriori Algorithm ◽  
Computing Technology ◽  
Binary Matrix ◽  
Transaction Data ◽  
Big Data Mining ◽  
Parallel Mining

It occurs time and space performance bottlenecks when traditional association rules algorithms are used to big data mining. This paper proposes a parallel algorithm based on matrix under cloud computing to improve Apriori algorithm. The algorithm uses binary matrix to store transaction data, uses matrix "and" operation to replace the connection between itemsets and combines cloud computing technology to implement the parallel mining for frequent itemsets. Under different conditions, the simulation shows it improves the efficiency, solves the performance bottleneck problem and can be widely used in big data mining with strong scalability and stability.

scholarly journals Grid computing and e-science: a view from inside

2008 ◽  
Vol 07 (02) ◽  
pp. C03
Author(s):  
Stefano Cozzini
Keyword(s):  
Cloud Computing ◽  
Grid Computing ◽  
Research Methods ◽  
New Method ◽  
Computing Technology ◽  
Scientific Communities ◽  
Future Evolution ◽  
The World ◽  
The Future

My intention is to analyze how, where and if grid computing technology is truly enabling a new way of doing science (so-called ‘e-science’). I will base my views on the experiences accumulated thus far in a number of scientific communities, which we have provided with the opportunity of using grid computing. I shall first define some basic terms and concepts and then discuss a number of specific cases in which the use of grid computing has actually made possible a new method for doing science. I will then present a case in which this did not result in a change in research methods. I will try to identify the reasons for these failures and analyze the future evolution of grid computing. I will conclude by introducing and commenting the concept of ‘cloud computing’, the approach offered and provided by major industrial actors (Google/IBM and Amazon being among the most important) and what impact this technology might have on the world of research.

scholarly journals Individualized Teaching and Teaching Process Evaluation for International Trade Students Based on Information Techniques

2019 ◽  
Vol 14 (23) ◽  
pp. 221
Author(s):  
Yanan Zhao
Keyword(s):  
Information Technology ◽  
Cloud Computing ◽  
Big Data ◽  
International Trade ◽  
Evaluation System ◽  
Training Model ◽  
Teaching Process ◽  
Education Industry ◽  
The World ◽  
Individualized Teaching

With the boom in information technology, countries around the world are competing the information the education industry. However, there is not yet a well-established standard to evaluate students’ capabilities in the teaching process based on information techniques. To solve the problem, this paper introduces the latest information techniques, such as big data and cloud computing, into the teaching of international trade, designs an individualized teaching system based on student portrait, and constructs an intelligent evaluation system of the teaching process. On this basis, several suggestions were put forward on the reform of the training model of international trade students. This research provides new insights on the evaluation and improvement of the teaching effect in the department of international trade.

scholarly journals Research on Big data Security privacy Protection based on cloud Computing

2021 ◽  
Vol 2083 (4) ◽  
pp. 042077
Author(s):  
Tongtong Xu ◽  
Lei Shi
Keyword(s):  
Cloud Computing ◽  
Big Data ◽  
Data Storage ◽  
Data Security ◽  
Privacy Protection ◽  
Data Privacy ◽  
Cloud Services ◽  
Security Mechanism ◽  
Computing Platform ◽  
Cloud Servers

Abstract Cloud computing is a new way of computing and storage. Users do not need to master professional skills, but can enjoy convenient network services as long as they pay according to their own needs. When we use cloud services, we need to upload data to cloud servers. As the cloud is an open environment, it is easy for attackers to use cloud computing to conduct excessive computational analysis on big data, which is bound to infringe on others’ privacy. In this process, we inevitably face the challenge of data security. How to ensure data privacy security in the cloud environment has become an urgent problem to be solved. This paper studies the big data security privacy protection based on cloud computing platform. This paper starts from two aspects: implicit security mechanism and display security mechanism (encryption mechanism), so as to protect the security privacy of cloud big data platform in data storage and data computing processing.

scholarly journals IMPLEMENTASI CLOUD COMPUTING TECHNOLOGY UNTUK SMK PGRI 2 TANGERANG BERBASIS GAFE (GOOGLE APPS FOR EDUCATION)

2019 ◽  
Vol 5 (1) ◽  
pp. 26-34
Author(s):  
Ari Asmawati ◽  
Ria Dwi I’zzaty ◽  
Tasya Oktavianti
Keyword(s):  
Cloud Computing ◽  
Computing Technology ◽  
The World ◽  
Teachers And Students ◽  
Technological Developments ◽  
Google Apps For Education ◽  
Google Apps

Technological developments that are so very fast, require that every individual or institution follow suit. Like the use of clud computing, the usage is currently very wide. In the world of education, the use of cloud computing is very useful for teachers and students in terms of learning in class and outside the classroom. Application of Gafe stored in the cloud provides many choices of office, chat and other applications. This system will try to be implemented in Tangerang PGRI 2 SMK, which is currently still using a manual system. This system allows teachers and students to communicate with each other and interact with each other.

Sign in / Sign up

Export Citation Format

Share Document