Real Time Task Execution in Cloud Using MapReduce Framework

Author(s):  
Sampa Sahoo ◽  
Bibhudatta Sahoo ◽  
Ashok Kumar Turuk ◽  
Sambit Kumar Mishra

Cloud Computing era comes with the advancement of technologies in the fields of processing, storage, bandwidth network access, security of internet etc. The development of automatic applications, smart devices and applications, sensor based applications need huge data storage and computing resources and need output within a particular time limit. Now users are becoming more sensitive towards, delay in applications they are using. So, a scalable platform like Cloud Computing is required that can provide huge computing resource, and data storage required for processing such applications. MapReduce framework is used to process huge amounts of data. Data processing on a cloud based on MapReduce would provide added benefits such as fault tolerant, heterogeneous, ease of use, free and open, efficient. This chapter discusses about cloud system model, real-time MapReduce framework, Cloud based MapReduce framework examples, quality attributes of MapReduce scheduling and various MapReduce scheduling algorithm based on quality attributes.

2019 ◽  
Vol 3 (2) ◽  
pp. 152
Author(s):  
Xianglan Wu

<p>In today's society, the rise of the Internet and rapid development make every day produce a huge amount of data. Therefore, the traditional data processing mode and data storage can not be fully analyzed and mined these data. More and more new information technologies (such as cloud computing, virtualization and big data, etc.) have emerged and been applied, the network has turned from informationization to intelligence, and campus construction has ushered in the stage of smart campus construction.The construction of intelligent campus refers to big data and cloud computing technology, which improves the informatization service quality of colleges and universities by integrating, storing and mining huge data.</p>


Author(s):  
Ganesh Chandra Deka

NoSQL databases are designed to meet the huge data storage requirements of cloud computing and big data processing. NoSQL databases have lots of advanced features in addition to the conventional RDBMS features. Hence, the “NoSQL” databases are popularly known as “Not only SQL” databases. A variety of NoSQL databases having different features to deal with exponentially growing data-intensive applications are available with open source and proprietary option. This chapter discusses some of the popular NoSQL databases and their features on the light of CAP theorem.


2013 ◽  
Vol 303-306 ◽  
pp. 2103-2106
Author(s):  
Cong Cheng

Popularization of the building monitoring system requires huge data storage, information management and computing services. However, the analog signal transmission cannot meet the requirements anymore, therefore cloud computing has to play its role. For this purpose, this article brings up an overall design idea and physical deployment of a cloud-based building monitoring system.


Recent advances in multi cloud technologies and multi-party computations have improved State of art usage of Cloud computing in real time scenarios. Primary reason behind using any service offered by others is ease of use with lesser economics. Cloud Computing is technological advancement which is in usage for last two decades because of its Pay-per-Usage policy offering enormous benefits across the user community. In spite of its enormous benefits, single factor which is stepping it back from its wider adoption throughout the digital society is its Security. Tremendous research work was done across industry and academia in association with cloud security. This paper focuses on brief history, real time deployment of cloud, usage, benefits, risks associated and Surveys various studies done by national and international organizations related to cloud security concerns and dwell upon the advantages of integrating multi clouds and multi-party computation techniques and emphasizes on recent research done across multi cloud environment and give a short note of future work to enhance security paradigm.


Author(s):  
Yun Shu ◽  
Jian Yu ◽  
Wei Qi Yan

In recent decades, internet auctions have become the most significant e-commerce business model worldwide. With the rapid rise of cloud computing over the last few years, the legacy online auction platform is gradually being replaced using service-oriented cloud computing in real time. This chapter describes the design and implementation of a state and high-performance online auction system over cloud and proposes the methodology to provide persistent state records during the auction process so that we are able to ensure the reliability of submitted bid price and guarantee the security of price message in the delivery process. The authors employ actor-based applications to achieve stateful, parallel, and distributed architecture. Meanwhile, utilizing distributed databases provides secure and efficient data storage. To the best of the authors' knowledge, this is the first time that the actor framework has been applied to the online auction. The preliminary result is for implementation of high-performance and real-time bidding online auction.


Author(s):  
Mainak Adhikari ◽  
Sukhendu Kar

NoSQL database provides a mechanism for storage and access of data across multiple storage clusters. NoSQL dabases are finding significant and growing industry to meet the huge data storage requirements of Big data, real time applications, and Cloud Computing. NoSQL databases have lots of advantages over the conventional RDBMS features. NoSQL systems are also referred to as “Not only SQL” to emphasize that they may in fact allow Structured language like SQL, and additionally, they allow Semi Structured as well as Unstructured language. A variety of NoSQL databases having different features to deal with exponentially growing data intensive applications are available with open source and proprietary option mostly prompted and used by social networking sites. This chapter discusses some features and challenges of NoSQL databases and some of the popular NoSQL databases with their features on the light of CAP theorem.


Cloud Computing is an essential podium for workable and impracticable users. It achieves high quality reliable services provided to the users via data storage servers. The key challenge in cloud architecture is to run the facilities without any hazel to the users. In today’s world of information technology, most of the applications are real time. The major constraint of the systems used in real time applications is that, they are prone to failure. The failure may be due to the following reasons: a) Failure to complete the task in prescribed time threshold value. b) Failure to achieve prescribed reliability value. Virtualization and Internet-based Cloud computing causes diverse types of failures to occur and so necessity for reliability and availability have turn out to be of vital concern. To ensure reliability and availability of cloud technologies, methods for fault tolerance need to be developed and deployed. The proposed work will focus on adaptive behavior during the assortment of replication and fine-grained check pointing methods for achieving a reliable cloud platform that can grip diverse client requests. In addition to this, the proposed work will also conclude the best suitable fault tolerance scheme to each chosen virtual machine.


2011 ◽  
Vol 368-373 ◽  
pp. 3473-3476 ◽  
Author(s):  
Jie Liu ◽  
Xian Sheng Qin

This work proposes a method of information integration based Cloud Computing. Users can ask for services through application layer, using the open source Hadoop and implementing medical image data storage and analysis. The functional level of this system is on the basis of service. In our experiments, using the MapReduce framework, efficiently implement the DCM format medical data convert to JPEG format picture. We are working on the function to directly read the medical data which is stored in PACS.


2018 ◽  
Vol 7 (4.5) ◽  
pp. 329
Author(s):  
Sultan Ahmad ◽  
Dr. Mohammad Mazhar Afza

As Cloud Computing has become a new way to store information remotely. It makes possible for many companies to become paperless. IT people and companies can outsource their huge data by using this emerging technology. The major important characteristics of cloud computing are on-demand self-service, broad network access, resource pooling, rapid elasticity and measured services. These cloud computing characteristics are helpful for organizations to become agile. Also there are few serious problems like security, scalability, availability and interoperability which are associated with the above cloud computing characteristics. Providing a secure and efficient access and retrieval of the valuable data is a main concern of cloud computing technologies. It is very important to protect data and credentials of cloud client on the internet. Apart from these security issues of data, the deletion of data on cloud storage is also a very serious issue nowadays.  Once a cloud user wants to delete his data, it must be sure that data actually deleted from all cloud storage sources and there should not be remain any copy of data exist at anywhere in cloud storage anyway. In this paper, different existing data deletion and retrieval methods are studied, observed and analyzed. The importance and related challenges to assured data deletion on the cloud storage are explored.  


Sign in / Sign up

Export Citation Format

Share Document