scholarly journals Improving the Efficiency of Deduplication Process by Dedicated Hash Table for each Digital Data Type in Cloud Storage System

Webology ◽  
2021 ◽  
Vol 18 (Special Issue 01) ◽  
pp. 288-301
Author(s):  
G. Sujatha ◽  
Dr. Jeberson Retna Raj
Keyword(s):  
Data Storage ◽  
Cloud Storage ◽  
Storage System ◽  
Hash Table ◽  
Cloud Services ◽  
Data Type ◽  
Digital Data ◽  
Storage Space ◽  
Data Deduplication ◽  
Worst Case

Data storage is one of the significant cloud services available to the cloud users. Since the magnitude of information outsourced grows extremely high, there is a need of implementing data deduplication technique in the cloud storage space for efficient utilization. The cloud storage space supports all kind of digital data like text, audio, video and image. In the hash-based deduplication system, cryptographic hash value should be calculated for all data irrespective of its type and stored in the memory for future reference. Using these hash value only, duplicate copies can be identified. The problem in this existing scenario is size of the hash table. To find a duplicate copy, all the hash values should be checked in the worst case irrespective of its data type. At the same time, all kind of digital data does not suit with same structure of hash table. In this study we proposed an approach to have multiple hash tables for different digital data. By having dedicated hash table for each digital data type will improve the searching time of duplicate data.

scholarly journals Improving Security on Cloud Based Deduplication System

2018 ◽  
Vol 7 (S1) ◽  
pp. 16-19
Author(s):  
B. Rasina Begum ◽  
P. Chithra
Keyword(s):  
Data Storage ◽  
Cloud Storage ◽  
Storage System ◽  
Single Copy ◽  
Cloud Services ◽  
Data Deduplication ◽  
Data Reliability ◽  
Configurable Computing ◽  
Local Data ◽  
Security Issues

Cloud computing provides a scalable platform for large amount of data and processes that work on various applications and services by means of on-demand service. The storage services offered by clouds have become a new profit growth by providing a comparable cheaper, scalable, location-independent platform for managing users’ data. The client uses the cloud storage and enjoys the high end applications and services from a shared group of configurable computing resources using cloud services. It reduces the difficulty of local data storage and maintenance. But it gives severe security issues toward users’ outsourced data. Data Redundancy promotes the data reliability in Cloud Storage. At the same time, it increases storage space, Bandwidth and Security threats due to some server vulnerability. Data Deduplication helps to improve storage utilization. Backup is also less which means less Hardware and Backup media. But it has lots of security issues. Data reliability is a very risky issue in a Deduplication storage system because there is single copy for each file stored in the server which is shared by all the data owners. If such a shared file/chunk was missing, large amount of data becomes unreachable. The main aim of this work is to implement Deduplication System without sacrificing Security in cloud storage. It combines both Deduplication and convergent key cryptography with reduced overhead.

scholarly journals Secure Content De-Duplication Utilizing Efficient Content Discovery and Preserving De-Duplication (Ecdpd)

2019 ◽  
Vol 8 (12S) ◽  
pp. 986-990
Keyword(s):  
Access Control ◽  
Data Storage ◽  
Cloud Storage ◽  
Storage System ◽  
Data Access ◽  
Data File ◽  
Data Deduplication ◽  
Efficient Technology ◽  
Data Access Control ◽  
Content Discovery

Cloud computing, an efficient technology that utilizes huge amount of data file storage with security. However, the content owner does not controlling data access for unauthorized clients and does not control data storage and usage of data. Some previous approaches data access control to help data de-duplication concurrently for cloud storage system. Encrypted data for cloud storage is not effectively handled by current industrial de-duplication solutions. The deduplication is unguarded from brute-force attacks and fails in supporting control of data access .An efficient data confining technique that eliminates redundant data’s multiple copies which is commonly used is Data-Deduplication. It reduces the space needed to store these data and thus bandwidth is saved. An efficient content discovery and preserving De-duplication (ECDPD) algorithm that detects client file range and block range of de-duplication in storing data files in the cloud storage system was proposed to overpower the above problems.Data access control is supported by ECDPD actively. Based on Experimental evaluations, proposed ECDPD method reduces 3.802 milliseconds of DUT (Data Uploading Time) and 3.318 milliseconds of DDT (Data Downloading Time) compared than existing approaches

Based on Cloud-Technology Data Storage Security

2014 ◽  
Vol 556-562 ◽  
pp. 6179-6183
Author(s):  
Zhi Gang Chai ◽  
Ming Zhao ◽  
Xiao Yu
Keyword(s):  
Cloud Computing ◽  
Data Storage ◽  
Cloud Storage ◽  
Rapid Development ◽  
Storage System ◽  
Storage Space ◽  
It Industry ◽  
Storage Security ◽  
The Cost ◽  
Space Requirements

With the rapid development of information technology, the extensive use of cloud computing promotes technological change in the IT industry. The use of cloud storage industry is also one solution to the problem of an amount of data storing, which is traditionally large, and unimaginably redundant. The use of cloud computing in the storage system connects the user's data with network clients via the Internet. That is to say, it not only solves a lot of data storage space requirements in request, but also greatly reduces the cost of the storage system. But in the application of cloud storage, there are also many problems to be solved, even to some extent which has hindered the development of cloud storage. Among these issues, the most concerning one is cloud storage security. The following passages discuss the problem and propose a solution to it.

Fast and Efficient Cloud Data Utilization with Deduplication

2018 ◽  
Vol 6 (6) ◽  
pp. 68
Author(s):  
Sunil S ◽  
A Ananda Shankar
Keyword(s):  
Data Storage ◽  
Cloud Storage ◽  
Storage System ◽  
Data Access ◽  
Data Deduplication ◽  
Cloud Data ◽  
Web Log ◽  
File Storage ◽  
Data Access Control ◽  
The Web

Cloud storage system is to provides facilitative file storage and sharing services for distributed clients.The cloud storage preserve the privacy of data holders by proposing a scheme to manage encrypted data storage with deduplication. This process can flexibly support data sharing with deduplication even when the data holder is offline, and it does not intrude the privacy of data holders. It is an effective approach to verify data ownership and check duplicate storage with secure challenge and big data support. We integrate cloud data deduplication with data access control in a simple way, thus reconciling data deduplication and encryption.We prove the security and assess the performance through analysis and simulation. The results show its efficiency, effectiveness and applicability.In this proposed system the upload data will be stored on the cloud based on date.This means that it has to be available to the data holder who need it when they need it. The web log record represents whether the keyword is repeated or not. Records with only repeated search data are retained in primary storage in cloud. All the other records are stored in temporary storage server. This step reduces the size of the web log thereby avoids the burden on the memory and speeds up the analysis.

scholarly journals Unbalanced Big Data-Compatible Cloud Storage Method Based on Redundancy Elimination Technology

2022 ◽  
Vol 2022 ◽  
pp. 1-10
Author(s):  
Tingting Yu
Keyword(s):  
Big Data ◽  
Data Acquisition ◽  
Data Storage ◽  
Cloud Storage ◽  
Data Encryption ◽  
Storage Space ◽  
Data Deduplication ◽  
Redundancy Elimination ◽  
Data Redundancy ◽  
Storage Method

In order to meet the requirements of users in terms of speed, capacity, storage efficiency, and security, with the goal of improving data redundancy and reducing data storage space, an unbalanced big data compatible cloud storage method based on redundancy elimination technology is proposed. A new big data acquisition platform is designed based on Hadoop and NoSQL technologies. Through this platform, efficient unbalanced data acquisition is realized. The collected data are classified and processed by classifier. The classified unbalanced big data are compressed by Huffman algorithm, and the data security is improved by data encryption. Based on the data processing results, the big data redundancy processing is carried out by using the data deduplication algorithm. The cloud platform is designed to store redundant data in the cloud. The results show that the method in this paper has high data deduplication rate and data deduplication speed rate and low data storage space and effectively reduces the burden of data storage.

Blockchain Encryption on Student Academic Transcripts using a Smart Contract

2021 ◽  
Author(s):  
Primasatria Edastama ◽  
Ninda Lutfiani ◽  
Qurotul Aini ◽  
Suryari Purnama ◽  
Isabella Yaumil Annisa
Keyword(s):  
Data Storage ◽  
Storage System ◽  
Digital Data ◽  
Decentralized System ◽  
Blockchain Technology ◽  
Educational Environments ◽  
The World ◽  
Technology Applications ◽  
E Learning ◽  
Data Storage System

As an innovation in the world of computers, blockchain has many benefits and is also widely applied in the world of education. Blockchain itself has many advantages, especially in the world of education. Blockchain is a digital data storage system that consists of many servers (multiserver). In this Blockchain technology, data created by one server can be replicated and verified by another server. By using this technology with a decentralized system and strong cryptography and can help colleges or universities to build infrastructure in the archive storage of transcripts, diplomas, and diplomas. Usage One of the blockchain technology applications in education is iBC, namely the e-learning Blockchain Certificate, book copyright, and also e-Portfolios. iBC or e-learning Blockchain Certificate is a tool designed to create, verify and also issue blockchain certificates. As has been supported by the IBC to create certificates that are globally verified and stored in a decentralized manner. Here will be presented use cases that are relevant in the use of Blockchain technology in educational environments, especially data processing in universities and we also try to design an IBC based on blockchain technology that can be used to support transparency and accountability of colleges or universities in issuing diplomas and grades. 

scholarly journals Deduplication in Cloud Storage

2019 ◽  
Vol 9 (2S) ◽  
pp. 364-368
Keyword(s):  
Data Storage ◽  
Cloud Storage ◽  
Cloud Service ◽  
Information Storage ◽  
Cloud Environment ◽  
Data Deduplication ◽  
Cloud Service Provider ◽  
Level Data ◽  
Block Level ◽  
Individual Client

Cloud Computing is well known today on account of enormous measure of data storage and quick access of information over the system. It gives an individual client boundless extra space, accessibility and openness of information whenever at anyplace. Cloud service provider can boost information storage by incorporating data deduplication into cloud storage, despite the fact that information deduplication removes excess information and reproduced information happens in cloud environment. This paper presents a literature survey alongside different deduplication procedures that have been based on cloud information storage. To all the more likely guarantee secure deduplication in cloud, this paper examines file level data deduplication and block level data deduplication.

scholarly journals An extensive research survey on data integrity and deduplication towards privacy in cloud storage

2020 ◽  
Vol 10 (2) ◽  
pp. 2011
Author(s):  
Anil Kumar G. ◽  
Shantala C. P.
Keyword(s):  
Cloud Storage ◽  
Data Privacy ◽  
Storage System ◽  
Data Integrity ◽  
Data Deduplication ◽  
Research Issues ◽  
Existing Problems ◽  
Research Survey ◽  
Challenging Tasks ◽  
Future Direction

Owing to the highly distributed nature of the cloud storage system, it is one of the challenging tasks to incorporate a higher degree of security towards the vulnerable data. Apart from various security concerns, data privacy is still one of the unsolved problems in this regards. The prime reason is that existing approaches of data privacy doesn't offer data integrity and secure data deduplication process at the same time, which is highly essential to ensure a higher degree of resistance against all form of dynamic threats over cloud and internet systems. Therefore, data integrity, as well as data deduplication is such associated phenomena which influence data privacy. Therefore, this manuscript discusses the explicit research contribution toward data integrity, data privacy, and data deduplication. The manuscript also contributes towards highlighting the potential open research issues followed by a discussion of the possible future direction of work towards addressing the existing problems.

Cloud solutions for GxP laboratories: considerations for data storage

Bioanalysis ◽  
2021 ◽  
Author(s):  
Scott Davis ◽  
Joel Usansky ◽  
Shibani Mitra-Kaushik ◽  
John Kellie ◽  
Kimberly Honrine ◽  
...  
Keyword(s):  
Pharmaceutical Industry ◽  
Best Practices ◽  
Drug Development ◽  
Data Storage ◽  
Real World ◽  
Cloud Storage ◽  
Low Cost ◽  
Cloud Services ◽  
Significant Shift ◽  
On Demand

Challenges for data storage during drug development have become increasingly complex as the pharmaceutical industry expands in an environment that requires on-demand availability of data and resources for users across the globe. While the efficiency and relative low cost of cloud services have become increasingly attractive, hesitancy toward the use of cloud services has decreased and there has been a significant shift toward real-world implementation. Within GxP laboratories, the considerations for cloud storage of data include data integrity and security, as well as access control and usage for users around the globe. In this review, challenges and considerations when using cloud storage options for the storage of laboratory-based GxP data are discussed and best practices are defined.

A Global Survey on Data Deduplication

2018 ◽  
Vol 10 (4) ◽  
pp. 43-66 ◽  
Author(s):  
Shubhanshi Singhal ◽  
Pooja Sharma ◽  
Rajesh Kumar Aggarwal ◽  
Vishal Passricha
Keyword(s):  
Data Reduction ◽  
Cloud Storage ◽  
Storage Systems ◽  
Distributed Storage ◽  
Digital Data ◽  
Data Deduplication ◽  
Computationally Efficient ◽  
Redundant Data ◽  
Single Instance ◽  
Local Storage

This article describes how data deduplication efficiently eliminates the redundant data by selecting and storing only single instance of it and becoming popular in storage systems. Digital data is growing much faster than storage volumes, which shows the importance of data deduplication among scientists and researchers. Data deduplication is considered as most successful and efficient technique of data reduction because it is computationally efficient and offers a lossless data reduction. It is applicable to various storage systems, i.e. local storage, distributed storage, and cloud storage. This article discusses the background, components, and key features of data deduplication which helps the reader to understand the design issues and challenges in this field.

Sign in / Sign up

Export Citation Format

Share Document