Single node repair algorithm for a multimedia cloud storage system based on network coding

2021 ◽  
Vol 27 (3) ◽  
pp. 205-214
Author(s):  
Xin Niu ◽  
Jingjing Jiang

Multimedia is inconvenient to use, difficult to maintain, and redundant in data storage. In order to solve the above problems and apply cloud storage to the integration of university teaching resources, this paper designs a virtualized cloud storage platform for university multimedia classrooms. The platform has many advantages, such as reducing the initial investment in multimedia classrooms, simplifying management tasks, making maximum use of actual resources and easy access to resources. Experiments and analysis show the feasibility and effectiveness of the platform. Aiming at the problems of the single-node repair algorithm of the existing multimedia cloud storage system, the limited domain is large, the codec complexity is high, the disk I/O (Input/Output) cost is high, the storage overhead and the repair bandwidth are unbalanced, and a network coding-based approach is proposed. Multimedia cloud storage. System single node repair algorithm. The algorithm stores the grouped multimedia file data in groups in the system, and performs XOR (exclusive OR) on the data in the group on the GF(2) finite field. When some nodes fail, the new node only needs to be connected. Two to three non-faulty nodes in the same group can accurately repair the data in the failed node. Theoretical analysis and simulation results show that the algorithm can reduce the complexity and repair of the codec, and reduce the disk I/O overhead. In this case, the storage cost of the algorithm is consistent with the storage cost based on the minimum storage regeneration code algorithm, and the repair bandwidth cost is close to the minimum bandwidth regeneration code algorithm.

2014 ◽  
Vol 556-562 ◽  
pp. 6241-6245 ◽  
Author(s):  
Kai Guo ◽  
Peng Yan Shen ◽  
Ming Zhong Xiao

In this paper, we present UBackup, which describes an easy way to build a private cloud storage system with high-efficient and high-disaster-tolerance. UBackup client enables file-level de-duplication by using a file fingerprint check. The utilization of compressed erasure code algorithm ensures data security and cuts down the cost. A space utilization rate variance minimizing algorithm is used on index server to balance system load. We present the system architecture of UBackup and its components, and we have implemented a proof-of-concept prototype of UBackup. By conducting performance evaluation in a public Internet, experimental results demonstrate the efficiency of the system.


2020 ◽  
Vol 17 (4) ◽  
pp. 1937-1942
Author(s):  
S. Sivasankari ◽  
V. Lavanya ◽  
G. Saranya ◽  
S. Lavanya

These days, Cloud storage is gaining importance among individual and institutional users. Individual and foundations looks for cloud server as a capacity medium to diminish their capacity load under nearby devices. In such storage services, it is necessary to avoid duplicate content/repetitive storage of same data to be avoided. By reducing the duplicate content in cloud storage reduces storage cost. De-duplication is necessary when multiple data owner outsource the same data, issues related to security and ownership to be considered. As the cloud server is always considered to be non trusted, as it is maintained by third party, thus the data stored in cloud is always encrypted and uploaded, thus randomization property of encryption affects de-duplication. It is necessary to propose a serverside de-duplication scheme for handling encrypted data. The proposed scheme allows the cloud server to control access to outsourced data even when the ownership changes dynamically.


2015 ◽  
Vol 4 (4) ◽  
pp. 286-289 ◽  
Author(s):  
Qingzhuang Zhao ◽  
◽  
Kun Li ◽  
Hui Li ◽  
Yunmin Wang ◽  
...  

2013 ◽  
Vol 717 ◽  
pp. 789-793
Author(s):  
Jun Wei Ge ◽  
Ai Hua Miao ◽  
Yi Qiu Fang

Erasure codes received extensive attention in the cloud storage system because of its effective on saving storage space,However, due to the high recovery-overhead of erasure code, its application has been limited in these storage systems.For these problems,in this paper,we presents A multi-server Erasure code algorithm based on the degree of restriction to reduce the recovery-overhead from the restriction of date and parity's degree,and enhance the system performance to a certain extent ,ensure the reliability of the data of the cloud storage environment.


2020 ◽  
Vol 245 ◽  
pp. 04011
Author(s):  
Ofer Rind ◽  
Hironori Ito ◽  
Guangwei Che ◽  
Tim Chou ◽  
Robert Hancock ◽  
...  

Large scientific data centers have recently begun providing a number of different types of data storage in order to satisfy the various needs of their users. Users with interactive accounts, for example, might want a POSIX interface for easy access to the data from their interactive machines. Grid computing sites, on the other hand, likely need to provide an X509-based storage protocol, like SRM and GridFTP, since the data management system is built upon them. Meanwhile, an experiment producing large amounts of data typically demands a service that provides archival storage for the safe keeping of their unique data. To access these various types of data, users must use specific sets of commands tailored to their respective storage, making access to their data complex and difficult. BNLBox is an attempt to provide a unified and easy to use storage service for all BNL users, to store their important documents, code and data. It is a cloud storage system with an intuitive web interface for novice users. It provides an automated synchronization feature that enables users to upload data to their cloud storage without manual intervention, freeing them to focus on analysis rather than data management software. It provides a POSIX interface for local interactive users, which simplifies data access from batch jobs as well. At the same time, it also provides users with a straightforward mechanism for archiving large data sets for later processing. The storage space can be used for both code and data within the compute job environment. This paper will describe various aspects of the BNLBox storage service.


Information ◽  
2021 ◽  
Vol 12 (4) ◽  
pp. 142
Author(s):  
Weijing You ◽  
Lei Lei ◽  
Bo Chen ◽  
Limin Liu

By only storing a unique copy of duplicate data possessed by different data owners, deduplication can significantly reduce storage cost, and hence is used broadly in public clouds. When combining with confidentiality, deduplication will become problematic as encryption performed by different data owners may differentiate identical data which may then become not deduplicable. The Message-Locked Encryption (MLE) is thus utilized to derive the same encryption key for the identical data, by which the encrypted data are still deduplicable after being encrypted by different data owners. As keys may be leaked over time, re-encrypting outsourced data is of paramount importance to ensure continuous confidentiality, which, however, has not been well addressed in the literature. In this paper, we design SEDER, a SEcure client-side Deduplication system enabling Efficient Re-encryption for cloud storage by (1) leveraging all-or-nothing transform (AONT), (2) designing a new delegated re-encryption (DRE), and (3) proposing a new proof of ownership scheme for encrypted cloud data (PoWC). Security analysis and experimental evaluation validate security and efficiency of SEDER, respectively.


Sign in / Sign up

Export Citation Format

Share Document