scholarly journals A Novel Repairable Fountain Codes Scheme Based on Partial Duplication Technique

2021 ◽  
Author(s):  
Anan Zhou ◽  
Benshun Yi ◽  
Mian Xiang ◽  
Laigan Luo
Keyword(s):  
Fault Tolerance ◽  
Distributed Storage ◽  
Low Cost ◽  
Storage System ◽  
Erasure Codes ◽  
Fountain Codes ◽  
Partial Duplication ◽  
Storage Network ◽  
Source Data ◽  
And Storage

Abstract Distributed storage system (DSS) is an emerging paradigm which provides reliable storage services for various source data. As the fault-tolerance scheme for DSS, erasure codes are required to provide redundancy service with high fault-tolerance and low cost. However, the existing coding scheme cannot provide these requirements well. Thus, it becomes an important yet challenging issue to find a code for storing various source data with high fault-tolerance and low cost. In this paper, a novel construction of repairable fountain codes with unequal locality is proposed by combining with partial duplication tech- nique, namely the PD-ULRFC scheme. We construct a multi-tier heterogeneous storage network, where data core, processing units and storage nodes collaboratively store and transmit data. Moreover, the proposed PD-ULRFC scheme can reduce the repair and download cost by sacrificing a little extra storage occupation. Furthermore, the expressions of the repair cost and download cost are derived to analyze the performance of PD-ULRFC scheme. The simulation results demonstrate that the PD-ULRFC scheme significantly outperforms other redundant schemes in communication cost saving.

scholarly journals Design and implementation of a low-cost device for measuring sap flow in woody species

DYNA ◽  
2019 ◽  
Vol 86 (208) ◽  
pp. 214-220
Author(s):  
María Fernanda Cárdenas ◽  
Cristina López Ramírez ◽  
Juan Diego Mejía ◽  
Jhon Fredy Escobar
Keyword(s):  
Sap Flow ◽  
Flow Measurement ◽  
Electronic Circuit ◽  
Low Cost ◽  
Storage System ◽  
Woody Species ◽  
Ratio Method ◽  
Ecosystem Level ◽  
Plant Level ◽  
And Storage

Transpiration is a key variable in water balance. Sap flow measurement methods allow to estimate transpiration at plant level, but scalable at the stand, river basin or ecosystem level. This requires recording data continuously, for which there are commercial devices, but they are specialized and expensive. This document shows that it is possible to integrate a data capture, management and storage system, as a counterpart to a commercial system such as Campbell's CR-100, for measuring and recording environmental variables, with a notable reduction in costs. The methodology used to develop a device for the estimation of sap flow using the heat ratio method, the design of the Arduino-based  electronic circuit and the software, with register 13-64-171 of the Dirección Nacional de Derechos de Autor, is presented.

scholarly journals Analysis of data integrity and storage quality of a distributed storage system

2021 ◽  
Vol 251 ◽  
pp. 02035
Author(s):  
Adrian Eduard Negru ◽  
Latchezar Betev ◽  
Mihai Carabaș ◽  
Costin Grigoraș ◽  
Nicolae Țăpuş ◽  
...  
Keyword(s):  
Data Storage ◽  
Distributed Storage ◽  
Storage System ◽  
Essential Element ◽  
Data Access ◽  
Distributed Data ◽  
Distributed Data Storage ◽  
Data Lifetime ◽  
Operational Issues ◽  
And Storage

CERN uses the world’s largest scientific computing grid, WLCG, for distributed data storage and processing. Monitoring of the CPU and storage resources is an important and essential element to detect operational issues in its systems, for example in the storage elements, and to ensure their proper and efficient function. The processing of experiment data depends strongly on the data access quality, as well as its integrity and both of these key parameters must be assured for the data lifetime. Given the substantial amount of data, O(200 PB), already collected by ALICE and kept at various storage elements around the globe, scanning every single data chunk would be a very expensive process, both in terms of computing resources usage and in terms of execution time. In this paper, we describe a distributed file crawler that addresses these natural limits by periodically extracting and analyzing statistically significant samples of files from storage elements, evaluates the results and is integrated with the existing monitoring solution, MonALISA.

A Distributed Storage Algorithm Based on Cauchy RS Code

2013 ◽  
Vol 336-338 ◽  
pp. 2188-2194
Author(s):  
Xing Gao ◽  
Min Li ◽  
Juan Juan Huang ◽  
Bing Chang Liu
Keyword(s):  
Fault Tolerance ◽  
Data Center ◽  
Distributed Storage ◽  
Erasure Codes ◽  
Data Encoding ◽  
Multiplication Operation ◽  
Rs Code ◽  
Rs Coding ◽  
Encoding Efficiency ◽  
Better Than

Data fault tolerance is a key technology in the field of distributed storage. In this paper, an algorithm to encode massive amounts of data and then distribute storage these data on each node in the data center is proposed, aiming at coping with the serious challenges in the protection of data fault tolerance. The method converts multiplication operation in Cauchy RS coding into a binary multiplication through the transition on bit operation, so that the entire operation on RS encoding is converted to an operation containing only simple XOR operator. The experiment proves that the method is better than the copy and the original RS coding in the data encoding efficiency. Furthermore, it saves the storage space and promotes the application of erasure codes strongly in distributed storage field.

Sign in / Sign up

Export Citation Format

Share Document