scholarly journals Single node failure repair method for distributed storage system based on genetic algorithm and MSR code

2021 ◽  
Vol 1982 (1) ◽  
pp. 012163
Author(s):  
Xiaoyue Qiu ◽  
Tiantian Wang ◽  
Enze Lin ◽  
Zongpeng Lu
2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Miao Ye ◽  
Ruoyu Wei ◽  
Wei Guo ◽  
Qiuxiang Jiang ◽  
Hongbing Qiu ◽  
...  

As a storage method for a distributed storage system, an erasure code can save storage space and repair the data of failed nodes. However, most studies that discuss the repair of fault nodes in the erasure code mode only focus on the condition that the bandwidth of heterogeneous links restricts the repair rate but ignore the condition that the storage node is heterogeneous, the cost of repair traffic in the repair process, and the influence of the failure of secondary nodes on the repair process. An optimal repair strategy based on the minimum storage regenerative (MSR) code and a hybrid genetic algorithm is proposed for single-node fault scenarios to solve the above problems. In this work, the single-node data repair problem is modeled as an optimization problem of an optimal Steiner tree with constraints considering heterogeneous link bandwidth and heterogeneous node processing capacity and takes repair traffic and repair delay as optimization objectives. After that, a hybrid genetic algorithm is designed to solve the problem. The experimental results show that under the same scales used in the MSR code cases, our approach has good robustness and its repair delay decreases by 10% and 55% compared with the conventional tree repair topology and star repair topology, respectively; the repair flow increases by 10% compared with the star topology, and the flow rate of the conventional tree repair topology decreases by 40%.


2012 ◽  
pp. 669-679
Author(s):  
Dominic Cherry ◽  
Maozhen Li ◽  
Man Qi

This chapter presents MediaGrid, a distributed storage system for archiving broadcast media contents. MediaGrid utilizes storage resources donated by computing nodes running in a distributed computing environment. A genetic algorithm for resource selection is built in MediaGrid with the aim to optimize the utilization of resources available for archiving media files with various sizes. Evaluation results show the effectiveness of MediaGrid in archiving broadcast media contents, and the performance of the genetic algorithm in resource utilization optimization


Author(s):  
Dominic Cherry ◽  
Maozhen Li ◽  
Man Qi

This chapter presents MediaGrid, a distributed storage system for archiving broadcast media contents. MediaGrid utilizes storage resources donated by computing nodes running in a distributed computing environment. A genetic algorithm for resource selection is built in MediaGrid with the aim to optimize the utilization of resources available for archiving media files with various sizes. Evaluation results show the effectiveness of MediaGrid in archiving broadcast media contents, and the performance of the genetic algorithm in resource utilization optimization.


Sign in / Sign up

Export Citation Format

Share Document