Key Distributed Components for a Large-Scale Object Storage

Author(s):  
Miriam Allalouf ◽  
Ghislain Chevalier ◽  
Danny Harnik ◽  
Sivan Tal

This chapter discusses distributed mechanisms that serve as building blocks in the construction of the VISION Cloud object service. Two are fundamental building blocks in the creation of a large-scale clustered object storage. These are distributed file systems and distributed data management systems. In addition, the authors study two complimentary topics that aim to improve the qualities of the underlying infrastructure. These are resource allocation mechanisms and improvements to data mobility via data reduction.

2013 ◽  
pp. 294-321
Author(s):  
Alexandru Costan

To accommodate the needs of large-scale distributed systems, scalable data storage and management strategies are required, allowing applications to efficiently cope with continuously growing, highly distributed data. This chapter addresses the key issues of data handling in grid environments focusing on storing, accessing, managing and processing data. We start by providing the background for the data storage issue in grid environments. We outline the main challenges addressed by distributed storage systems: high availability which translates into high resilience and consistency, corruption handling regarding arbitrary faults, fault tolerance, asynchrony, fairness, access control and transparency. The core part of the chapter presents how existing solutions cope with these high requirements. The most important research results are organized along several themes: grid data storage, distributed file systems, data transfer and retrieval and data management. Important characteristics such as performance, efficient use of resources, fault tolerance, security, and others are strongly determined by the adopted system architectures and the technologies behind them. For each topic, we shortly present previous work, describe the most recent achievements, highlight their advantages and limitations, and indicate future research trends in distributed data storage and management.


2017 ◽  
Vol 2 (3) ◽  
pp. 161
Author(s):  
S. Sathya ◽  
M. Ranjith Kumar ◽  
K. Madheswaran

The keyestablishment for secure many-to-many communications is very important nowadays. The problem is inspired by the proliferation of large-scale distributed file systems supporting parallel access to multiple storage devices. In this, a variety of authenticated key exchange protocols that are designed to address the issues. This shows that these protocols are capable of reducing the workload of the metadata server and concurrently supporting forward secrecy and escrow-freeness. All this requires only a small fraction of increased computation overhead at the client. This proposed three authenticated key exchange protocols for parallel network file system (pNFS). The protocols offer three appealing advantages over the existing Kerberos-based protocol. First, the metadata server executing these protocols has much lower workload than that of the Kerberos-based approach. Second, two of these protocols provide forward secrecy: one is partially forward secure (with respect to multiple sessions within a time period), while the other is fully forward secure (with respect to a session). Third, designed a protocol which not only provides forward secrecy, but is also escrow-free.


2019 ◽  
Vol 30 (9) ◽  
pp. 1962-1974 ◽  
Author(s):  
Yuanning Gao ◽  
Xiaofeng Gao ◽  
Xiaochun Yang ◽  
Jiaxi Liu ◽  
Guihai Chen

Sign in / Sign up

Export Citation Format

Share Document