Two-level Hash/Table approach for metadata management in distributed file systems

2012 ◽  
Vol 64 (1) ◽  
pp. 144-155 ◽  
Author(s):  
Antonio F. Díaz ◽  
Mancia Anguita ◽  
Hugo E. Camacho ◽  
Erik Nieto ◽  
Julio Ortega
Keyword(s):  
Hash Table ◽  
File Systems ◽  
Metadata Management ◽  
Distributed File Systems

An Efficient Ring-Based Metadata Management Policy for Large-Scale Distributed File Systems

2019 ◽  
Vol 30 (9) ◽  
pp. 1962-1974 ◽  
Author(s):  
Yuanning Gao ◽  
Xiaofeng Gao ◽  
Xiaochun Yang ◽  
Jiaxi Liu ◽  
Guihai Chen
Keyword(s):  
Large Scale ◽  
File Systems ◽  
Management Policy ◽  
Metadata Management ◽  
Distributed File Systems

scholarly journals Log-Less Metadata Management on Metadata Server for Parallel File Systems

2014 ◽  
Vol 2014 ◽  
pp. 1-8
Author(s):  
Jianwei Liao ◽  
Guoqiang Xiao ◽  
Xiaoning Peng
Keyword(s):  
Performance Improvement ◽  
File System ◽  
File Systems ◽  
Metadata Management ◽  
Distributed File Systems ◽  
Data Throughput ◽  
Management Schemes ◽  
Metadata Processing ◽  
Metadata Server ◽  
Metadata Service

This paper presents a novel metadata management mechanism on the metadata server (MDS) for parallel and distributed file systems. In this technique, the client file system backs up the sent metadata requests, which have been handled by the metadata server, so that the MDS does not need to log metadata changes to nonvolatile storage for achieving highly available metadata service, as well as better performance improvement in metadata processing. As the client file system backs up certain sent metadata requests in its memory, the overhead for handling these backup requests is much smaller than that brought by the metadata server, while it adopts logging or journaling to yield highly available metadata service. The experimental results show that this newly proposed mechanism can significantly improve the speed of metadata processing and render a better I/O data throughput, in contrast to conventional metadata management schemes, that is, logging or journaling on MDS. Besides, a complete metadata recovery can be achieved by replaying the backup logs cached by all involved clients, when the metadata server has crashed or gone into nonoperational state exceptionally.

scholarly journals Design and Implementation of a Metadata Management Scheme for Large Distributed File Systems

2009 ◽  
Vol E92-D (7) ◽  
pp. 1475-1478 ◽  
Author(s):  
Jong Hyeon YUN ◽  
Yong Hun PARK ◽  
Dong Min SEO ◽  
Seok Jae LEE ◽  
Jae Soo YOO
Keyword(s):  
File Systems ◽  
Metadata Management ◽  
Distributed File Systems ◽  
Design And Implementation ◽  
Management Scheme

PABIRS: A data access middleware for distributed file systems

2015 ◽  
Author(s):  
Sai Wu ◽  
Gang Chen ◽  
Xianke Zhou ◽  
Zhenjie Zhang ◽  
Anthony K. H. Tung ◽  
...  
Keyword(s):  
File Systems ◽  
Data Access ◽  
Distributed File Systems
Sign in / Sign up

Export Citation Format

Share Document