Personal Storage Grid Architecture

2010 ◽  
Vol 2 (3) ◽  
pp. 17-30 ◽  
Author(s):  
Mian-Guan Lim ◽  
Sining Wu ◽  
Tomasz Simon ◽  
Md Rashid ◽  
Na Helian

On-demand cloud applications like online email accounts and online virtual disk space are becoming widely available in various forms. In cloud applications, one can see the importance of underlying resources, such as disk space, that is available to the end-user but not easily accessible. In the authors’ study, a modern file system developed in linux is proposed, which enables consuming of cloud applications and making the underlying disk space resource available to the end-user. This system is developed as a web service to support cross operation system support. A free online mail account was used to demonstrate this solution, and an IMAP protocol to communicate with remote data spaces was used so that this method can mount onto any email system that supports IMAP. The authors’ definition of infinite storage as the user is able to mount file systems as a single logical drive.

Author(s):  
Mian-Guan Lim ◽  
Sining Wu ◽  
Tomasz Simon ◽  
Md Rashid ◽  
Na Helian

On-demand cloud applications like online email accounts and online virtual disk space are becoming widely available in various forms. In cloud applications, one can see the importance of underlying resources, such as disk space, that is available to the end-user but not easily accessible. In the authors’ study, a modern file system developed in linux is proposed, which enables consuming of cloud applications and making the underlying disk space resource available to the end-user. This system is developed as a web service to support cross operation system support. A free online mail account was used to demonstrate this solution, and an IMAP protocol to communicate with remote data spaces was used so that this method can mount onto any email system that supports IMAP. The authors’ definition of infinite storage as the user is able to mount file systems as a single logical drive.


2021 ◽  
Author(s):  
Stefan Versick ◽  
Thomas Fischer ◽  
Ole Kirner ◽  
Tobias Meisel ◽  
Jörg Meyer

<p>Earth System Models (ESM) got much more demanding over the last years. Modelled processes got more complex and more and more processes are considered in models. In addition resolutions of the models got higher to improve accuracy of predictions. This requires faster high performance computers (HPC) and better I/O performance. One way to improve I/O performance is to use faster file systems. Last year we showed the impact of the ad-hoc file system on the performance of the ESM EMAC. An ad-hoc file system is a private parallel file system which is created on-demand for an HPC job using the node-local storage devices, in our case solid-state-disks (SSD). It only exists during the runtime of the job. Therefore output data have to be moved to a permanent file system before the job has finished. Performance improvements are due to the use of SSDs in case of small chunks of I/O or a high amount of I/O operations per second. Another reason for a performace boost is because the running job can exclusively access the file system. To get a better overview in which cases ESMs benefit from using ad-hoc file systems we repeated our performance tests with further ESMs with different I/O strategies. In total we now analyzed EMAC (parallel netcdf), ICON2.5 (netcdf with asynchronous I/O), ICON2.6 (netcdf with Climate Data Interface (CDI) library) and OpenGeoSys (parallel VTU).</p>


2014 ◽  
Vol 602-605 ◽  
pp. 3481-3484
Author(s):  
Zhi Hao Wu

Traditional file systems have some shortages in storing small files, such as randomness of data layout, waste of disk space and lack of inode resources. In this thesis, a log-structured file system named LevelFS based on LevelDB is presented. By setting the write buffer, it can make disk randomized writes of small files into disk sequential writes, and reduce the distance of related data, so as to improve the read and write performance of file system. Experiments show that LevelFS can greatly improve read and write performance of small files without affect the large ones.


Author(s):  
Mustapha Mohammed Baua'a

The I\O file system Read\Write operations are considered the most significant characteristics. Where, many researchers focus on their works on how to decrease the response time of I\O file system read\write operations. However, most articles concentrate on how to read\write content of the file in parallelism manner. Here in this paper, the author considers the parallelizing Read\Write whole file bytes not only its contents. A case study has been applied in order to make the idea more clear. It talks about two techniques of uploading\downloading files via Web Service. The first one is a traditional way where the files uploaded and downloaded serially. While the second one is uploaded\ downloaded files using Java thread in order to simulate parallelism technique. Java Netbeans 8.0.2 have been used as a programming environment to implement the Download\Upload files through Web Services. Validation results are also presented via using Mat-lab platform as benchmarks. The visualized figures of validation results are clearly clarifying that the second technique shows better response time in comparison to the traditional way.


Author(s):  
Clara Betancourt ◽  
Björn Hagemeier ◽  
Sabine Schröder ◽  
Martin G. Schultz

AbstractWe present context-aware benchmarking and performance engineering of a mature TByte-scale air quality database system which was created by the Tropospheric Ozone Assessment Report (TOAR) and contains one of the world’s largest collections of near-surface air quality measurements. A special feature of our data service https://join.fz-juelich.de is on-demand processing of several air quality metrics directly from the TOAR database. As a service that is used by more than 350 users of the international air quality research community, our web service must be easily accessible and functionally flexible, while delivering good performance. The current on-demand calculations of air quality metrics outside the database together with the necessary transfer of large volume raw data are identified as the major performance bottleneck. In this study, we therefore explore and benchmark in-database approaches for the statistical processing, which results in performance enhancements of up to 32%.


2012 ◽  
Vol 263-266 ◽  
pp. 1979-1986
Author(s):  
Qiang Li ◽  
Li Gu Zhu ◽  
Sai Feng Zeng

Updates discovery is the key problem of data synchronization; it has been used to generate updates operations. The traditional algorithms ignore the modify semanteme, cause the updates operations increased. A new file updating discovery algorithm that supports semantic synchronization is proposed in this paper. The algorithm takes advantage of semantic info, which preserved in file system journal, to accurately recognize users originally modify intents. We take the NTFS file system as an example to realize and test the new algorithm. By comparison, the algorithm effectively reduces synchronization requests. Experiments show that, the algorithm cans timely respond to users’ modification and support massive file changes that occurred in short time. The algorithm is designed based on the basic features of file system journal, and can be applied to other file systems.


2021 ◽  
Vol 17 (3) ◽  
pp. 1-25
Author(s):  
Bohong Zhu ◽  
Youmin Chen ◽  
Qing Wang ◽  
Youyou Lu ◽  
Jiwu Shu

Non-volatile memory and remote direct memory access (RDMA) provide extremely high performance in storage and network hardware. However, existing distributed file systems strictly isolate file system and network layers, and the heavy layered software designs leave high-speed hardware under-exploited. In this article, we propose an RDMA-enabled distributed persistent memory file system, Octopus + , to redesign file system internal mechanisms by closely coupling non-volatile memory and RDMA features. For data operations, Octopus + directly accesses a shared persistent memory pool to reduce memory copying overhead, and actively fetches and pushes data all in clients to rebalance the load between the server and network. For metadata operations, Octopus + introduces self-identified remote procedure calls for immediate notification between file systems and networking, and an efficient distributed transaction mechanism for consistency. Octopus + is enabled with replication feature to provide better availability. Evaluations on Intel Optane DC Persistent Memory Modules show that Octopus + achieves nearly the raw bandwidth for large I/Os and orders of magnitude better performance than existing distributed file systems.


2011 ◽  
Vol 3 (3) ◽  
pp. 361-374
Author(s):  
Marcos Livato ◽  
Gideon Carvalho de Benedicto

The new "molds" of competitiveness have suggested that the attentions should be focused on an efficient management of the supply chain in the supermarket departments, starting from the producer until the end user of the products, reducing the operational costs. It's known that the elimination of some of these stages of intermediation of the ways of distribution can represent to the small and mediums retailers an important competitive advantage, with the elimination of the additional costs charged by the intermediaries. The objective of this work is to propose a model of restructuring  of the ways of distribution in the brazilian retail of  food through of the strategy, inducing the elimination of the intermediaries. The search of the bibliography was used like basement to the definition of the methodology of this search, that was realized through of an observational study realized with nineteen Central Business Supermarket s in the state of São Paulo. To do the collection of the datas was prepared a questionary with specific questions. After the collection of the datas and tab, were used techniques quantitive  of analysis of datas through of SAS system. The study intends to discuss the proposal of the cooperation's networks like a strategic alternative, with the possibility of elimination of some phases of intermediation of the distribuition's ways.


2019 ◽  
Vol 3 (9) ◽  
pp. 283-289
Author(s):  
Shuchi Sukul ◽  
Goldy Rathee ◽  
Parimal Anand ◽  
Sakshi Kataria ◽  
Pratibha Taneja

OBJECTIVES: The present research was conducted to assess incidences of root microcracks caused by hand and rotary file system at different lengths MATERIAL AND METHODS: This in-vitro study was undertaken to assess incidence of root microcracks caused by hand and rotary file system at different lengths In total, 100 the mandibular premolar with straight roots determined with intact, fully formed apices were taken. Samples were randomly distributed into 5 groups based on the file system used: a) Group A: Control, b) Group B: Reciproc, c) Group C: WaveOne, d) Group D: One Shape and e) Group E: ProTaper. Pearson Chi-square test was used to determine the differences between groups. The dentinal defects were expressed as percentage of samples with microcracks in each group. Level of statistical significance was set at p-value less than 0.05. RESULTS: The chi square test was used to compare the Distribution of the number of teeth in which cracks were observed on the horizontal sections. It was found to be significant with group ProTaper showing maximum cracks at 3,6,9 mm level as compared to other file systemCONCLUSION: Nickel-titanium instruments causes cracks on the apical root surface or in the root canal wall. ProTaper causes maximum dentinal cracks as compared to other file systems


Author(s):  
Ferdinando Filetto ◽  
Renato Luiz Grisi Macedo

O tema central deste trabalho refere-se a indicadores de sustentabilidade. Os objetivos foram: propor indicadores de sustentabilidade para o ecoturismo, considerando os componentes ambiental, social e econômico, considerados como indicadores biofísicos (ambiental) e socioeconômicos (social e econômico). Utilizou-se de um roteiro para a definição dos indicadores de sustentabilidade, identificando-se essas categorias significativas: recursos endógenos, operação do sistema endógeno, recursos exógenos e operação dos sistemas exógenos. Foram determinados 98 indicadores, sendo que 19 foram do elemento natural (explicitados como sendo a água, o solo, o ar, a flora e a fauna), 10 do elemento cultural (apresentados como patrimônio histórico, artístico, cultural e paleo-antropo-arqueológico), 25 do elemento social e 4 do elemento econômico. Sustainable Development Indicators for Ecotourism in Protect Areas ABSTRACT The main subject of this work refers to sustainable indictors. The objectives were: propose sustainable indicators for the ecotourism, considering social, economic and environmental components, considered as indicating biophysical (environmental) and socioeconomics (social and economic). A script was used for the definition of the sustainable indicators, identifying these significant categories: endogenous resources, endogenous operation system, exogenous resources and operation of exogenous resources. Were determined 98 indicators, wherein 19 were of the natural element (explained as water, soil, air, the flora and fauna), 10 of the cultural element (submitted as historical, artistic, cultural and paleo-antropo-archaeological heritage), 25 of social element and 4 of the economic element. KEYWORDS: : Indicators; Sustainable; Ecotourism; Protect Areas.


Sign in / Sign up

Export Citation Format

Share Document