Measuring file access patterns in UNIX

1986 ◽  
Vol 14 (2) ◽  
pp. 15-20 ◽  
Author(s):  
Irene Hu
Keyword(s):  
Author(s):  
Shou-Hsuan S. Huang ◽  
Zechun Cao ◽  
Calvin E. Raines ◽  
Mai N. Yang ◽  
Camille Simon

Author(s):  
Alexandra Glagoleva ◽  
Archana Sathaye

In  this  paper,  we  present  a  new  methodology  for managing read-write filesets  across  multiple  file servers of a Distributed File System, thus balancing  the  load  of  file access requests across servers. The proposed methodology is based on a rule-based data mining technique and graph theory algorithms.   The  rule-based technique generates rules from access request data  to  identify  present file access patterns in the system. We then use the  rules,  graph  analysis and statistical information (usage and size of the  filesets) to relocate the filesets between different file servers. The algorithm for fileset relocation is based on the graph coloring problem. We tested our algorithms on data collected for five months on DFS file servers in  a  production  environment.   Experiments  with  the data show that our methodology  can  make intelligent decisions about file system transfers in order to balance the access request load across DFS servers.


Author(s):  
Boonthanome Nouanesengsy ◽  
John Patchett ◽  
James Ahrens ◽  
Andrew Bauer ◽  
Aashish Chaudhary ◽  
...  

Electronics ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 164 ◽  
Author(s):  
Donghee Shin ◽  
Kyungwoon Cho ◽  
Hyokyung Bahn

Rendering is the process of generating high-resolution images by software, which is widely used in animation, video games and visual effects in movies. Although rendering is a computation-intensive job, we observe that storage accesses may become another performance bottleneck in desktop-rendering systems. In this article, we present a new buffer cache management scheme specialized for rendering systems. Unlike general-purpose computing systems, rendering systems exhibit specific file access patterns, and we show that this results in significant performance degradation in the buffer cache system. To cope with this situation, we collect various file input/output (I/O) traces of rendering workloads and analyze their access patterns. The results of this analysis show that file I/Os in rendering processes consist of long loops for configuration, short loops for texture input, random reads for input, and single-writes for output. Based on this observation, we propose a new buffer cache management scheme for improving the storage performance of rendering systems. Experimental results show that the proposed scheme improves the storage I/O performance by an average of 19% and a maximum of 55% compared to the conventional buffer cache system.


Author(s):  
Chih-Song Kuo ◽  
Aamer Shah ◽  
Akihiro Nomura ◽  
Satoshi Matsuoka ◽  
Felix Wolf
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document