Performance Implications of Periodic Checkpointing on Large-Scale Cluster Systems

Author(s):  
A.J. Oliner ◽  
R.K. Sahoo ◽  
J.E. Moreira ◽  
M. Gupta
Keyword(s):  

2007 ◽  
Vol 20 (1) ◽  
pp. 75-97 ◽  
Author(s):  
Bahman Javadi ◽  
Jemal H. Abawajy ◽  
Mohammad K. Akbari


Author(s):  
Xiaoyu Fu ◽  
Rui Ren ◽  
Jianfeng Zhan ◽  
Wei Zhou ◽  
Zhen Jia ◽  
...  
Keyword(s):  


2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Bingzheng Li ◽  
Jinchen Xu ◽  
Zijing Liu

With the development of high-performance computing and big data applications, the scale of data transmitted, stored, and processed by high-performance computing cluster systems is increasing explosively. Efficient compression of large-scale data and reducing the space required for data storage and transmission is one of the keys to improving the performance of high-performance computing cluster systems. In this paper, we present SW-LZMA, a parallel design and optimization of LZMA based on the Sunway 26010 heterogeneous many-core processor. Combined with the characteristics of SW26010 processors, we analyse the storage space requirements, memory access characteristics, and hotspot functions of the LZMA algorithm and implement the thread-level parallelism of the LZMA algorithm based on Athread interface. Furthermore, we make a fine-grained layout of LDM address space to achieve DMA double buffer cyclic sliding window algorithm, which optimizes the performance of SW-LZMA. The experimental results show that compared with the serial baseline implementation of LZMA, the parallel LZMA algorithm obtains a maximum speedup ratio of 4.1 times using the Silesia corpus benchmark, while on the large-scale data set, speedup is 5.3 times.



Author(s):  
Bahman Javadi ◽  
Jemal Abawajy ◽  
Mohammad Akbari ◽  
Saeid Nahavandi


Author(s):  
Wei Zhou ◽  
Jianfeng Zhan ◽  
Dan Meng ◽  
Zhihong Zhang


Sign in / Sign up

Export Citation Format

Share Document