Performance Implications of Periodic Checkpointing on Large-Scale Cluster Systems

2005 ◽  
Author(s):  
A.J. Oliner ◽  
R.K. Sahoo ◽  
J.E. Moreira ◽  
M. Gupta
Keyword(s):  
Large Scale ◽  
Cluster Systems

A comprehensive analytical model of interconnection networks in large-scale cluster systems

2007 ◽  
Vol 20 (1) ◽  
pp. 75-97 ◽  
Author(s):  
Bahman Javadi ◽  
Jemal H. Abawajy ◽  
Mohammad K. Akbari
Keyword(s):  
Analytical Model ◽  
Interconnection Networks ◽  
Large Scale ◽  
Cluster Systems

scholarly journals LogMaster: Mining Event Correlations in Logs of Large-Scale Cluster Systems

2012 ◽  
Author(s):  
Xiaoyu Fu ◽  
Rui Ren ◽  
Jianfeng Zhan ◽  
Wei Zhou ◽  
Zhen Jia ◽  
...  
Keyword(s):  
Large Scale ◽  
Cluster Systems

scholarly journals SW-LZMA: Parallel Implementation of LZMA Based on SW26010 Many-Core Processor

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Bingzheng Li ◽  
Jinchen Xu ◽  
Zijing Liu
Keyword(s):  
High Performance Computing ◽  
High Performance ◽  
Large Scale ◽  
Cluster Systems ◽  
Large Scale Data ◽  
Many Core ◽  
High Performance Computing Cluster ◽  
Performance Computing ◽  
Scale Data ◽  
Computing Cluster

With the development of high-performance computing and big data applications, the scale of data transmitted, stored, and processed by high-performance computing cluster systems is increasing explosively. Efficient compression of large-scale data and reducing the space required for data storage and transmission is one of the keys to improving the performance of high-performance computing cluster systems. In this paper, we present SW-LZMA, a parallel design and optimization of LZMA based on the Sunway 26010 heterogeneous many-core processor. Combined with the characteristics of SW26010 processors, we analyse the storage space requirements, memory access characteristics, and hotspot functions of the LZMA algorithm and implement the thread-level parallelism of the LZMA algorithm based on Athread interface. Furthermore, we make a fine-grained layout of LDM address space to achieve DMA double buffer cyclic sliding window algorithm, which optimizes the performance of SW-LZMA. The experimental results show that compared with the serial baseline implementation of LZMA, the parallel LZMA algorithm obtains a maximum speedup ratio of 4.1 times using the Silesia corpus benchmark, while on the large-scale data set, speedup is 5.3 times.

Analytical Network Modeling of Heterogeneous Large-Scale Cluster Systems

2006 ◽  
Author(s):  
Bahman Javadi ◽  
Jemal Abawajy ◽  
Mohammad Akbari ◽  
Saeid Nahavandi
Keyword(s):  
Large Scale ◽  
Network Modeling ◽  
Cluster Systems

scholarly journals Online Event Correlations Analysis in System Logs of Large-Scale Cluster Systems

2010 ◽  
pp. 262-276 ◽  
Author(s):  
Wei Zhou ◽  
Jianfeng Zhan ◽  
Dan Meng ◽  
Zhihong Zhang
Keyword(s):  
Large Scale ◽  
Cluster Systems ◽  
System Logs
Sign in / Sign up

Export Citation Format

Share Document