scholarly journals HDF Cloud – Helmholtz Data Federation Cloud Resources at the Jülich Supercomputing Centre

Author(s):  
Björn Hagemeier

The HDF Cloud is an OpenStack based infrastructure-as-a-service (IaaS) environment operated by Jülich Supercomputing Centre (JSC) at Forschungszentrum Jülich. It has been installed predominantly to support challenging data use cases within the Helmholtz Association’s strategic initiative Helmholtz Data Federation (HDF). To this end, it has been connected to one of the central storage resources of JSC, the DATA file system that is also available on the high-performance computing systems.

Author(s):  
Simon McIntosh–Smith ◽  
Rob Hunt ◽  
James Price ◽  
Alex Warwick Vesztrocy

High-performance computing systems continue to increase in size in the quest for ever higher performance. The resulting increased electronic component count, coupled with the decrease in feature sizes of the silicon manufacturing processes used to build these components, may result in future exascale systems being more susceptible to soft errors caused by cosmic radiation than in current high-performance computing systems. Through the use of techniques such as hardware-based error-correcting codes and checkpoint-restart, many of these faults can be mitigated at the cost of increased hardware overhead, run-time, and energy consumption that can be as much as 10–20%. Some predictions expect these overheads to continue to grow over time. For extreme scale systems, these overheads will represent megawatts of power consumption and millions of dollars of additional hardware costs, which could potentially be avoided with more sophisticated fault-tolerance techniques. In this paper we present new software-based fault tolerance techniques that can be applied to one of the most important classes of software in high-performance computing: iterative sparse matrix solvers. Our new techniques enables us to exploit knowledge of the structure of sparse matrices in such a way as to improve the performance, energy efficiency, and fault tolerance of the overall solution.


Sign in / Sign up

Export Citation Format

Share Document