scholarly journals Performance Analysis of Ivshmem for High-Performance Computing in Virtual Machines

2018 ◽  
Vol 960 ◽  
pp. 012015
Author(s):  
Pavle Ivanovic ◽  
Harald Richter
Keyword(s):  
Performance Analysis ◽  
High Performance Computing ◽  
High Performance ◽  
Virtual Machines ◽  
Performance Computing

scholarly journals Viability of Cloud Computing for Real-Time Numerical Weather Prediction

2016 ◽  
Vol 31 (6) ◽  
pp. 1985-1996 ◽  
Author(s):  
David Siuta ◽  
Gregory West ◽  
Henryk Modzelewski ◽  
Roland Schigas ◽  
Roland Stull
Keyword(s):  
Cloud Computing ◽  
High Performance Computing ◽  
Real Time ◽  
Numerical Weather Prediction ◽  
High Performance ◽  
Virtual Machines ◽  
Weather Prediction ◽  
Cloud Platform ◽  
Numerical Weather ◽  
Performance Computing

Abstract As cloud-service providers like Google, Amazon, and Microsoft decrease costs and increase performance, numerical weather prediction (NWP) in the cloud will become a reality not only for research use but for real-time use as well. The performance of the Weather Research and Forecasting (WRF) Model on the Google Cloud Platform is tested and configurations and optimizations of virtual machines that meet two main requirements of real-time NWP are found: 1) fast forecast completion (timeliness) and 2) economic cost effectiveness when compared with traditional on-premise high-performance computing hardware. Optimum performance was found by using the Intel compiler collection with no more than eight virtual CPUs per virtual machine. Using these configurations, real-time NWP on the Google Cloud Platform is found to be economically competitive when compared with the purchase of local high-performance computing hardware for NWP needs. Cloud-computing services are becoming viable alternatives to on-premise compute clusters for some applications.

scholarly journals ComputeOps: Container for High Performance Computing

2020 ◽  
Vol 245 ◽  
pp. 07006
Author(s):  
Cécile Cavet ◽  
Martin Souchal ◽  
Sébastien Gadrat ◽  
Gilles Grasseau ◽  
Andrea Satirana ◽  
...  
Keyword(s):  
High Performance Computing ◽  
High Performance ◽  
Virtual Machines ◽  
Key Concepts ◽  
The Status ◽  
Image Building ◽  
Computing Framework ◽  
Performance Computing ◽  
Linux Containers

The High Performance Computing (HPC) domain aims to optimize code in order to use the latest multicore and parallel technologies including specific processor instructions. In this computing framework, portability and reproducibility are key concepts. A way to handle these requirements is to use Linux containers. These “light virtual machines” allow to encapsulate applications within its environment in Linux processes. Containers have been recently rediscovered due to their abilities to provide both multi-infrastructure environnement for developers and system administrators and reproducibility due to image building file. Two container solutions are emerging: Docker for microservices and Singularity for computing applications. We present here the status of the ComputeOps project which has the goal to study the benefit of containers for HPC applications.

The Impact of Virtualization on High Performance Computing Clustering in the Cloud

2015 ◽  
Vol 6 (4) ◽  
pp. 65-81 ◽  
Author(s):  
Ouidad Achahbar ◽  
Mohamed Riduan Abid
Keyword(s):  
Big Data ◽  
High Performance Computing ◽  
High Performance ◽  
Virtual Machines ◽  
Performance Trends ◽  
Tightly Coupled ◽  
Physical Clusters ◽  
User Friendly ◽  
The Impact ◽  
Performance Computing

The ongoing pervasiveness of Internet access is intensively increasing Big Data production. This, in turn, increases demand on compute power to process this massive data, and thus rendering High Performance Computing (HPC) into a high solicited service. Based on the paradigm of providing computing as a utility, the Cloud is offering user-friendly infrastructures for processing Big Data, e.g., High Performance Computing as a Service (HPCaaS). Still, HPCaaS performance is tightly coupled with the underlying virtualization technique since the latter is responsible for the creation of virtual machines that carry out data processing jobs. In this paper, the authors evaluate the impact of virtualization on HPCaaS. They track HPC performance under different Cloud virtualization platforms, namely KVM and VMware-ESXi, and compare it against physical clusters. Each tested cluster provided different performance trends. Yet, the overall analysis of the findings proved that the selection of virtualization technology can lead to significant improvements when handling HPCaaS.

HPC cloud services based on the Proxmox VE platform

2019 ◽  
Author(s):  
А.В. Баранов ◽  
Е.А. Киселёв
Keyword(s):  
High Performance Computing ◽  
Management System ◽  
High Performance ◽  
Virtual Machines ◽  
Cloud Services ◽  
Job Management ◽  
Job Management System ◽  
High Level ◽  
Performance Computing ◽  
Hpc Cloud

Организация облачных сервисов для высокопроизводительных вычислений затруднена, во-первых, по причине высоких накладных расходов на виртуализацию, во-вторых, из-за специфики систем управления заданиями и ресурсами в научных суперкомпьютерных центрах. В настоящей работе рассмотрен подход к построению облачных сервисов видов PaaS и SaaS, основанных на совместном функционировании облачной платформы Proxmox VE и системы управления прохождением параллельных заданий, применяемой в качестве менеджера ресурсов в Межведомственном суперкомпьютерном центре РАН. Purpose. The purpose of this paper is to develop methods and technologies for building high-performance computing cloud services in scientific supercomputer centers. Methodology.To build a cloud environment for high-performance scientific calculations (HPC), the corresponding three-level model and the method of combining flows of supercomputer tasks of various types were applied. Results.A high-level HPC cloud services technology based on the free Proxmox VE software platform has been developed. The Proxmox VE platform has been integrated with the domestic supercomputer job management system called SUPPZ. Experimental estimates of the overheads introduced in the high-performance computing process by the Proxmox components are obtained. Findings.An approach to the integration a supercomputer job management system and a virtualization platform is proposed. The presented approach is based on the representation of the supercomputer jobs as virtual machines or containers. Using the Proxmox VE platform as an example, the influence of a virtual environment on the execution time of parallel programs is investigated experimentally. The possibility of applying the proposed approach to building cloud services of the PaaS and SaaS type in scientific supercomputing centers of collective use is substantiated for a class of applications for which the overhead costs introduced by the Proxmox components are acceptable.

scholarly journals ComputeOps: containers for High Performance Computing

2019 ◽  
Vol 214 ◽  
pp. 07004
Author(s):  
Cécile Cavet ◽  
Aurélien Bailly-Reyre ◽  
David Chamont ◽  
Olivier Dadoun ◽  
Alexandre Dehne Garcia ◽  
...  
Keyword(s):  
High Performance Computing ◽  
High Performance ◽  
Virtual Machines ◽  
Key Concepts ◽  
Image Building ◽  
Computing Framework ◽  
Performance Computing ◽  
Linux Containers

The High Performance Computing (HPC) domain aims to optimize code to use the latest multicore and parallel technologies including specific processor instructions. In this computing framework, portability and reproducibility are key concepts. A way to handle these requirements is to use Linux containers. These "light virtual machines" allow users to encapsulate applications within its environment in processes. Containers have been recently highlighted because they provide multi-infrastructure environnement for both developers and system administrators. Furthermore, they offer reproducibility due to image building files. Two container solutions are emerging: Docker for micro-services and Singularity for computing applications. We present here the Com-puteOps project which investigates the container benefits for HPC applications.

Sign in / Sign up

Export Citation Format

Share Document