On-Demand Urgent High Performance Computing Utilizing the Google Cloud Platform

Author(s):  
Brandon Posey ◽  
Adam Deer ◽  
Wyatt Gorman ◽  
Vanessa July ◽  
Neeraj Kanhere ◽  
...  
2016 ◽  
Vol 31 (6) ◽  
pp. 1985-1996 ◽  
Author(s):  
David Siuta ◽  
Gregory West ◽  
Henryk Modzelewski ◽  
Roland Schigas ◽  
Roland Stull

Abstract As cloud-service providers like Google, Amazon, and Microsoft decrease costs and increase performance, numerical weather prediction (NWP) in the cloud will become a reality not only for research use but for real-time use as well. The performance of the Weather Research and Forecasting (WRF) Model on the Google Cloud Platform is tested and configurations and optimizations of virtual machines that meet two main requirements of real-time NWP are found: 1) fast forecast completion (timeliness) and 2) economic cost effectiveness when compared with traditional on-premise high-performance computing hardware. Optimum performance was found by using the Intel compiler collection with no more than eight virtual CPUs per virtual machine. Using these configurations, real-time NWP on the Google Cloud Platform is found to be economically competitive when compared with the purchase of local high-performance computing hardware for NWP needs. Cloud-computing services are becoming viable alternatives to on-premise compute clusters for some applications.


2020 ◽  
Vol 10 (10) ◽  
pp. 3382
Author(s):  
Rahmat Ullah ◽  
Tughrul Arslan

For processing large-scale medical imaging data, adopting high-performance computing and cloud-based resources are getting attention rapidly. Due to its low–cost and non-invasive nature, microwave technology is being investigated for breast and brain imaging. Microwave imaging via space-time algorithm and its extended versions are commonly used, as it provides high-quality images. However, due to intensive computation and sequential execution, these algorithms are not capable of producing images in an acceptable time. In this paper, a parallel microwave image reconstruction algorithm based on Apache Spark on high-performance computing and Google Cloud Platform is proposed. The input data is first converted to a resilient distributed data set and then distributed to multiple nodes on a cluster. The subset of pixel data is calculated in parallel on these nodes, and the results are retrieved to a master node for image reconstruction. Using Apache Spark, the performance of the parallel microwave image reconstruction algorithm is evaluated on high-performance computing and Google Cloud Platform, which shows an average speed increase of 28.56 times on four homogeneous computing nodes. Experimental results revealed that the proposed parallel microwave image reconstruction algorithm fully inherits the parallelism, resulting in fast reconstruction of images from radio frequency sensor’s data. This paper also illustrates that the proposed algorithm is generalized and can be deployed on any master-slave architecture.


2020 ◽  
Vol 14 ◽  

Typically, the constant changes in computers and communications technology led to the need of on-demand network access to a shared computing resources to reduce cost and time and this is known as Cloud computing, which delivers computing services to users as a pay-as-you-go manner by emerging several distributed and high performance computing concepts. The cloud makes reaching any information or source possible from anywhere eliminating the setup and instillation step such that the user and the hardware may co-exist in different places. This comes beneficial for the users or the small companies that cannot effort to pay for the hardware, storage or resources as the big companies. Many of the studies on cloud computing was dedicated to the performance efficiency of task scheduling. Scheduling is a wide concept and it is one of the most important issues that generally work on mapping tasks to appropriate resources efficiently and effectively using one or more strategy. This paper have reviewed and classified the most recent scheduling algorithms in cloud computing and gave examples on each.


2015 ◽  
Vol 7 (3) ◽  
pp. 511-516
Author(s):  
I. G. Gankevich ◽  
S. G. Balyan ◽  
S. A. Abrahamyan ◽  
V. V. Korkhov

Sign in / Sign up

Export Citation Format

Share Document