AbstractWe are pleased to present the special issue “New developments in scalable computing” of the scientific journal “Cybernetics and Information Technologies”. For this issue (Volume 20, No 6 – December 2020), we have selected 19 papers which have gone through peer review and represent novel results in the field of Scalable Computing using state-of-the-art high-performance computing infrastructures.
Abstract
Summary
The existence of more than 100 public Galaxy servers with service quotas is indicative of the need for an increased availability of compute resources for Galaxy to use. The GalaxyCloudRunner enables a Galaxy server to easily expand its available compute capacity by sending user jobs to cloud resources. User jobs are routed to the acquired resources based on a set of configurable rules and the resources can be dynamically acquired from any of four popular cloud providers (AWS, Azure, GCP or OpenStack) in an automated fashion.
Availability and implementation
GalaxyCloudRunner is implemented in Python and leverages Docker containers. The source code is MIT licensed and available at https://github.com/cloudve/galaxycloudrunner. The documentation is available at http://gcr.cloudve.org/.
This work presents an introduction to the Data Intensive Scalable Computing (DISC) approach. This paradigm represents a valuable effort to tackle the large amount of data produced by several ordinary applications. Therefore, subjects such as characterization of big data and storage approaches, in addition to brief comparison between HPC and DISC are differentiated highlight.
Scalable computing in Java with PCJ Library. Improved collective operations
