scholarly journals Experience of OpenStack Test Deployment and Comparison of Virtual and Real Cluster Environments

2021 ◽  
pp. 74-85
Author(s):  
Tamara Bardadym ◽  
Oleksandr Lefterov ◽  
Sergiy Osypenko
Keyword(s):  
Biomedical Application ◽  
Open Science ◽  
Graphical Form ◽  
Virtual Cluster ◽  
Parallel Processes ◽  
Biomedical Computing ◽  
Test Application ◽  
Scaling Parameters ◽  
Cluster Environment ◽  
Cloud Technologies

Introduction. A brief overview of the properties and architecture of one of the components of the National Cloud of Open Science prototype – the cloud platform OpenStack is given. The list of software and hardware components of the OpenStack test cloud environment and the sequence of actions required for the deployment of both OpenStack itself and the Slurm virtual cluster environment for portable, scalable, reproducible scientific biomedical computing are presented. The purpose of the paper is a description of the experience of test deployment of OpenStack to create a scalable computing environment for reproducible scientific computing using modern technological solutions, which can be applied to both cloud (OpenStack, AWS, Google) and cluster platforms (Slurm). Results. The structure of the created test containerized (using Singularity technology) biomedical application, which contains modern software and libraries and can be used in conventional and cloud virtual cluster environments is briefly described. The results of a comparative test of this application in the virtual cluster environment Slurm under the control of OpenStack and in the node of cluster SKIT-4.5 in the V.M. Glushkov Institute of Cybernetics of the NAS of Ukraine are given. Information on solving the problem of finding the optimal in terms of saving resources scaling parameters for the developed application in two comparable cluster environments is given. Some features of the use of these cluster environments are clarified, in particular, a comparison of the dependence of the application speed on the number of parallel processes for two cluster environments is presented. Empirical data are presented in graphical form, which illustrate the nature of the load on the OpenStack server and the use of RAM on the number of parallel processes. Possibilities of portability between the specified cluster environments, scaling of calculations and maintenance of reproducibility of calculations for the offered test application are demonstrated. The advantages of using OpenStack technology for scientific biomedical calculations are pointed out. Conclusions. The described example of test deployment and use of OpenStack gives an idea of the requirements for the necessary technical base to ensure the reproducibility of scientific biomedical calculations in cloud and cluster environments. Keywords: cloud technologies, reproducible calculations, cluster platform.

scholarly journals On the way to creating Ukrainian national cloud of open science

2021 ◽  
pp. 027-039
Author(s):  
S.Ya. Svistunov ◽  
◽  
P.I. Perkonos ◽  
S.V. Subotin ◽  
Ya.M. Tverdochlib ◽  
...  
Keyword(s):  
Information Processing ◽  
Computational Methods ◽  
Open Science ◽  
Information Resource ◽  
National Academy Of Sciences ◽  
Research Teams ◽  
Common Information ◽  
New Approaches ◽  
Academy Of Sciences ◽  
Cloud Technologies

Modern conditions of science development, which are characterized by a significant increase in the volume of information, require new approaches to computational methods and new approaches to information processing. The article considers approaches to creating conditions and tools based on cloud technologies for more effective cooperation of research teams working on similar scientific problems. The article analyzes the stages of development of the European Open Science Cloud and presents the strategy of building the National Open Science Cloud. The article presents the main results of the development of a common information resource for scientific researches at the National Academy of Sciences of Ukraine, which can be considered as a prototype of the National Open Science Cloud, which integrates into the European Open Science Cloud.

scholarly journals THE CONCEPTUAL BASIS OF THE UNIVERSITY CLOUD-BASED LEARNING AND RESEARCH ENVIRONMENT FORMATION AND DEVELOPMENT IN VIEW OF THE OPEN SCIENCE PRIORITIES

2018 ◽  
Vol 68 (6) ◽  
pp. 1 ◽  
Author(s):  
Valerii Yu. Bykov ◽  
Mariya P. Shyshkina
Keyword(s):  
Higher Education ◽  
Experimental Studies ◽  
Education Institution ◽  
Open Science ◽  
Cloud Services ◽  
European Research ◽  
Environment Design ◽  
Research Environment ◽  
Scientific Application ◽  
Cloud Technologies

This article explores the scientific and methodological background of the creation and development of the cloud-based learning and research environment in the context of open science priorities and the European Research Area (ERA) formation. The conceptual and terminology body of the cloud-based environment investigation and the main features of such an environment are delineated. The main methodological principles of the environment design and development, for instance, the principles of open science, open education and also the specific principles inherent to the cloud-based systems are described. The study aim is to analyze the conceptual body, principles, and features of the formation and development of the cloud-based educational and research environment in the context of the open science concept. The objective of the study is to determine the prospects of cloud technologies that are used to support educational and scientific activities and to outline the principles and technologies of open science use and explore their broader application in pedagogical systems of higher educational institutions. The research methods are the analysis of official international documents, publications on the research, observation, comparison, the analysis of the experience of the educational and scientific application of cloud technologies, and experimental studies. The results of the research substantiate cloud technologies in the principles of creation and development of the learning and research environment (LRE) of a higher education institution. The concept of the cloud-based environment is explained; the characteristic features of its functioning are outlined. Additionally, the prospects and estimation of the cloud-based LRE development in the aspect of open science are defined. Conclusions and recommendations encompass the application of cloud-based open science technologies covering European research infrastructures, scientific and educational networks, European open science cloud, and also cloud services for collecting, submitting and processing data as a topical and promising trend for the development and modernization of the learning and research environment of higher education institutions.

Data Storage Architecture of Maintenance Support System Based on Hadoop

2014 ◽  
Vol 1065-1069 ◽  
pp. 3429-3433
Author(s):  
Li Ying Han ◽  
Wei Wang ◽  
Nai Wen Hu
Keyword(s):  
Data Storage ◽  
Support System ◽  
Storage Capacity ◽  
Rapid Development ◽  
Rail Transit ◽  
Signal System ◽  
Virtual Cluster ◽  
Open Source Framework ◽  
Cluster Environment ◽  
Low Efficiency

With the rapid development of rail transit, storage of mass data has become an urgent problem. In view of the problem of insufficient storage capacity and low-efficiency for traditional storage technology, maintenance monitoring data collected by MSS (Maintenance Support System) is taken as the background in this paper [1], an open source framework Hadoop is introduced to build MSS data storage architecture. Through building the virtual cluster environment, the Hadoop technology used in signal system of rail transit is verified feasible.

Sign in / Sign up

Export Citation Format

Share Document