scholarly journals An experience of applying the parallelization regions for the step-by-step parallelization of software packages using the SAPFOR system

Author(s):  
А.С. Колганов

Одна из основных сложностей разработки параллельной программы для кластера — необходимость принятия глобальных решений по распределению данных и вычислений с учетом свойств всей программы, а затем выполнения кропотливой работы по модификации программы и ее отладки. Большой объем программного кода, а также многомодульность, многовариантность и многоязыковость, затрудняют принятие решений по согласованному распределению данных и вычислений. Опыт использования предыдущей системы САПФОР показал, что при распараллеливании на кластер больших программ и программных комплексов необходимо уметь распараллеливать их постепенно, начиная с наиболее времяемких фрагментов и постепенно добавляя новые фрагменты, пока не достигнем желаемого уровня эффективности параллельной программы. С этой целью предыдущая система была полностью переработана, и на ее основе была создана новая система SAPFOR (System FOR Automated Parallelization). В данной статье будет рассмотрен опыт применения метода частичного распараллеливания, идея которого заключается в том, что распараллеливанию подвергается не вся программа целиком, а ее части (области распараллеливания) — в них заводятся дополнительные экземпляры требуемых данных, производится распределение этих данных и соответствующих им вычислений. The main difficulty in developing a parallel program for a cluster is the need to make global decisions on the distribution of data and computations, taking into account the properties of the entire program, and then doing the hard work of modifying the program and debugging it. A large amount of code as well as multimoduling, multivariant and multilanguage, make it difficult to make decisions on a consistent distribution of data and computations. The experience of using the previous SAPFOR system showed that, when parallelizing large programs and software packages for a cluster, one should be able to parallelize them gradually, starting with the most time-intensive fragments and gradually adding new fragments until we reach the desired level of parallel program efficiency. For this purpose, the previous system was completely redesigned and a new system SAPFOR (System FOR Automated Parallelization) was created. To solve this problem, the method of incremental or partial arallelization will be considered in this paper. The idea of this method is that not the entire program is subjected to parallelization, but only its parts (parallelization regions) where additional versions of the required data are created and distributed and the corresponding computations are performed. This paper also discusses the application of automated mapping of programs to a cluster using the proposed incremental parallelization method and using the example of a NPB (NAS Parallel Benchmarks) software package.

2020 ◽  
Author(s):  
Hamed Haselimashhadi ◽  
Jeremy C Mason ◽  
Ann-Marie Mallon ◽  
Damian Smedley ◽  
Terrence F Meehan ◽  
...  

AbstractReproducibility in the statistical analyses of data from high-throughput phenotyping screens requires a robust and reliable analysis foundation that allows modelling of different possible statistical scenarios. Regular challenges are scalability and extensibility of the analysis software. In this manuscript, we describe OpenStats, a freely available software package that addresses these challenges. We show the performance of the software in a high-throughput phenomic pipeline in the International Mouse Phenotyping Consortium (IMPC) and compare the agreement of the results with the most similar implementation in the literature. OpenStats has significant improvements in speed and scalability compared to existing software packages including a 13-fold improvement in computational time to the current production analysis pipeline in the IMPC. Reduced complexity also promotes FAIR data analysis by providing transparency and benefiting other groups in reproducing and re-usability of the statistical methods and results. OpenStats is freely available under a Creative Commons license at www.bioconductor.org/packages/OpenStats.


Author(s):  
Singuru Rajesh

Farmers are backbone of India and they suffer many hurdles while growing crops. In post-harvesting steps, drying crops plays a major role in grain production. About 70% of the threshed grains are sun-dried in many regions. During sudden rains farmers face difficulty to cover the threshed grains and some of them die because of thunderstorm/lighting with this older methods. It necessitates to design a new system for these conditions instead of older methods. The aim of the project is to provide an innovative design for helping farmers from unseasonal rains easily. The newly modelled Rain Sensor Capsule for farmers, whose operation is compiled by the automatic rain sensor, wooden capsule, controllers and power conversion unit. The capsule is modelled in AutoCAD software package, then a prototype is fabricated and tested.


EDIS ◽  
2020 ◽  
Vol 2020 (2) ◽  
pp. 7
Author(s):  
Jeffry M. Flenniken ◽  
Steven Stuglik ◽  
Basil V. Iannone

Geographic information system (GIS) software packages can be prohibitively expensive, causing many to shy away from mapping and spatial analysis. This 7-page fact sheet written by Jeffry M. Flenniken, Steven Stuglik, and Basil V. Iannone III and published by the UF/IFAS School of Forest Resources and Conservation introduces the reader to a free GIS software package called Quantum GIS (QGIS), walking the reader through simple GIS processes that can be used to visualize spatial patterns of importance to a variety of fields, including natural resources, agriculture, and urban planning. Learn how to create a land-cover map for a county of interest and create heatmaps that illustrate the density of a given attribute (Florida Springs for this example). This publication will benefit those interested in incorporating GIS into their work but who are unable to afford expensive proprietary GIS software packages, as well as anyone interested in learning a new GIS software package. https://edis.ifas.ufl.edu/fr428


2021 ◽  
pp. 1-9
Author(s):  
Charles Auerbach

Single-subject research has historically had an important position in the areas of research and practice evaluation. With the current trend toward evidence-based practice, the emphasis in this chapter is on the demand for and reliance on this practice-based, evidence-building research design to increase in the future. SSD for R is a software package available to help researchers and practitioners analyze single-subject research data. This chapter describes the historical, current, and future uses of single-subject research and the contributions of these designs to both visual and statistical analysis. A brief review of software packages to handle this type of analysis is included in this chapter. Finally, an overview of the functionality of SSD for R is provided.


2011 ◽  
Vol 2 (3) ◽  
pp. 42-62
Author(s):  
Afonso Araújo Neto ◽  
Marco Vieira

When deploying database-centric web applications, administrators should pay special attention to database security requirements. Acknowledging this, Database Management Systems (DBMS) implement several security mechanisms that help Database Administrators (DBAs) making their installations secure. However, different software products offer different sets of mechanisms, making the task of selecting the adequate package for a given installation quite hard. This paper proposes a methodology for detecting database security gaps. This methodology is based on a comprehensive list of security mechanisms (derived from widely accepted security best practices), which was used to perform a gap analysis of the security features of seven software packages composed by widely used products, including four DBMS engines and two Operating Systems (OS). The goal is to understand how much each software package helps developers and administrators to actually accomplish the security tasks that are expected from them. Results show that while there is a common set of security mechanisms that is implemented by most packages, there is another set of security tasks that have no support at all in any of the packages.


Author(s):  
Kees van Slooten ◽  
Marcel Bruins

The Software Package Development Methodology (SPDM) is a methodology for developing complex and customizable software packages supporting business processes, especially Enterprise Resource Planning (ERP) software. Two approaches are applied by this chapter. First SPDM will be compared to a method engineering framework. Method engineering is a discipline to construct new methods from parts of existing methods taking into account situational factors. The second approach is the analysis of the results of a questionnaire, asking users of SPDM their opinion on several issues concerning problems and quality of SPDM. The conclusions, after applying both approaches, are quite similar and some recommendations are made for future research.


2019 ◽  
Vol 36 (5) ◽  
pp. 1647-1648 ◽  
Author(s):  
Bilal Wajid ◽  
Hasan Iqbal ◽  
Momina Jamil ◽  
Hafsa Rafique ◽  
Faria Anwar

Abstract Motivation Metabolomics is a data analysis and interpretation field aiming to study functions of small molecules within the organism. Consequently Metabolomics requires researchers in life sciences to be comfortable in downloading, installing and scripting of software that are mostly not user friendly and lack basic GUIs. As the researchers struggle with these skills, there is a dire need to develop software packages that can automatically install software pipelines truly speeding up the learning curve to build software workstations. Therefore, this paper aims to provide MetumpX, a software package that eases in the installation of 103 software by automatically resolving their individual dependencies and also allowing the users to choose which software works best for them. Results MetumpX is a Ubuntu-based software package that facilitate easy download and installation of 103 tools spread across the standard metabolomics pipeline. As far as the authors know MetumpX is the only solution of its kind where the focus lies on automating development of software workstations. Availability and implementation https://github.com/hasaniqbal777/MetumpX-bin. Supplementary information Supplementary data are available at Bioinformatics online.


2008 ◽  
Vol 381-382 ◽  
pp. 599-602 ◽  
Author(s):  
O. Velychko

According to international standards the accredited calibration and testing laboratories are required to use reliable measuring instruments and to estimate an uncertainty of measurements. The variety of software tools and the different approaches taken will almost certainly ensure that for each laboratory there is a software package which will meet the needs. In this paper, several a software packages are made according to their validation for comparison. Briefly general principles of validating uncertainty analysis software packages are described. Briefly used validation methods are described.


Author(s):  
Olga V. Olshevska

Creating a computer program to calculate microchannel air condensers to reduce design time and carrying out variant calculations. Software packages for thermophysical properties of the working substance and the coolant, the correlation equation for calculating heat transfer, aerodynamics and hydrodynamics, the thermodynamic equations for the irreversible losses and their minimization in the heat exchanger were used in the process of creating. Borland Delphi 7 is used for creating software package.


Sign in / Sign up

Export Citation Format

Share Document