Lessons learned in the design and implementation of a private cloud for high-performance computing using OpenStack in existing university infrastructure

Author(s):  
Rodolfo Arturo Caliz Ospino ◽  
Pedro Fabian Perez Arteaga ◽  
Jose Nelson Perez Castillo
2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Sergio Botelho Junior ◽  
Bill O’Gorman

Purpose This paper aims to explore high performance computing (HPC) in the context of the South East region of Ireland, which hosts a publicly available HPC infrastructure, by identifying whether companies, especially small and medium enterprises (SMEs), are using, or are prepared to use, HPC to improve their business processes, expansion and sustainability. The result of the analysis provides region-specific guidelines that are meant to improve the HPC landscape in the region. The lessons learned from this research may apply to other similar, and developing, European regions. Design/methodology/approach This paper explores the use of HPC in the context of the South East region of Ireland and examines whether companies, especially SMEs, are benefiting from the use of publicly available HPC infrastructure in the region. This paper also provides a set of recommendations, of a policy nature, and required actions to increase HPC usage, based on the reality of the region. Therefore, the first step in the process was to understand the HPC landscape in the South East region of Ireland. Interviews were conducted with higher education institute (HEI) staff who were knowledgeable about the HPC infrastructure of their institutes and also about whether collaboration between the HEIs and businesses from the same region exists. The interview findings allowed the proposal of region-specific guidelines to improve the HPC landscape and collaboration in the region. The guidelines were analysed and refined in a focus group with key regional stakeholders from academia, industry and government, who have experience and expertise in high-technology transfer processes happening in the region. Findings The findings of the current study strongly suggest that HPC usage by SMEs in the South East region of Ireland is still incipient; and that HPC knowledge is currently inadequately transferred from the HEI hosting the HPC infrastructure to public and private sector organisations based in the region. The findings also demonstrate that there are no courses or training programmes available dedicated to HPC and that the level of collaboration between the HEI hosting the HPC infrastructure and industry in the region is minimal as regards HPC usage and projects. Therefore, there is a need to put specific targeted policies and actions, both from a regional government and HEI perspectives, in place to encourage SMEs to optimise their processes by using HPC. Originality/value This research is unique as it provides customised region-specific recommendations (RSR) and feasible actions to encourage industry, especially SMEs, to use HPC and collaborate around it. The literature review identified that there is a lack of studies that can inform policymakers to include HPC in their innovation agenda. Previous research studies specifically focussing on HPC policies are even more scarce. Most of the existing research pertaining to HPC focusses on the technical aspect of HPC; therefore, this research and paper bring a new dimension to existing HPC research. Even though this research was focussed on the South East of Ireland region, the model that generated the RSRs can be extrapolated and applied to other regions that need to develop their HPC landscape and the use of HPC among SMEs in their respective regions.


Author(s):  
J. Charles Victor ◽  
P. Alison Paprica ◽  
Michael Brudno ◽  
Carl Virtanen ◽  
Walter Wodchis ◽  
...  

IntroductionCanadian provincial health systems have a data advantage – longitudinal population-wide data for publicly funded health services, in many cases going back 20 years or more. With the addition of high performance computing (HPC), these data can serve as the foundation for leading-edge research using machine learning and artificial intelligence. Objectives and ApproachThe Institute for Clinical Evaluative Sciences (ICES) and HPC4Health are creating the Ontario Data Safe Haven (ODSH) – a secure HPC cloud located within the HPC4Health physical environment at the Hospital for Sick Children in Toronto. The ODSH will allow research teams to post, access and analyze individual datasets over which they have authority, and enable linkage to Ontario administrative and other data. To start, the ODSH is focused on creating a private cloud meeting ICES’ legislated privacy and security requirements to support HPC-intensive analyses of ICES data. The first ODSH projects are partnerships between ICES scientists and machine learning. ResultsAs of March 2018, the technological build of the ODSH was tested and completed and the privacy and security policy framework and documentation were completed. We will present the structure of the ODSH, including the architectural choices made when designing the environment, and planned functionality in the future. We will describe the experience to-date for the very first analysis done using the ODSH: the automatic mining of clinical terminology in primary care electronic medical records using deep neural networks. We will also present the plans for a high-cost user Risk Dashboard program of research, co-designed by ICES scientists and health faculty from the Vector Institute for artificial intelligence, that will make use of the ODSH beginning May 2018. Conclusion/ImplicationsThrough a partnership of ICES, HPC4Health and the Vector Institute, a secure private cloud ODSH has been created as is starting to be used in leading edge machine learning research studies that make use of Ontario’s population-wide data assets.


Sign in / Sign up

Export Citation Format

Share Document