SciTokens SSH: Token-based Authentication for Remote Login to Scientific Computing Environments

Author(s):  
You Alex Gao ◽  
Jim Basney ◽  
Alex Withers
2019 ◽  
Author(s):  
Nathan Sheffield

Reproducible computing environments are required for reproducible analysis and are also useful for interactive exploratory analysis. In the past, scientific computing environments have been managed with package managers or with virtual machines. More recently, modern workflow managers have incorporated linux container technology to improve reproducibility. These existing solutions solve some of the challenges of managing reproducible computing environments, but they remain limited: System-wide environments and native package managers lack the portability, efficiency, and robustness of modern containers, while container-aware workflows are specialized and incapable of interactive computing. Here, I introduce *bulker*, an approach that combines the advantages of virtual machines, native package managers, and container-aware workflow managers. Bulker creates and distributes complete environments, like virtual machines, but with re-usable modular components, like a native package manager. It uses individually containerized tools like a container-aware workflow manager, but also allows these environments to be activated interactively and distributed independently of a particular workflow. Bulker is thus a more general approach to portable and reproducible computing environments.


Author(s):  
Kiran Kumar S V N Madupu

Big Data has terrific influence on scientific discoveries and also value development. This paper presents approaches in data mining and modern technologies in Big Data. Difficulties of data mining as well as data mining with big data are discussed. Some technology development of data mining as well as data mining with big data are additionally presented.


Sign in / Sign up

Export Citation Format

Share Document