AURA – next generation neutrino detector in the South Pole

AbstractSolving the century-old puzzle of how and where cosmic rays are accelerated mostly drives the design of high-energy neutrino telescopes. It calls, along with a diversity of science goals reaching particle physics, astrophysics and cosmology, for the construction of a kilometer-scale neutrino detector. This led to the IceCube concept to transform a kilometer cube of transparent Antarctic Ice, one mile below the South Pole, into a neutrino telescope.

Download Full-text

IceProd - a dataset management system for IceCube: update

EPJ Web of Conferences ◽

10.1051/epjconf/201921403058 ◽

2019 ◽

Vol 214 ◽

pp. 03058

Author(s):

David Schultz ◽

Juan Carlos Díaz Vélez

Keyword(s):

Management System ◽

South Pole ◽

Neutrino Detector ◽

The South ◽

User Access ◽

Improve Stability ◽

The Way

IceCube is a cubic kilometer neutrino detector located at the south pole. IceProd is IceCube’s internal dataset management system, keeping track of where, when, and how jobs run. It schedules jobs from submitted datasets to HTCondor, keeping track of them at every stage of the lifecycle. Many updates have happened in the last years to improve stability and scalability, as well as increase user access. Along the way, the IceProd codebase switched from Python 2 to Python 3.

Download Full-text

CVMFS: Stratum 0 in Kubernetes

EPJ Web of Conferences ◽

10.1051/epjconf/201921407032 ◽

2019 ◽

Vol 214 ◽

pp. 07032

Author(s):

David Schultz ◽

Heath Skarlupka ◽

Vladimir Brik ◽

Gonzalo Merino

Keyword(s):

High Throughput ◽

South Pole ◽

Neutrino Detector ◽

The South ◽

Software Suite ◽

High Throughput Computing ◽

Continuous Delivery

IceCube is a cubic kilometer neutrino detector located at the south pole. CVMFS is a key component to IceCube’s Distributed High Throughput Computing analytics workflow for sharing 500GB of software across datacenters worldwide. Building the IceCube software suite across multiple platforms and deploying it into CVMFS has until recently been a manual, time consuming task that doesn’t fit well within an agile continuous delivery framework. Within the last 2 years a plethora of tooling around microservices has created an opportunity to upgrade the IceCube software build and deploy pipeline. We present a framework using Kubernetes to deploy Buildbot. The Buildbot pipeline is a set of pods (docker containers) in the Kubernetes cluster that builds the IceCube software across multiple platforms, tests the new software for critical errors, syncs the software to a containerized CVMFS server, and finally executes a publish. The time from code commit to CVMFS publish has been greatly reduced and has enabled the capability of publishing nightly builds to CVMFS.

Download Full-text