Secure and efficient high-performance PROOF-based cluster system for high-energy physics

2014 ◽  
Vol 70 (1) ◽  
pp. 166-176 ◽  
Author(s):  
Sang Un Ahn ◽  
Il Yeon Yeo ◽  
Sang Oh Park
Keyword(s):  
High Performance ◽  
High Energy Physics ◽  
High Energy ◽  
Cluster System ◽  
Energy Physics

scholarly journals Beyond HEP: Photon and accelerator science computing infrastructure at DESY

2020 ◽  
Vol 245 ◽  
pp. 07036
Author(s):  
Christoph Beyer ◽  
Stefan Bujack ◽  
Stefan Dietrich ◽  
Thomas Finnern ◽  
Martin Flemming ◽  
...  
Keyword(s):  
High Performance ◽  
Large Scale ◽  
High Energy Physics ◽  
High Energy ◽  
Resource Provisioning ◽  
Small Scale ◽  
Online Processing ◽  
Offline Processing ◽  
National Analysis ◽  
Energy Physics

DESY is one of the largest accelerator laboratories in Europe. It develops and operates state of the art accelerators for fundamental science in the areas of high energy physics, photon science and accelerator development. While for decades high energy physics (HEP) has been the most prominent user of the DESY compute, storage and network infrastructure, various scientific areas as science with photons and accelerator development have caught up and are now dominating the demands on the DESY infrastructure resources, with significant consequences for the IT resource provisioning. In this contribution, we will present an overview of the computational, storage and network resources covering the various physics communities on site. Ranging from high-throughput computing (HTC) batch-like offline processing in the Grid and the interactive user analyses resources in the National Analysis Factory (NAF) for the HEP community, to the computing needs of accelerator development or of photon sciences such as PETRA III or the European XFEL. Since DESY is involved in these experiments and their data taking, their requirements include fast low-latency online processing for data taking and calibration as well as offline processing, thus high-performance computing (HPC) workloads, that are run on the dedicated Maxwell HPC cluster. As all communities face significant challenges due to changing environments and increasing data rates in the following years, we will discuss how this will reflect in necessary changes to the computing and storage infrastructures. We will present DESY compute cloud and container orchestration plans as a basis for infrastructure and platform services. We will show examples of Jupyter notebooks for small scale interactive analysis, as well as its integration into large scale resources such as batch systems or Spark clusters. To overcome the fragmentation of the various resources for all scientific communities at DESY, we explore how to integrate them into a seamless user experience in an Interdisciplinary Data Analysis Facility.

scholarly journals High Performance Numerical Computing for High Energy Physics: A New Challenge for Big Data Science

2014 ◽  
Vol 2014 ◽  
pp. 1-13 ◽  
Author(s):  
Florin Pop
Keyword(s):  
Monte Carlo ◽  
Big Data ◽  
Numerical Methods ◽  
High Performance ◽  
Data Science ◽  
Experimental Validation ◽  
High Energy Physics ◽  
High Energy ◽  
Performance Computing ◽  
Energy Physics

Modern physics is based on both theoretical analysis and experimental validation. Complex scenarios like subatomic dimensions, high energy, and lower absolute temperature are frontiers for many theoretical models. Simulation with stable numerical methods represents an excellent instrument for high accuracy analysis, experimental validation, and visualization. High performance computing support offers possibility to make simulations at large scale, in parallel, but the volume of data generated by these experiments creates a new challenge for Big Data Science. This paper presents existing computational methods for high energy physics (HEP) analyzed from two perspectives: numerical methods and high performance computing. The computational methods presented are Monte Carlo methods and simulations of HEP processes, Markovian Monte Carlo, unfolding methods in particle physics, kernel estimation in HEP, and Random Matrix Theory used in analysis of particles spectrum. All of these methods produce data-intensive applications, which introduce new challenges and requirements for ICT systems architecture, programming paradigms, and storage capabilities.

scholarly journals HTS Accelerator Magnets and Conductor development in Europe

2020 ◽  
Author(s):  
Lucio Rossi ◽  
Carmine Senatore
Keyword(s):  
European Community ◽  
High Field ◽  
High Performance ◽  
High Energy Physics ◽  
Background Field ◽  
High Energy ◽  
Race Track ◽  
Accelerator Magnets ◽  
Very High ◽  
Energy Physics

In view of the preparation for a post-LHC collider, the high-energy physics (HEP) community started from 2010 to discuss various options, including the use of HTS for very high field dipoles. Therefore, a small program was set in Europe aiming at exploring the possibility of using HTS for accelerator quality magnets. Based on various EU funded programs, though at modest levels, has enabled the European community of accelerator magnets to start getting experience in HTS and addressing a few issues. The program was based on use of REBCO tapes to form 10 kA Roebel cables, to be used to wind small dipoles of 30-40 mm aperture in the 5 T range. The dipoles are designed to be later inserted in a background dipole field (in Nb3Sn), to reach eventually a field level in the 16-20 T range, beyond the reach of LTS. The program is currently underway: more than 1 km tape of high performance (Je > 500 A/mm2 at 20 T, 4.2 K has been manufactured and characterized, various 30 m long Roebel cables have been assembled and validated up to 13 kA, a few dipoles have been wound and tested, reaching at present 4.5 T in stand-alone (while a dipole made from race track coils with no-bore exceeded 5 T using stacked tape cable) and a test in a background field is being organized.

scholarly journals Hardware Implementation Study of Particle Tracking Algorithm on FPGAs

Electronics ◽  
2021 ◽  
Vol 10 (20) ◽  
pp. 2546
Author(s):  
Alessandro Gabrielli ◽  
Fabrizio Alfonsi ◽  
Alberto Annovi ◽  
Alessandra Camplani ◽  
Alessandro Cerri
Keyword(s):  
High Speed ◽  
High Performance ◽  
Hardware Implementation ◽  
High Energy Physics ◽  
Medical Image Analysis ◽  
Computation Time ◽  
High Energy ◽  
Spatial Transformation ◽  
Flip Flop ◽  
Energy Physics

In recent years, the technological node used to implement FPGA devices has led to very high performance in terms of computational capacity and in some applications these can be much more efficient than CPUs or other programmable devices. The clock managers and the enormous versatility of communication technology through digital transceivers place FPGAs in a prime position for many applications. For example, from real-time medical image analysis to high energy physics particle trajectory recognition, where computation time can be crucial, the benefits of using frontier FPGA capabilities are even more relevant. This paper shows an example of FPGA hardware implementation, via a firmware design, of a complex analytical algorithm: The Hough transform. This is a mathematical spatial transformation used here to facilitate on-the-fly recognition of the trajectories of ionising particles as they pass through the so-called tracker apparatus within high-energy physics detectors. This is a general study to demonstrate that this technique is not only implementable via software-based systems, but can also be exploited using consumer hardware devices. In this context the latter are known as hardware accelerators. In this article in particular, the Xilinx UltraScale+ FPGA is investigated as it belongs to one of the frontier family devices on the market. These FPGAs make it possible to reach high-speed clock frequencies at the expense of acceptable energy consumption thanks to the 14 nm technological node used by the vendor. These devices feature a huge number of gates, high-bandwidth memories, transceivers and other high-performance electronics in a single chip, enabling the design of large, complex and scalable architectures. In particular the Xilinx Alveo U250 has been investigated. A target frequency of 250 MHz and a total latency of 30 clock periods have been achieved using only the 17 ÷ 53% of LUTs, the 8 ÷ 12% of DSPs, the 1 ÷ 3% of Block Rams and a Flip Flop occupancy range of 9 ÷ 28%.

scholarly journals A Feasibility Study on workload integration between HT-Condor and Slurm Clusters

2019 ◽  
Vol 214 ◽  
pp. 08004 ◽  
Author(s):  
R. Du ◽  
J. Shi ◽  
J. Zou ◽  
X. Jiang ◽  
Z. Sun ◽  
...  
Keyword(s):  
Resource Utilization ◽  
High Performance ◽  
High Energy Physics ◽  
Job Scheduling ◽  
High Energy ◽  
The Other ◽  
Workload Manager ◽  
High Degree ◽  
Performance Computing ◽  
Energy Physics

There are two production clusters co-existed in the Institute of High Energy Physics (IHEP). One is a High Throughput Computing (HTC) cluster with HTCondor as the workload manager, the other is a High Performance Computing (HPC) cluster with Slurm as the workload manager. The resources of the HTCondor cluster are funded by multiple experiments, and the resource utilization reached more than 90% by adopting a dynamic resource share mechanism. Nevertheless, there is a bottleneck if more resources are requested by multiple experiments at the same moment. On the other hand, parallel jobs running on the Slurm cluster reflect some specific attributes, such as high degree of parallelism, low quantity and long wall time. Such attributes make it easy to generate free resource slots which are suitable for jobs from the HTCondor cluster. As a result, if there is a mechanism to schedule jobs from the HTCon-dor cluster to the Slurm cluster transparently, it would improve the resource utilization of the Slurm cluster, and reduce job queue time for the HTCondor cluster. In this proceeding, we present three methods to migrate HTCondor jobs to the Slurm cluster, and concluded that HTCondor-C is more preferred. Furthermore, because design philosophy and application scenes are di↵erent between HTCondor and Slurm, some issues and possible solutions related with job scheduling are presented.

High-Performance Computing Modeling Advances Accelerator Science for High-Energy Physics

2014 ◽  
Vol 16 (6) ◽  
pp. 32-41 ◽  
Author(s):  
James Amundson ◽  
Alexandru Macridin ◽  
Panagiotis Spentzouris
Keyword(s):  
High Performance Computing ◽  
High Performance ◽  
High Energy Physics ◽  
High Energy ◽  
Performance Computing ◽  
Energy Physics

scholarly journals Kalman Filter track reconstruction on FPGAs for acceleration of the High Level Trigger of the CMS experiment at the HL-LHC

2019 ◽  
Vol 214 ◽  
pp. 01003
Author(s):  
Sioni Summers ◽  
Andrew Rose
Keyword(s):  
Kalman Filter ◽  
High Performance ◽  
High Energy Physics ◽  
Computation Time ◽  
High Energy ◽  
Track Reconstruction ◽  
Level Trigger ◽  
Cms Experiment ◽  
High Level ◽  
Energy Physics

Track reconstruction at the CMS experiment uses the Combinatorial Kalman Filter. The algorithm computation time scales exponentially with pileup, which will pose a problem for the High Level Trigger at the High Luminosity LHC. FPGAs, which are already used extensively in hardware triggers, are becoming more widely used for compute acceleration. With a combination of high performance, energy efficiency, and predictable and low latency, FPGA accelerators are an interesting technology for high energy physics. Here, progress towards porting of the CMS track reconstruction to Maxeler Technologies’ Dataflow Engines is shown, programmed with their high level language MaxJ. The performance is compared to CPUs, and further steps to optimise for the architecture are presented.

scholarly journals Real-time HEP analysis with funcX, a high-performance platform for function as a service

2020 ◽  
Vol 245 ◽  
pp. 07046
Author(s):  
Anna Elizabeth Woodard ◽  
Ana Trisovic ◽  
Zhuozhao Li ◽  
Yadu Babuji ◽  
Ryan Chard ◽  
...  
Keyword(s):  
Real Time ◽  
High Performance ◽  
High Energy Physics ◽  
High Energy ◽  
Service Platform ◽  
Performance Function ◽  
Service Paradigm ◽  
Heterogeneous Resources ◽  
Energy Physics

We explore how the function as a service paradigm can be used to address the computing challenges in experimental high-energy physics at CERN. As a case study, we use funcX—a high-performance function as a service platform that enables intuitive, flexible, efficient, and scalable remote function execution on existing infrastructure—to parallelize an analysis operating on columnar data to aggregate histograms of analysis products of interest in real-time. We demonstrate efficient execution of such analyses on heterogeneous resources.

scholarly journals Distributed statistical inference with pyhf enabled through funcX

2021 ◽  
Vol 251 ◽  
pp. 02070
Author(s):  
Matthew Feickert ◽  
Lukas Heinrich ◽  
Giordon Stark ◽  
Ben Galewsky
Keyword(s):  
Statistical Inference ◽  
High Performance ◽  
High Energy Physics ◽  
Job Scheduling ◽  
Hadron Collider ◽  
High Energy ◽  
New Physics ◽  
Probability Models ◽  
Compute Model ◽  
Energy Physics

In High Energy Physics facilities that provide High Performance Computing environments provide an opportunity to efficiently perform the statistical inference required for analysis of data from the Large Hadron Collider, but can pose problems with orchestration and efficient scheduling. The compute architectures at these facilities do not easily support the Python compute model, and the configuration scheduling of batch jobs for physics often requires expertise in multiple job scheduling services. The combination of the pure-Python libraries pyhf and funcX reduces the common problem in HEP analyses of performing statistical inference with binned models, that would traditionally take multiple hours and bespoke scheduling, to an on-demand (fitting) “function as a service” that can scalably execute across workers in just a few minutes, offering reduced time to insight and inference. We demonstrate execution of a scalable workflow using funcX to simultaneously fit 125 signal hypotheses from a published ATLAS search for new physics using pyhf with a wall time of under 3 minutes. We additionally show performance comparisons for other physics analyses with openly published probability models and argue for a blueprint of fitting as a service systems at HPC centers.

Sign in / Sign up

Export Citation Format

Share Document