The Quest to solve the HL-LHC data access puzzle

HL-LHC will confront the WLCG community with enormous data storage, management and access challenges. These are as much technical as economical. In the WLCG-DOMA Access working group, members of the experiments and site managers have explored different models for data access and storage strategies to reduce cost and complexity, taking into account the boundary conditions given by our community.Several of these scenarios have been evaluated quantitatively, such as the Data Lake model and incremental improvements of the current computing model with respect to resource needs, costs and operational complexity.To better understand these models in depth, analysis of traces of current data accesses and simulations of the impact of new concepts have been carried out. In parallel, evaluations of the required technologies took place. These were done in testbed and production environments at small and large scale.We will give an overview of the activities and results of the working group, describe the models and summarise the results of the technology evaluation focusing on the impact of storage consolidation in the form of Data Lakes, where the use of streaming caches has emerged as a successful approach to reduce the impact of latency and bandwidth limitation.We will describe the experience and evaluation of these approaches in different environments and usage scenarios. In addition we will present the results of the analysis and modelling efforts based on data access traces of the experiments.

Download Full-text

New developments in cost modeling for the LHC computing

EPJ Web of Conferences ◽

10.1051/epjconf/202024503014 ◽

2020 ◽

Vol 245 ◽

pp. 03014

Author(s):

Catherine Biscarat ◽

Tommaso Boccali ◽

Daniele Bonacorsi ◽

Concezio Bozzi ◽

Davide Costanzo ◽

...

Keyword(s):

Working Group ◽

Data Access ◽

Cost Modeling ◽

New Developments ◽

Resource Needs ◽

Recent Developments ◽

The Cost ◽

Future Work ◽

The Impact ◽

Computing Models

The increase in the scale of LHC computing during Run 3 and Run 4 (HL-LHC) will certainly require radical changes to the computing models and the data processing of the LHC experiments. The working group established by WLCG and the HEP Software Foundation to investigate all aspects of the cost of computing and how to optimise them has continued producing results and improving our understanding of this process. In particular, experiments have developed more sophisticated ways to calculate their resource needs, we have a much more detailed process to calculate infrastructure costs. This includes studies on the impact of HPC and GPU based resources on meeting the computing demands. We have also developed and perfected tools to quantitatively study the performance of experiments workloads and we are actively collaborating with other activities related to data access, benchmarking and technology cost evolution. In this contribution we expose our recent developments and results and outline the directions of future work.

Download Full-text

Smart Caching at CMS: applying AI to XCache edge services

EPJ Web of Conferences ◽

10.1051/epjconf/202024504024 ◽

2020 ◽

Vol 245 ◽

pp. 04024

Author(s):

Daniele Spiga ◽

Diego Ciangottini ◽

Mirco Tracolli ◽

Tommaso Tedeschi ◽

Daniele Cesini ◽

...

Keyword(s):

National Level ◽

Data Access ◽

Analysis Data ◽

Technical Solution ◽

Early Results ◽

Lake Model ◽

Geographically Distributed ◽

Computing Centers ◽

Working Set ◽

The Impact

The projected Storage and Compute needs for the HL-LHC will be a factor up to 10 above what can be achieved by the evolution of current technology within a flat budget. The WLCG community is studying possible technical solutions to evolve the current computing in order to cope with the requirements; one of the main focus is resource optimization, with the ultimate aim of improving performance and efficiency, as well as simplifying and reducing operation costs. As of today the storage consolidation based on a Data Lake model is considered a good candidate for addressing HL-LHC data access challenges. The Data Lake model under evaluation can be seen as a logical system that hosts a distributed working set of analysis data. Compute power can be “close” to the lake, but also remote and thus completely external. In this context we expect data caching to play a central role as a technical solution to reduce the impact of latency and reduce network load. A geographically distributed caching layer will be functional to many satellite computing centers that might appear and disappear dynamically. In this talk we propose a system of caches, distributed at national level, describing both deployment and results of the studies made to measure the impact on the CPU efficiency. In this contribution, we also present the early results on novel caching strategy beyond the standard XRootD approach whose results will be a baseline for an AI-based smart caching system.

Download Full-text

New developments on EDR (Event Data Recorder) for automated vehicles

Open Engineering ◽

10.1515/eng-2020-0007 ◽

2020 ◽

Vol 10 (1) ◽

pp. 140-146

Author(s):

Klaus Böhm ◽

Tibor Kubjatko ◽

Daniel Paula ◽

Hans-Georg Schweiger

Keyword(s):

Data Base ◽

Data Storage ◽

Data Model ◽

Working Group ◽

Storage System ◽

Data Access ◽

Event Data ◽

Automated Vehicles ◽

Automated Driving ◽

Quantum Leap

AbstractWith the upcoming new legislative rules in the EU on Event Data Recorder beginning 2022 the question is whether the discussed data base is sufficient for the needs of clarifying accidents involving automated vehicles. Based on the reconstruction of real accidents including vehicles with ADAS combined with specially designed crash tests a broader data base than US EDR regulation (NHTSA 49 CFR Part 563.7) is proposed. The working group AHEAD, to which the authors contribute, has already elaborated a data model that fits the needs of automated driving. The structure of this data model is shown. Moreover, the special benefits of storing internal video or photo feeds form the vehicle camera systems combined with object data is illustrated. When using a sophisticate 3D measurement method of the accident scene the videos or photos can also serve as a control instance for the stored vehicle data. The AHEAD Data Model enhanced with the storage of the video and photo feeds should be considered in the planned roadmap of the Informal Working Group (IWG) on EDR/ DSSAD (Data Storage System for Automated Driving) reporting to UNECE WP29. Also, a data access over the air using technology already applied in China for electric vehicles called Real Time Monitoring would allow a quantum leap in forensic accident reconstruction.

Download Full-text

Dominating OP Returns: The Impact of Omni and Veriblock on Bitcoin

Journal of Grid Computing ◽

10.1007/s10723-020-09537-9 ◽

2020 ◽

Vol 18 (4) ◽

pp. 575-592

Author(s):

Elias Strehle ◽

Fred Steinmetz

Keyword(s):

Data Storage ◽

The Other ◽

Other Hand ◽

Depth Analysis ◽

Almost All ◽

The Impact

AbstractBitcoin has always been used to store arbitrary data, particularly since Bitcoin Core developers added a dedicated method for data storage in 2014: the OP Return operator. This paper provides an in-depth analysis of all OP Return transactions published on Bitcoin between September 14, 2018, and December 31, 2019. The 32.4 million OP Return transactions (22% of all Bitcoin transactions) published during this period added 10 GB to the blockchain’s size. Almost all OP Return transactions can be attributed to one of 37 blockchain services. The two dominant services are Veriblock (58% of OP Return transactions) and Omni/Tether (40%). Veriblock transactions pay only 14% of the average transaction fee, partly because most of them are submitted during times when overall activity on Bitcoin is low. Omni transactions, on the other hand, pay more than twice the average transaction fee and therefore compete with regular Bitcoin transactions for inclusion in new blocks.

Download Full-text

Russia - European Union: The continuation ofthe sanctions standoff

Voprosy Ekonomiki ◽

10.32609/0042-8736-2017-6-114-127 ◽

2017 ◽

pp. 114-127

Author(s):

M. Klinova ◽

E. Sidorova

Keyword(s):

European Union ◽

Economic Recession ◽

Economic Sanctions ◽

Current Data ◽

The State ◽

The European Union ◽

The Impact ◽

The Eu ◽

Year 2013

The article deals with economic sanctions and their impact on the state and prospects of the neighboring partner economies - the European Union (EU) and Russia. It provides comparisons of current data with that of the year 2013 (before sanctions) to demonstrate the impact of sanctions on both sides. Despite the fact that Russia remains the EU’s key partner, it came out of the first three partners of the EU. The current economic recession is caused by different reasons, not only by sanctions. Both the EU and Russia have internal problems, which the sanctions confrontation only exacerbates. The article emphasizes the need for a speedy restoration of cooperation.

Download Full-text

Psychosomatic Features, Compliance and Complementary Therapies in Rheumatoid Arthritis

Current Rheumatology Reviews ◽

10.2174/1573397115666191212114758 ◽

2020 ◽

Vol 16 (3) ◽

pp. 215-223

Author(s):

Rostislav A. Grekhov ◽

Galina P. Suleimanova ◽

Andrei S. Trofimenko ◽

Liudmila N. Shilova

Keyword(s):

Quality Of Life ◽

Rheumatoid Arthritis ◽

Interpersonal Relationships ◽

Behavioral Therapy ◽

Current Data ◽

Psychotherapeutic Interventions ◽

And Coping ◽

Regulation Of Emotion ◽

The Impact

This review highlights the issue of psychosomatic conditions in rheumatoid arthritis, paying special attention to new researches and trends in this field. Emerging concepts in all the major parts of the problem are covered consecutively, from the impact of chronic musculoskeletal pain on the emotional state to disease influence over quality of life, socio-psychological, and interpersonal relationships. Chronic pain is closely related to emotional responses and coping ability, with a pronounced positive effect of psychotherapeutic interventions, family and social support on it. Psychosexual disorders, anxiety, depression also commonly coexist with rheumatoid arthritis, leading to further decrease in quality of life, low compliance, and high suicide risk. Influence of psychosomatic conditions on the overall treatment effect is usually underestimated by rheumatologists and general practitioners. Psychosomatic considerations are of great importance for up-to-date management of rheumatoid arthritis, as they strongly influence the quality of life, compliance, and thereby disease outcomes. Two major approaches of psychological rehabilitation exist, both coping with pain through the regulation of emotion and psychotherapeutic intervention, which not only helps patients in coping with the disease, but also aimed at improving the overall adaptation of the patient. It includes techniques of relaxation, cognitive-behavioral therapy, and biofeedback therapy. Current data about the efficacy of the additional correcting therapies for patients with rheumatoid arthritis, both emerging and common ones, are discussed in the review.

Download Full-text

The Catholic Diaspora—Experiences of Evacuation

10.1093/oso/9780198827023.003.0005 ◽

2018 ◽

Author(s):

Thomas Brodie

Keyword(s):

Urban Areas ◽

Religious Practice ◽

Catholic Clergy ◽

Profound Influence ◽

The Social ◽

Depth Analysis ◽

Nazi Era ◽

Mass Evacuation ◽

The Impact ◽

Pastoral Practice

This chapter analyses the impact exerted on the Catholic Church’s pastoral networks in Germany by the mass evacuation of laypeople from bombed urban areas as of 1941. Drawing on the voluminous correspondence of priests and curates despatched from the Rhineland and Westphalia to Saxony, Thuringia, Silesia, Austria, and elsewhere to minister to Catholic evacuees, this chapter provides in-depth analysis of the social and cultural histories of religious practice in wartime Germany. It demonstrates that the evacuation of laypeople—a topic long neglected within histories of wartime religious practice—exerted a profound influence on pastoral practice by the years 1943–5, placing unprecedented pressures on the Catholic clergy of the dioceses central to this study (Aachen, Cologne and Münster). This chapter therefore also casts new light on regionalism in Germany during the Nazi era.

Download Full-text

Decreased Medical Care During the COVID-19 Pandemic – A Comprehensive Analysis of Radiological Examinations

RöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren ◽

10.1055/a-1368-5047 ◽

2021 ◽

Author(s):

Annette Aigner ◽

Bernd Hamm ◽

Florian Nima Fleckenstein ◽

Tazio Maleitzke ◽

Georg Böning ◽

...

Keyword(s):

Medical Care ◽

Control Period ◽

Surrogate Marker ◽

Medical Specialty ◽

Case Volume ◽

Medical Specialties ◽

Key Points ◽

Depth Analysis ◽

The Impact ◽

Radiological Examinations

Objectives As a cross-section discipline within the hospital infrastructure, radiological departments might be able to provide important information regarding the impact of the COVID-19 pandemic on healthcare. The goal of this study was to quantify changes in medical care during the first wave of the pandemic using radiological examinations as a comprehensive surrogate marker and to determine potential future workload. Methods A retrospective analysis of all radiological examinations during the first wave of the pandemic was performed. The number of examinations was compared to time-matched control periods. Furthermore, an in-depth analysis of radiological examinations attributed to various medical specialties was conducted and postponed examinations were extrapolated to calculate additional workload in the near future. Results A total of 596,760 examinations were analyzed. Overall case volumes decreased by an average of 41 % during the shutdown compared to the control period. The most affected radiological modalities were sonography (–54 %), X-ray (–47 %) followed by MRI (–42 %). The most affected medical specialty was trauma and orthopedics (–60 % case volume) followed by general surgery (–49 %). Examination numbers increased during the post-shutdown period leading to a predicted additional workload of up to 22 %. Conclusion This study shows a marked decrease in radiological examinations in total and among several core medical specialties, indicating a significant reduction in medical care during the first COVID-19 shutdown. Key Points: Citation Format

Download Full-text

A Retrospective Experience of Helicobacter pylori Histology in a Large Sample of Subjects in Northern Italy

Life ◽

10.3390/life11070650 ◽

2021 ◽

Vol 11 (7) ◽

pp. 650

Author(s):

Davide Giuseppe Ribaldone ◽

Carlo Zurlo ◽

Sharmila Fagoonee ◽

Chiara Rosso ◽

Angelo Armandi ◽

...

Keyword(s):

Helicobacter Pylori ◽

Large Population ◽

Population Data ◽

Signet Ring Cell ◽

Current Data ◽

Low Grade ◽

Gastric Cardia Adenocarcinoma ◽

Significant Difference ◽

H Pylori ◽

The Impact

Updated data about the prevalence of Helicobacter pylori (H. pylori) and its correlation with histological results are scarce. The aim of our study was to provide current data on the impact of H. pylori in a third-level endoscopy service. We performed a large, retrospective study analyzing the results of all histological samples of gastroscopy from the year 2019. In total, 1512 subjects were included. The prevalence of H. pylori was 16.8%. A significant difference between the prevalence in subjects born in Italy and those from eastern Europe, south America, or Africa was found (p < 0.0001, p = 0.006, and p = 0.0006, respectively). An association was found between H. pylori and active superficial gastritis (p < 0.0001). Current H. pylori and/or a previous finding of H. pylori was related to antral atrophy (p < 0.0001). Fifteen patients had low-grade dysplasia. There were no statistically significant associations with current or past H. pylori infection. One patient presented gastric cardia adenocarcinoma with regular gastric mucosa. One patient, H. pylori positive, was diagnosed with gastric signet ring cell adenocarcinoma in a setting of diffuse atrophy, without metaplasia.. Our study provides updated, solid (biopsy diagnosis and large population) data on the prevalence of H. pylori infection in a representative region of southern Europe.

Download Full-text

Ontogenetic shift in the trophic role of the invasive killer shrimp Dikerogammarus villosus: a stable isotope study

Biological Invasions ◽

10.1007/s10530-021-02472-0 ◽

2021 ◽

Author(s):

Francesco Mancini ◽

Raffaele De Giorgi ◽

Alessandro Ludovisi ◽

Salvatrice Vizzini ◽

Giorgio Mancinelli

Keyword(s):

Dietary Habits ◽

Trophic Position ◽

Ecological Impact ◽

Central Italy ◽

Local Conditions ◽

Dikerogammarus Villosus ◽

Isotopic Signatures ◽

Depth Analysis ◽

Stable Isotope Study ◽

The Impact

AbstractThe introduction of the amphipod Dikerogammarus villosus in European fresh waters is to date recognized as a threat to the integrity of invaded communities. Predation by D. villosus on native benthic invertebrates is assumed as the key determinant of its ecological impact, yet available information describe the species as a primary consumer as well as a carnivore depending on local conditions. Here, we assessed the trophic position (TP) of D. villosus in Lake Trasimeno, a recently invaded lentic system in central Italy, using the CN isotopic signatures of individuals captured in winter spanning two orders of magnitude in body size. TP estimations were compared with those characterizing the native amphipod Echinogammarus veneris and other representative invertebrate predators. On average, D. villosus showed a trophic position higher than E. veneris, and comparable with that of odonate nymphs. An in-depth analysis revealed that large-sized individuals had a trophic position of 3.07, higher than odonates and close to that of the hirudinean predator Erpobdella octoculata, while small-sized specimens had a trophic position of 2.57, similar to that of E. veneris (2.41). These findings indicate that size-related ontogenetic shifts in dietary habits may per se vary the nature of the interaction between Dikerogammarus villosus and native invertebrates from competition to predation. Information collated from published isotopic studies corroborated the generality of our results. We conclude that intra-specific trophic flexibility may potentially amplify and make more multifaceted the impact of the species on other invertebrate species in invaded food webs.

Download Full-text