Distributed caching system for multi-site DPM storage

The main goal of this work, in the context of WLCG, is to test a storage setup where the storage areas are geographically distributed and the system provides some pools behaving as data caches. Users can find data needed for their analysis in a local cache and process them locally. We first demonstrate that the distributed setup for a DPM storage is almost transparent to the users, in terms of performance and functionalities. Then, we implement a mechanism to fill the storage cache with data registered in Rucio Data Management system and we test it, running a physics analysis that gets its input data from the cache. Thus we demonstrate that the use of such a system can be useful for diskless sites with a local cache only, allowing to optimize the distribution and analysis of experimental data.

Download Full-text

Data management and processing workflow for the Materials Physics and Engineering group beamlines at the Advanced Photon Source

Journal of Synchrotron Radiation ◽

10.1107/s1600577519000584 ◽

2019 ◽

Vol 26 (2) ◽

pp. 373-381 ◽

Cited By ~ 2

Author(s):

Jun-Sang Park ◽

Connor Horn ◽

Prithvi Ramanathan ◽

Peter Kenesei ◽

Siniša Veseli

Keyword(s):

Experimental Data ◽

Data Management ◽

Management System ◽

Experimental Techniques ◽

Data Management System ◽

Wide Range ◽

Photon Source ◽

Large User

The ability to store, organize, process and distribute experimental data effectively, efficiently and securely is particularly important for large user facilities like the Advanced Photon Source. In this article, the deployment of the APS Data Management System (DM) at the 1-ID and 6-BM beamlines of the APS is described. These two beamlines support a wide range of experimental techniques and generate data at relatively high rates, making them ideal candidates to illustrate the deployment and customization of the DM system and its tools. Using several usage examples at these beamlines, various capabilities of the DM system are described.

Download Full-text

Integration and Implementation of Numerical Design and Manufacturing Data Management System for Beverage Bottle

Applied Mechanics and Materials ◽

10.4028/www.scientific.net/amm.155-156.663 ◽

2012 ◽

Vol 155-156 ◽

pp. 663-667

Author(s):

Chao Lv ◽

Xiao Hong Pan

Keyword(s):

Experimental Data ◽

Data Management ◽

Management System ◽

Processing Parameters ◽

Data Management System ◽

Seamless Integration ◽

Design Cycle ◽

Numerical Design ◽

Key Technologies ◽

Design And Manufacturing

To implement numeralization and automation during the manufacturing of beverage bottles, a data management system for the numerical design and manufacturing of beverage bottle was proposed, which was required in the process of the rheological tests, simulation of stretch-blow process, and the optimization of the processing parameters. Simultaneously, several key technologies were illustrated in detail, including the processing of the experimental data, the seamless integration of various systems, the data mining and optimization of processing parameters. Application of this system beneficially offers technical support to lessen the experimental workload, improve the manufacturing process, guide the operation in workshop, shorten the design cycle and improve the efficiency.

Download Full-text

The design of a data management system at HEPS

Journal of Synchrotron Radiation ◽

10.1107/s1600577520015167 ◽

2021 ◽

Vol 28 (1) ◽

pp. 169-175

Author(s):

Hao Hu ◽

Fazhi Qi ◽

Hongmei Zhang ◽

Haolai Tian ◽

Qi Luo

Keyword(s):

Experimental Data ◽

Data Management ◽

Management System ◽

High Energy ◽

Data Management System ◽

General Situation ◽

It Systems ◽

Data Rates ◽

Key Techniques ◽

Storage Distribution

According to the estimated data rates, it is predicted that 24 PB raw experimental data will be produced per month from 14 beamlines at the first stage of the High-Energy Photon Source (HEPS) in China, and the volume of experimental data will be even greater with the completion of over 90 beamlines at the second stage in the future. To make sure that the huge amount of data collected at HEPS is accurate, available and accessible, an effective data management system (DMS) is crucial for deploying the IT systems. In this article, a DMS is designed for HEPS which is responsible for automating the organization, transfer, storage, distribution and sharing of the data produced from experiments. First, the general situation of HEPS is introduced. Second, the architecture and data flow of the HEPS DMS are described from the perspective of facility users and IT, and the key techniques implemented in this system are introduced. Finally, the progress and the effect of the DMS deployed as a testbed at beamline 1W1A of the Beijing Synchrotron Radiation Facility are shown.

Download Full-text

Risk Management on Information Security in ABC Company

ACMIT Proceedings ◽

10.33555/acmit.v4i1.60 ◽

2017 ◽

Vol 4 (1) ◽

pp. 62-66

Author(s):

Luyen Ha Nam

Keyword(s):

Risk Management ◽

Information Security ◽

Data Management ◽

Management System ◽

Risk Mitigation ◽

Data Management System ◽

Data Centre ◽

Long Time ◽

Mitigation Action ◽

Better Than

From long, long time ago until nowadays information still takes a serious position for all aspect of life, fromindividual to organization. In ABC company information is somewhat very sensitive, very important. But how wekeep our information safe, well we have many ways to do that: in hard drive, removable disc etc. with otherorganizations they even have data centre to save their information. The objective of information security is to keep information safe from unwanted access. We applied Risk Mitigation Action framework on our data management system and after several months we have a result far better than before we use it: information more secure, quickly detect incidents, improve internal and external collaboration etc.

Download Full-text