Towards Building a Distributed Data Management Architecture to Integrate Multi-Sources Remote Sensing Big Data

Author(s):  
Xiaohui Huang ◽  
Lizhe Wang ◽  
Jining Yan ◽  
Ze Deng ◽  
Shaoyuan Wang ◽  
...  
1992 ◽  
Vol 31 (3) ◽  
pp. 459-487
Author(s):  
R. A. Demers ◽  
J. D. Fisher ◽  
S. S. Gaitonde ◽  
R. R. Sanders

2014 ◽  
Vol 513 (3) ◽  
pp. 032095 ◽  
Author(s):  
Wataru Takase ◽  
Yoshimi Matsumoto ◽  
Adil Hasan ◽  
Francesca Di Lodovico ◽  
Yoshiyuki Watase ◽  
...  

2021 ◽  
Vol 251 ◽  
pp. 02057
Author(s):  
Cédric Serfon ◽  
Ruslan Mashinistov ◽  
John Steven De Stefano ◽  
Michel Hernández Villanueva ◽  
Hironori Ito ◽  
...  

The Belle II experiment, which started taking physics data in April 2019, will multiply the volume of data currently stored on its nearly 30 storage elements worldwide by one order of magnitude to reach about 340 PB of data (raw and Monte Carlo simulation data) by the end of operations. To tackle this massive increase and to manage the data even after the end of the data taking, it was decided to move the Distributed Data Management software from a homegrown piece of software to a widely used Data Management solution in HEP and beyond : Rucio. This contribution describes the work done to integrate Rucio with Belle II distributed computing infrastructure as well as the migration strategy that was successfully performed to ensure a smooth transition.


Sign in / Sign up

Export Citation Format

Share Document