scholarly journals Metadata Integration with Labeled-Property Graphs

2019 ◽  
pp. 441-448
Author(s):  
Vasily Bunakov
Keyword(s):  
Metadata Integration

scholarly journals The ATLAS EventIndex for LHC Run 3

2020 ◽  
Vol 245 ◽  
pp. 04017
Author(s):  
Dario Barberis ◽  
Igor Aleksandrov ◽  
Evgeny Alexandrov ◽  
Zbigniew Baranowski ◽  
Gancho Dimitrov ◽  
...  
Keyword(s):  
Event Detection ◽  
Storage System ◽  
Data Access ◽  
Use Cases ◽  
Production Rates ◽  
Global Event ◽  
Storage Service ◽  
Data Ingestion ◽  
Core Storage ◽  
Metadata Integration

The ATLAS EventIndex was designed in 2012-2013 to provide a global event catalogue and limited event-level metadata for ATLAS analysis groups and users during the LHC Run 2 (2015-2018). It provides a good and reliable service for the initial use cases (mainly event picking) and several additional ones, such as production consistency checks, duplicate event detection and measurements of the overlaps of trigger chains and derivation datasets. The LHC Run 3, starting in 2021, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This proceeding describes the implementation of a new core storage service that will be able to provide at least the same functionality as the current one for increased data ingestion and search rates, and with increasing volumes of stored data. It is based on a set of HBase tables, with schemas derived from the current Oracle implementation, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, allowing to re-use most of the existing code for metadata integration.

Sign in / Sign up

Export Citation Format

Share Document