scholarly journals The ALICE O2 data quality control system

2020 ◽  
Vol 245 ◽  
pp. 01027
Author(s):  
Piotr Konopka ◽  
Barthélémy von Haller

The ALICE Experiment at CERN LHC (Large Hadron Collider) is undertaking a major upgrade during LHC Long Shutdown 2 in 2019–2021. The raw data input from the ALICE detectors will then increase a hundredfold, up to 3.5 TB/s. In order to cope with such a large amount of data, a new online-offline computing system, called O2, will be deployed. One of the key software components of the O2 system will be the data Quality Control (QC) that replaces the existing online Data Quality Monitoring and offline Quality Assurance. It involves the gathering, the analysis by user-defined algorithms and the visualization of monitored data, in both the synchronous and asynchronous parts of the O2 system. This paper presents the architecture and design, as well as the latest and upcoming features, of the ALICE O2 QC. The results of the extensive benchmarks which have been carried out for each component of the system are later summarized. Finally, the adoption of this tool amongst the ALICE Collaboration and the measures taken to develop, in synergy with their respective teams, efficient monitoring modules for the detectors, are discussed.

Author(s):  
Antonella D. Pontoriero ◽  
Giovanna Nordio ◽  
Rubaida Easmin ◽  
Alessio Giacomel ◽  
Barbara Santangelo ◽  
...  

2001 ◽  
Vol 27 (7) ◽  
pp. 867-876 ◽  
Author(s):  
Pankajakshan Thadathil ◽  
Aravind K Ghosh ◽  
J.S Sarupria ◽  
V.V Gopalakrishna

2014 ◽  
Vol 926-930 ◽  
pp. 4254-4257 ◽  
Author(s):  
Jin Xu ◽  
Da Tao Yu ◽  
Zhong Jie Yuan ◽  
Bo Li ◽  
Zi Zhou Xu

Traditional artificial perception quality control methods of marine environment monitoring data have many disadvantages, including high labor costs and mistakes of data review. Based on GIS spatial analysis technology, Marine Environment Monitoring Data Quality Control System is established according to the Bohai Sea monitoring regulation. In the practical application process, it plays the role of improving efficiency of quality control, saving the manpower and financial resources. It also provides an important guarantee for the comprehensive analysis and management of marine environment data.


1980 ◽  
Vol 1 (2) ◽  
pp. 171-172
Author(s):  
M.M. Koretz ◽  
M. Kohler ◽  
E. McGuigan ◽  
J.F. Hannigan ◽  
B.W. Brown

2020 ◽  
Vol 27 (4) ◽  
Author(s):  
Daniel Michelson ◽  
Bjarne Hansen ◽  
Dominik Jacques ◽  
François Lemay ◽  
Peter Rodriguez

Sensors ◽  
2018 ◽  
Vol 18 (8) ◽  
pp. 2628 ◽  
Author(s):  
Yusheng Zhou ◽  
Rufu Qin ◽  
Huiping Xu ◽  
Shazia Sadiq ◽  
Yang Yu

With the construction and deployment of seafloor observatories around the world, massive amounts of oceanographic measurement data were gathered and transmitted to data centers. The increase in the amount of observed data not only provides support for marine scientific research but also raises the requirements for data quality control, as scientists must ensure that their research outcomes come from high-quality data. In this paper, we first analyzed and defined data quality problems occurring in the East China Sea Seafloor Observatory System (ECSSOS). We then proposed a method to detect and repair the data quality problems of seafloor observatories. Incorporating data statistics and expert knowledge from domain specialists, the proposed method consists of three parts: a general pretest to preprocess data and provide a router for further processing, data outlier detection methods to label suspect data points, and a data interpolation method to fill up missing and suspect data. The autoregressive integrated moving average (ARIMA) model was improved and applied to seafloor observatory data quality control by using a sliding window and cleaning the input modeling data. Furthermore, a quality control flag system was also proposed and applied to describe data quality control results and processing procedure information. The real observed data in ECSSOS were used to implement and test the proposed method. The results demonstrated that the proposed method performed effectively at detecting and repairing data quality problems for seafloor observatory data.


Sign in / Sign up

Export Citation Format

Share Document