The Software Defined Online Storage System at the GridKa WLCG Tier-1 Center

The computing center GridKa is serving the ALICE, ATLAS, CMS and LHCb experiments as one of the biggest WLCG Tier-1 centers world wide with compute and storage resources. It is operated by the Steinbuch Centre for Computing at Karlsruhe Institute of Technology in Germany. In April 2017 a new online storage system was put into operation. In its current stage of expansion it offers the HEP experiments a capacity of 34 PB of online storage. The whole storage is partitioned into few large file systems, one for each experiment, using IBM Spectrum Scale as software-defined-storage base layer. The system offers a combined read-write performance of 100 GB/s. It can be scaled transparently both in size and performance allowing to fulfill the growing needs especially of the LHC experiments for online storage in the coming years. In this article we discuss the general architecture of the storage system and present first experiences with the performance of the system in production use.

Download Full-text

An Empirical Evaluation of NVM-Aware File Systems on Intel Optane DC Persistent Memory Modules

Electronics ◽

10.3390/electronics10161977 ◽

2021 ◽

Vol 10 (16) ◽

pp. 1977

Author(s):

Guangyu Zhu ◽

Jaehyun Han ◽

Sangjin Lee ◽

Yongseok Son

Keyword(s):

Data Management ◽

Empirical Evaluation ◽

File Systems ◽

Data Management System ◽

Nand Flash ◽

Storage Devices ◽

Persistent Memory ◽

Memory Modules ◽

And Performance ◽

And Storage

The emergence of non-volatile memories (NVM) brings new opportunities and challenges to data management system design. As an important part of the data management systems, several new file systems are developed to take advantage of the characteristics of NVM. However, these NVM-aware file systems are usually designed and evaluated based on simulations or emulations. In order to explore the performance and characteristics of these file systems on real hardware, in this article, we provide an empirical evaluation of NVM-aware file systems on the first commercially available byte-addressable NVM (i.e., the Intel Optane DC Persistent Memory Module (DCPMM)). First, to compare the performance difference between traditional file systems and NVM-aware file systems, we evaluate the performance of Ext4, XFS, F2FS, Ext4-DAX, XFS-DAX, and NOVA file systems on DCPMMs. To compare DCPMMs with other secondary storage devices, we also conduct the same evaluations on Optane SSDs and NAND-flash SSDs. Second, we observe how remote NUMA node access and device mapper striping affect the performance of DCPMMs. Finally, we evaluate the performance of the database (i.e., MySQL) on DCPMMs with Ext4 and Ext4-DAX file systems. We summarize several observations from the evaluation results and performance analysis. We anticipate that these observations will provide implications for various memory and storage systems.

Download Full-text

Development of stormwater exfiltration systems

10.32920/ryerson.14661942.v1 ◽

2021 ◽

Author(s):

Zulfiqar Ali Khowaja

Keyword(s):

Best Management Practices ◽

Management Practices ◽

Storage System ◽

Urban Runoff ◽

Best Management ◽

Parking Lot ◽

And Performance ◽

The City ◽

And Storage ◽

Receiving Water

Pollutant loading from urban runoff has been established as a major cause of receiving water degradation. In an effort to control this problem at the source many Best Management Practices (BMP) have been developed. In this report, the Atlantis Exfiltration Tanks System, was developed as a potential BMP for the City of Sarnia. In order to analyze the efficiency and performance characteristics of the Atlantis Exfiltration Tanks, it is necessary to conduct pilot study before implementation. For this purpose, the highly impervious parking lot of the Newton's Park in Sarnia was selected to develop the Atlantis Exfiltration System (AES). The construction of AES was completed in summer of 2004. AES is an "at source" base water purification and storage system. This report includes the construction and performance of AES followed by conclusions and recommendations for further study.

Download Full-text

Rethinking key–value store for parallel I/O optimization

The International Journal of High Performance Computing Applications ◽

10.1177/1094342016677084 ◽

2016 ◽

Vol 31 (4) ◽

pp. 335-356 ◽

Cited By ~ 4

Author(s):

Anthony Kougkas ◽

Hassan Eslami ◽

Xian-He Sun ◽

Rajeev Thakur ◽

William Gropp

Keyword(s):

Cloud Storage ◽

Large Scale ◽

Storage Systems ◽

Storage System ◽

File Systems ◽

Data Synchronization ◽

Input Output ◽

Parallel File Systems ◽

Parallel File ◽

And Performance

Key–value stores are being widely used as the storage system for large-scale internet services and cloud storage systems. However, they are rarely used in HPC systems, where parallel file systems are the dominant storage solution. In this study, we examine the architecture differences and performance characteristics of parallel file systems and key–value stores. We propose using key–value stores to optimize overall Input/Output (I/O) performance, especially for workloads that parallel file systems cannot handle well, such as the cases with intense data synchronization or heavy metadata operations. We conducted experiments with several synthetic benchmarks, an I/O benchmark, and a real application. We modeled the performance of these two systems using collected data from our experiments, and we provide a predictive method to identify which system offers better I/O performance given a specific workload. The results show that we can optimize the I/O performance in HPC systems by utilizing key–value stores.

Download Full-text

DEVELOPMENT OF AN AIR DELIVERABLE ANTIPOLLUTION TRANSFER SYSTEM INCLUDING THE DEVELOPMENT OF OF AN OPTIMUM OIL STORAGE CONTAINER

International Oil Spill Conference Proceedings ◽

10.7901/2169-3358-1971-1-165 ◽

1971 ◽

Vol 1971 (1) ◽

pp. 165-177

Author(s):

Commander R.J. Ketchel ◽

H.D. Smith

Keyword(s):

Field Test ◽

Storage System ◽

Performance Data ◽

Development Effort ◽

Transfer System ◽

Storage Container ◽

The Past ◽

Oil Storage ◽

And Performance ◽

And Storage

ABSTRACT During the past two years development of a special purpose emergency tanker unloading system was accomplished. The Air Deliverable Transfer Pumping and Storage System (ADAPTS) is now being provided for operational use. This paper traces the development of the system from inception to procurement specifications preparation. Problems encountered during the development effort are identified. Solutions, and the rationale behind them, obtained to overcome the technical and operational problems are discussed. Field test experience and performance data on the ADAPTS system are presented.

Download Full-text

Cost and Performance Metrics Used to Assess Carbon Utilization and Storage Technologies

10.2172/1489766 ◽

2014 ◽

Author(s):

Alexander Zoelle ◽

Peter Kabatek

Keyword(s):

Performance Metrics ◽

Carbon Utilization ◽

And Performance ◽

Storage Technologies ◽

And Storage

Download Full-text

Artificial intelligence-based nonlinear control of renewable energies and storage system in a DC microgrid

ISA Transactions ◽

10.1016/j.isatra.2021.04.004 ◽

2021 ◽

Author(s):

Syeda Shafia Zehra ◽

Aqeel Ur Rahman ◽

Hammad Armghan ◽

Iftikhar Ahmad ◽

Umme Ammara

Keyword(s):

Artificial Intelligence ◽

Nonlinear Control ◽

Storage System ◽

Renewable Energies ◽

Dc Microgrid ◽

And Storage

Download Full-text

Parameter Study and Dynamic Simulation of the DEMO Intermediate Heat Transfer and Storage System Design Using MATLAB®/Simulink

Fusion Engineering and Design ◽

10.1016/j.fusengdes.2021.112291 ◽

2021 ◽

Vol 166 ◽

pp. 112291

Author(s):

Maria-Victoria Bologa ◽

Evaldas Bubelis ◽

Wolfgang Hering

Keyword(s):

Heat Transfer ◽

System Design ◽

Dynamic Simulation ◽

Storage System ◽

Parameter Study ◽

And Storage

Download Full-text

Review of Battery Management Systems (BMS) Development and Industrial Standards

Technologies ◽

10.3390/technologies9020028 ◽

2021 ◽

Vol 9 (2) ◽

pp. 28

Author(s):

Hossam A. Gabbar ◽

Ahmed M. Othman ◽

Muhammad R. Abdussami

Keyword(s):

Energy Storage ◽

Large Scale ◽

Comprehensive Evaluation ◽

Storage System ◽

Energy Storage System ◽

Battery Management System ◽

Battery Management ◽

Electrical Power System ◽

Safety Aspects ◽

And Performance

The evolving global landscape for electrical distribution and use created a need area for energy storage systems (ESS), making them among the fastest growing electrical power system products. A key element in any energy storage system is the capability to monitor, control, and optimize performance of an individual or multiple battery modules in an energy storage system and the ability to control the disconnection of the module(s) from the system in the event of abnormal conditions. This management scheme is known as “battery management system (BMS)”, which is one of the essential units in electrical equipment. BMS reacts with external events, as well with as an internal event. It is used to improve the battery performance with proper safety measures within a system. Therefore, a safe BMS is the prerequisite for operating an electrical system. This report analyzes the details of BMS for electric transportation and large-scale (stationary) energy storage. The analysis includes different aspects of BMS covering testing, component, functionalities, topology, operation, architecture, and BMS safety aspects. Additionally, current related standards and codes related to BMS are also reviewed. The report investigates BMS safety aspects, battery technology, regulation needs, and offer recommendations. It further studies current gaps in respect to the safety requirements and performance requirements of BMS by focusing mainly on the electric transportation and stationary application. The report further provides a framework for developing a new standard on BMS, especially on BMS safety and operational risk. In conclusion, four main areas of (1) BMS construction, (2) Operation Parameters, (3) BMS Integration, and (4) Installation for improvement of BMS safety and performance are identified, and detailed recommendations were provided for each area. It is recommended that a technical review of the BMS be performed for transportation electrification and large-scale (stationary) applications. A comprehensive evaluation of the components, architectures, and safety risks applicable to BMS operation is also presented.

Download Full-text