scholarly journals Building blocks for persistent memory

2020 ◽  
Vol 29 (6) ◽  
pp. 1223-1241
Author(s):  
Alexander van Renen ◽  
Lukas Vogel ◽  
Viktor Leis ◽  
Thomas Neumann ◽  
Alfons Kemper
Keyword(s):  
Performance Evaluation ◽  
Building Blocks ◽  
Database Systems ◽  
Performance Bottlenecks ◽  
Persistent Memory ◽  
Comprehensive Performance ◽  
Memory Modules ◽  
Real Hardware ◽  
Writing Block ◽  
Level Building

AbstractI/O latency and throughput are two of the major performance bottlenecks for disk-based database systems. Persistent memory (PMem) technologies, like Intel’s Optane DC persistent memory modules, promise to bridge the gap between NAND-based flash (SSD) and DRAM, and thus eliminate the I/O bottleneck. In this paper, we provide the first comprehensive performance evaluation of PMem on real hardware in terms of bandwidth and latency. Based on the results, we develop guidelines for efficient PMem usage and four optimized low-level building blocks for PMem applications: log writing, block flushing, in-place updates, and coroutines for write latency hiding.

Performance Evaluation of Distributed Database Systems

2014 ◽  
Vol 13 (9) ◽  
pp. 4859-4867
Author(s):  
Khaled Saleh Maabreh
Keyword(s):  
Performance Evaluation ◽  
System Performance ◽  
Operation Mode ◽  
Database Systems ◽  
Distributed Database ◽  
Evaluation Study ◽  
Distributed Database Systems ◽  
Different Types ◽  
Distributed Database System ◽  
Distributed Database Management

Distributed database management systems manage a huge amount of data as well as large and increasingly growing number of users through different types of queries. Therefore, efficient methods for accessing these data volumes will be required to provide a high and an acceptable level of system performance.  Data in these systems are varying in terms of types from texts to images, audios and videos that must be available through an optimized level of replication. Distributed database systems have many parameters like data distribution degree, operation mode and the number of sites and replication. These parameters have played a major role in any performance evaluation study. This paper investigates the main parameters that may affect the system performance, which may help with configuring the distributed database system for enhancing the overall system performance.

scholarly journals Comprehensive Performance Evaluation of Green Infrastructure Practices for Urban Watersheds Using an Engineering–Environmental–Economic (3E) Model

2021 ◽  
Vol 13 (9) ◽  
pp. 4678
Author(s):  
Yi-Jia Xing ◽  
Tse-Lun Chen ◽  
Meng-Yao Gao ◽  
Si-Lu Pei ◽  
Wei-Bin Pan ◽  
...  
Keyword(s):  
Performance Evaluation ◽  
Environmental Economic ◽  
Environmental Impact ◽  
Pollution Control ◽  
Green Infrastructure ◽  
Stormwater Management ◽  
Economic Cost ◽  
Urban Watersheds ◽  
Comprehensive Performance ◽  
Detention Basins

Green infrastructure practices could provide innovative solutions for on-site stormwater management and runoff pollution control, which could relieve the stress of nonpoint pollution resulting from heavy rainfall events. In this study, the performance and cost-effectiveness of six green infrastructure practices, namely, green roofs, rain gardens, pervious surfaces, swales, detention basins, and constructed wetlands, were investigated. The comprehensive performance evaluation in terms of the engineering performance, environmental impact, and economic cost was determined in the proposed engineering–environmental–economic (3E) triangle model. The results revealed that these green infrastructure practices were effective for stormwater management in terms of runoff attenuation, peak flow reduction and delay, and pollutant attenuation. It was suggested that for pollution control, detention basins can efficiently reduce the total suspended solids, total nitrogen, total phosphorus, and lead. The implementation of detention basins is highly recommended due to their higher engineering performance and lower environmental impact and economic cost. A case study of a preliminary cost–benefit analysis of green infrastructure practice exemplified by the Pearl River Delta in China was addressed. It suggested that green infrastructure was cost-effective in stormwater management in this area, which would be helpful for sustaining healthy urban watersheds.

Octopus + : An RDMA-Enabled Distributed Persistent Memory File System

2021 ◽  
Vol 17 (3) ◽  
pp. 1-25
Author(s):  
Bohong Zhu ◽  
Youmin Chen ◽  
Qing Wang ◽  
Youyou Lu ◽  
Jiwu Shu
Keyword(s):  
High Speed ◽  
High Performance ◽  
File System ◽  
Direct Memory Access ◽  
File Systems ◽  
Distributed File Systems ◽  
Persistent Memory ◽  
Memory Modules ◽  
Non Volatile Memory ◽  
Volatile Memory

Non-volatile memory and remote direct memory access (RDMA) provide extremely high performance in storage and network hardware. However, existing distributed file systems strictly isolate file system and network layers, and the heavy layered software designs leave high-speed hardware under-exploited. In this article, we propose an RDMA-enabled distributed persistent memory file system, Octopus + , to redesign file system internal mechanisms by closely coupling non-volatile memory and RDMA features. For data operations, Octopus + directly accesses a shared persistent memory pool to reduce memory copying overhead, and actively fetches and pushes data all in clients to rebalance the load between the server and network. For metadata operations, Octopus + introduces self-identified remote procedure calls for immediate notification between file systems and networking, and an efficient distributed transaction mechanism for consistency. Octopus + is enabled with replication feature to provide better availability. Evaluations on Intel Optane DC Persistent Memory Modules show that Octopus + achieves nearly the raw bandwidth for large I/Os and orders of magnitude better performance than existing distributed file systems.

Persistent memory hash indexes

2021 ◽  
Vol 14 (5) ◽  
pp. 785-798
Author(s):  
Daokun Hu ◽  
Zhiwen Chen ◽  
Jianbing Wu ◽  
Jianhua Sun ◽  
Hao Chen
Keyword(s):  
Future Development ◽  
High Performance ◽  
Performance Metrics ◽  
Comprehensive Evaluation ◽  
State Of The Art ◽  
Hash Tables ◽  
Trade Offs ◽  
Depth Analysis ◽  
Persistent Memory ◽  
Memory Modules

Persistent memory (PM) is increasingly being leveraged to build hash-based indexing structures featuring cheap persistence, high performance, and instant recovery, especially with the recent release of Intel Optane DC Persistent Memory Modules. However, most of them are evaluated on DRAM-based emulators with unreal assumptions, or focus on the evaluation of specific metrics with important properties sidestepped. Thus, it is essential to understand how well the proposed hash indexes perform on real PM and how they differentiate from each other if a wider range of performance metrics are considered. To this end, this paper provides a comprehensive evaluation of persistent hash tables. In particular, we focus on the evaluation of six state-of-the-art hash tables including Level hashing, CCEH, Dash, PCLHT, Clevel, and SOFT, with real PM hardware. Our evaluation was conducted using a unified benchmarking framework and representative workloads. Besides characterizing common performance properties, we also explore how hardware configurations (such as PM bandwidth, CPU instructions, and NUMA) affect the performance of PM-based hash tables. With our in-depth analysis, we identify design trade-offs and good paradigms in prior arts, and suggest desirable optimizations and directions for the future development of PM-based hash tables.

Sign in / Sign up

Export Citation Format

Share Document