Revisiting the design of LSM-tree Based OLTP storage engine with persistent memory

2021 ◽  
Vol 14 (10) ◽  
pp. 1872-1885
Author(s):  
Baoyue Yan ◽  
Xuntao Cheng ◽  
Bo Jiang ◽  
Shibin Chen ◽  
Canfang Shang ◽  
...  

The recent byte-addressable and large-capacity commercialized persistent memory (PM) is promising to drive database as a service (DBaaS) into unchartered territories. This paper investigates how to leverage PMs to revisit the conventional LSM-tree based OLTP storage engines designed for DRAM-SSD hierarchy for DBaaS instances. Specifically we (1) propose a light-weight PM allocator named Hal-loc customized for LSM-tree, (2) build a high-performance Semi-persistent Memtable utilizing the persistent in-memory writes of PM, (3) design a concurrent commit algorithm named Reorder Ring to aschieve log-free transaction processing for OLTP workloads and (4) present a Global Index as the new globally sorted persistent level with non-blocking in-memory compaction. The design of Reorder Ring and Semi-persistent Memtable achieves fast writes without synchronized logging overheads and achieves near instant recovery time. Moreover, the design of Semi-persistent Memtable and Global Index with in-memory compaction enables the byte-addressable persistent levels in PM, which significantly reduces the read and write amplification as well as the background compaction overheads. The overall evaluation shows that the performance of our proposal over PM-SSD hierarchy outperforms the baseline by up to 3.8x in YCSB benchmark and by 2x in TPC-C benchmark.

Author(s):  
Liping Yao ◽  
Danlei Zhu ◽  
Hailiang Liao ◽  
Sheik Haseena ◽  
Mahesh kumar Ravva ◽  
...  

Due to their advantages of low-cost, light-weight, and mechanical flexibility, much attention has been focused on pi-conjugated organic semiconductors. In the past decade, although many materials with high performance has...


2013 ◽  
Vol 30 (06) ◽  
pp. 1350026 ◽  
Author(s):  
ADIEL TEIXEIRA DE ALMEIDA

Using additive models for aggregation of criteria is an important procedure in many multicriteria decision methods. This compensatory approach, which scores the alternatives straightforwardly, may have significant drawbacks. For instance, the Decision Maker (DM) may prefer not to select alternatives which have a very low performance in whatever criterion. In contrast, such an alternative may have the best overall evaluation, since the additive model may compensate this low performance in one of the criteria as a result of high performance in other criteria. Thus, additive-veto models are proposed with a view to considering the possibility of vetoing alternatives in such situations, particularly for choice and ranking problems. A numerical application illustrates the use of such models, with a detailed discussion related to real practical problems. Moreover, the results obtained from a numerical simulation show that it is not so rare for a veto of the best alternative to occur in the additive model. This is of considerable relevance depending on the DM's preference structure.


2013 ◽  
Vol 554-557 ◽  
pp. 264-273 ◽  
Author(s):  
Stanislav Dedov ◽  
Gunter Lehmann ◽  
Rudolf Kawalla

Due to the constant development in the automotive industry, where high performance shared with the maximal comfort and safety at low car body weight are the primary goals, gains the lightweight construction in importance. Materials with light weight, high strength and toughness are being engaged. With this background the material aluminum and its alloys become highly attractive to manufacturers. There are mainly two ways of forming the metal materials: casting or forming. Apart from substitution of one method by another there are also many examples of combining of casting and forging processes in practice. Such approach allows using the advantages of both methods, shortening the process chains and saving energy and resources at the same time. Furthermore the form flexibility can be increased and the product quality can be improved. For higher process efficiency a direct transition from casting to forging operation should be applied, so that the heat loss decreases and no additional heat treatment between these operations is necessary. There are processes known, which allow producing the final parts by casting and forging from one a single heat. The application of such processes requires materials, which have simultaneously good casting and forging properties. The Institute of Metal forming TU Freiberg works intensively on development of combined casting-forging technologies for lightweight aluminum parts. A technological chain for this coupled process followed by precipitation hardening heat treatment was developed (Figure 1). Heat treatable aluminum cast and wrought alloys with 1 – 7 % silicon were applied. By the variation of silicon content the optimal cast, forging and hardening properties were achieved. This technology with high energy efficiency allows producing durable light weight parts from aluminum alloys while the mechanical properties of the final parts are equal to or even higher than those in the conventional processes.


2021 ◽  
Vol 17 (3) ◽  
pp. 1-25
Author(s):  
Bohong Zhu ◽  
Youmin Chen ◽  
Qing Wang ◽  
Youyou Lu ◽  
Jiwu Shu

Non-volatile memory and remote direct memory access (RDMA) provide extremely high performance in storage and network hardware. However, existing distributed file systems strictly isolate file system and network layers, and the heavy layered software designs leave high-speed hardware under-exploited. In this article, we propose an RDMA-enabled distributed persistent memory file system, Octopus + , to redesign file system internal mechanisms by closely coupling non-volatile memory and RDMA features. For data operations, Octopus + directly accesses a shared persistent memory pool to reduce memory copying overhead, and actively fetches and pushes data all in clients to rebalance the load between the server and network. For metadata operations, Octopus + introduces self-identified remote procedure calls for immediate notification between file systems and networking, and an efficient distributed transaction mechanism for consistency. Octopus + is enabled with replication feature to provide better availability. Evaluations on Intel Optane DC Persistent Memory Modules show that Octopus + achieves nearly the raw bandwidth for large I/Os and orders of magnitude better performance than existing distributed file systems.


2021 ◽  
Vol 14 (5) ◽  
pp. 785-798
Author(s):  
Daokun Hu ◽  
Zhiwen Chen ◽  
Jianbing Wu ◽  
Jianhua Sun ◽  
Hao Chen

Persistent memory (PM) is increasingly being leveraged to build hash-based indexing structures featuring cheap persistence, high performance, and instant recovery, especially with the recent release of Intel Optane DC Persistent Memory Modules. However, most of them are evaluated on DRAM-based emulators with unreal assumptions, or focus on the evaluation of specific metrics with important properties sidestepped. Thus, it is essential to understand how well the proposed hash indexes perform on real PM and how they differentiate from each other if a wider range of performance metrics are considered. To this end, this paper provides a comprehensive evaluation of persistent hash tables. In particular, we focus on the evaluation of six state-of-the-art hash tables including Level hashing, CCEH, Dash, PCLHT, Clevel, and SOFT, with real PM hardware. Our evaluation was conducted using a unified benchmarking framework and representative workloads. Besides characterizing common performance properties, we also explore how hardware configurations (such as PM bandwidth, CPU instructions, and NUMA) affect the performance of PM-based hash tables. With our in-depth analysis, we identify design trade-offs and good paradigms in prior arts, and suggest desirable optimizations and directions for the future development of PM-based hash tables.


Sign in / Sign up

Export Citation Format

Share Document