Hercules: Intelligent Coupling of Dual-Mode Flash Memory and Hard Disk Drive

2020 ◽  
Author(s):  
Wen Cheng ◽  
Yuqi Zou ◽  
Lingfang Zeng ◽  
Yang Wang
Keyword(s):  
Flash Memory ◽  
Reference Data ◽  
Storage System ◽  
Data Access ◽  
Disk Drive ◽  
Data Migration ◽  
Dual Mode ◽  
Performance Improvements ◽  
Locality Principle ◽  
The Cost

Abstract The write performance of multi-level cell (MLC) is several times slower than single-level cell (SLC); however, the cost per bit of MLC is much lower than SLC. Dual-mode flash (the medium can be partially switched to SLC mode by programming only 1 bit in some cells) can combine SLC and MLC to provide trading density opportunity for performance. In this paper, we present Hercules—a hybrid storage system that couples dual-mode flash memory and hard drive disk (HDD)—based on the content locality principle for high storage performance. The data are divided into two types: the reference data for read operation and the delta data for write operation. The reference data are stored in SLC and the delta data in MLC or HDD in sequential orders. Hercules organizes the metadata for the mapping of the physical locations of the reference blocks and the delta data of the original blocks, intelligently identifies hot/cold data and performs the data migration between MLC and disk for performance improvements. To validate our findings, we implemented Hercules and made evaluation to show that Hercules can effectively improve the data access speed and reduce the response time, compared with the Flashcache storage structure, and in particular, with Hercules, we can achieve 10% performance improvement over the system in absence of hot delta data caching.

scholarly journals Heat Prediction of High Energy Physical Data Based on LSTM Recurrent Neural Network

2020 ◽  
Vol 245 ◽  
pp. 04002
Author(s):  
Zhenjing Cheng ◽  
Lu Wang ◽  
Yaodong Cheng ◽  
Gang Chen
Keyword(s):  
High Energy Physics ◽  
Prediction Models ◽  
Heuristic Algorithms ◽  
Learning Algorithm ◽  
Storage System ◽  
Data Access ◽  
High Energy ◽  
Data Migration ◽  
File Access ◽  
Energy Physics

High-energy physics computing is a typical data-intensive calculation. Each year, petabytes of data needs to be analyzed, and data access performance is increasingly demanding. The tiered storage system scheme for building a unified namespace has been widely adopted. Generally, data is stored on storage devices with different performances and different prices according to different access frequency. When the heat of the data changes, the data is then migrated to the appropriate storage tier. At present, heuristic algorithms based on artificial experience are widely used in data heat prediction. Due to the differences in computing models of different users, the accuracy of prediction is low. A method for predicting future access popularity based on file access characteristics with the help of LSTM deep learning algorithm is proposed as the basis for data migration in hierarchical storage. This paper uses the real data of high-energy physics experiment LHAASO as an example for comparative testing. The results show that under the same test conditions, the model has higher prediction accuracy and stronger applicability than existing prediction models.

scholarly journals A Novel Global Key-Value Storage System Based on Kinetic Drives

Algorithms ◽  
2020 ◽  
Vol 13 (10) ◽  
pp. 247
Author(s):  
Xiang Cao ◽  
Cheng Li
Keyword(s):  
Average Distance ◽  
Storage System ◽  
Data Access ◽  
Disk Drive ◽  
Ip Address ◽  
Nosql Databases ◽  
Data Intensive ◽  
Storage Overhead ◽  
Backup And Recovery ◽  
Data Intensive Applications

NoSQL databases are flexible and efficient for many data intensive applications, and the key-value store is one of them. In recent years, a new Ethernet accessed disk drive called the “Kinetic Drive” was developed by Seagate. This new Kinetic Drive is specially designed for key-value stores. Users can directly access data with a Kinetic Drive via its IP address without going through a storage server/layer. With this new innovation, the storage stack and architectures of key-value store systems have been greatly changed. In this paper, we propose a novel global key-value store system based on Kinetic Drives. We explore data management issues including data access, key indexing, data backup, and recovery. We offer scalable solutions with small storage overhead. The performance evaluation shows that our location-aware design and backup approach can reduce the average distance traveled for data access requests.

scholarly journals The cost-effectiveness of an energy storage system using hydrogen and underground gas storage

2019 ◽  
Vol 137 ◽  
pp. 01007 ◽  
Author(s):  
Sebastian Lepszy
Keyword(s):  
Cost Effectiveness ◽  
Energy Storage ◽  
Historical Data ◽  
Renewable Energy Sources ◽  
Storage System ◽  
Energy Storage System ◽  
Electricity Production ◽  
Energy Market ◽  
The Cost ◽  
Random Nature

Due to the random nature of the production, the use of renewable energy sources requires the use of technologies that allow adjustment of electricity production to demand. One of the ways that enable this task is the use of energy storage systems. The article focuses on the analysis of the cost-effectiveness of energy storage from the grid. In particular, the technology was evaluated using underground hydrogen storage generated in electrolysers. Economic analyzes use historical data from the Polish energy market. The obtained results illustrate, among other things, the proportions between the main technology modules selected optimally in technical and economic terms.

scholarly journals Optimization of Network Carbon Capture and Storage System (CCS) Using Mathematical Approach

2015 ◽  
Vol 9 (7) ◽  
pp. 161
Author(s):  
David Licindo ◽  
Arinne Christin Paramudita ◽  
Renanto Handogo ◽  
Juwari Purwo Sutikno
Keyword(s):  
Carbon Capture ◽  
Storage System ◽  
Carbon Capture And Storage ◽  
Exact Result ◽  
Maximum Load ◽  
Mathematical Approach ◽  
Source To Sink ◽  
Storage Location ◽  
The Cost ◽  
And Storage

Carbon capture and storage (CCS) is one of the technologies to reduce greenhouse gas emissions (GHG) tocapture of CO2 from the flue gas of a power plant that typically use coal as a Source of energy and then store it ina suitable geological storage (in specific locations). In practice, these sites may not be readily available forstorage at the same time that the Sources (GHG producing) are operating which gives rise to multi – periodplanning problems. This study presents a mathematical approach by considering constraints limit flowratereceived by Sink, various time availability of Sink and Source and calculation with the purpose to determine theminimum cost network which is getting the maximum load that is exchanged from Source to Sink. Illustrativecase studies are given to demonstrate the application of mathematical models to obtained with the exact result ofthe exchange network from Source to Sink. Derived from network obtained from the calculation of theMaximum Load Source to Sink and results may vary in accordance with the limitations that exist in themathematical model. The case study has been prepared with 2 cases, first 6 Source and 3 Sink with value ofSource Load is greater than the amount available on the Sink. Also, second case is 2 Source and 5 Sinkwithvalue of Source Load is smaller than the amount available on the Sink. In addition, Case Studies tominimize the cost of pipeline construction and distribution of CO2 by plant and storage location determination inJava. Flowrate restriction factor that goes into Sink, Source and Sink establishment time and cost are taken intoaccount can affect the networks that can be exchanged from the Source to the Sink.

Lightweight Dynamic Redundancy Control with Adaptive Encoding for Server-based Storage

2021 ◽  
Vol 17 (4) ◽  
pp. 1-38
Author(s):  
Takayuki Fukatani ◽  
Hieu Hanh Le ◽  
Haruo Yokota
Keyword(s):  
Low Cost ◽  
Storage System ◽  
Erasure Coding ◽  
Performance Impact ◽  
Data Redundancy ◽  
Performance Improvements ◽  
Redundant Data ◽  
Redundancy Control ◽  
User Data ◽  
Capacity Efficiency

With the recent performance improvements in commodity hardware, low-cost commodity server-based storage has become a practical alternative to dedicated-storage appliances. Because of the high failure rate of commodity servers, data redundancy across multiple servers is required in a server-based storage system. However, the extra storage capacity for this redundancy significantly increases the system cost. Although erasure coding (EC) is a promising method to reduce the amount of redundant data, it requires distributing and encoding data among servers. There remains a need to reduce the performance impact of these processes involving much network traffic and processing overhead. Especially, the performance impact becomes significant for random-intensive applications. In this article, we propose a new lightweight redundancy control for server-based storage. Our proposed method uses a new local filesystem-based approach that avoids distributing data by adding data redundancy to locally stored user data. Our method switches the redundancy method of user data between replication and EC according to workloads to improve capacity efficiency while achieving higher performance. Our experiments show up to 230% better online-transaction-processing performance for our method compared with CephFS, a widely used alternative system. We also confirmed that our proposed method prevents unexpected performance degradation while achieving better capacity efficiency.

scholarly journals The ATLAS EventIndex for LHC Run 3

2020 ◽  
Vol 245 ◽  
pp. 04017
Author(s):  
Dario Barberis ◽  
Igor Aleksandrov ◽  
Evgeny Alexandrov ◽  
Zbigniew Baranowski ◽  
Gancho Dimitrov ◽  
...  
Keyword(s):  
Event Detection ◽  
Storage System ◽  
Data Access ◽  
Use Cases ◽  
Production Rates ◽  
Global Event ◽  
Storage Service ◽  
Data Ingestion ◽  
Core Storage ◽  
Metadata Integration

The ATLAS EventIndex was designed in 2012-2013 to provide a global event catalogue and limited event-level metadata for ATLAS analysis groups and users during the LHC Run 2 (2015-2018). It provides a good and reliable service for the initial use cases (mainly event picking) and several additional ones, such as production consistency checks, duplicate event detection and measurements of the overlaps of trigger chains and derivation datasets. The LHC Run 3, starting in 2021, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This proceeding describes the implementation of a new core storage service that will be able to provide at least the same functionality as the current one for increased data ingestion and search rates, and with increasing volumes of stored data. It is based on a set of HBase tables, with schemas derived from the current Oracle implementation, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, allowing to re-use most of the existing code for metadata integration.

scholarly journals Coordinated Control of Interconnected Microgrid and Energy Storage System

2018 ◽  
Vol 8 (6) ◽  
pp. 4781
Author(s):  
Md. Asaduz-Zaman ◽  
Md. Habibur Rahaman ◽  
Md. Selim Reza ◽  
Md. Mafizul Islam
Keyword(s):  
Energy Storage ◽  
Storage System ◽  
Energy Storage System ◽  
Frequency Regulation ◽  
Spinning Reserve ◽  
Island Area ◽  
Load Demand ◽  
Loading Constraints ◽  
Power Frequency ◽  
The Cost

Several microgrids can be interconnected together to enhance the grid reliability and reduce the cost of supplying power to an island area where conventional power grid cannot be connected. Source and load demand do not properly balance always. Besides that, sometimes power and frequency fluctuation has occurred in MG at island mode. Need to design a special control for maintaining the state of charge (SoC) of energy storage system. This paper proposes a new power supply system for an island area that interconnects two microgrids with a single energy storage system (ESS). An algorithm has been proposed that control the microgrids energy storage system for spinning reserve and load power/frequency regulation purpose. The minimum loading constraints of diesel engine generator (DEG) is considered and the SOC of the ESS is properly maintained.

System Dynamics and Disk Drive Head Position Error Prediction in a Data Storage Box

2014 ◽  
Author(s):  
Lidu Huang ◽  
Chiao-ping Roger Ku ◽  
Jean O’Young ◽  
Toshiki Hirano
Keyword(s):  
Data Storage ◽  
Storage System ◽  
Disk Drive ◽  
Head Position ◽  
Position Error ◽  
System Level ◽  
Disk Drives ◽  
Data Storage System ◽  
Mechanical Disturbances ◽  
System Transfer Function

Disk drives are packed at ever dense arrangement in a modern data storage system, internal and external mechanical disturbances can have a great effect to disk drive’s read and write performances. The VCM torque generated during seeking affects its own as well as neighboring drives head position. In this study, we modeled a storage box with multiple HDDs installed to obtain mechanical system transfer function. The mechanical excitation is characterized by VCM torque, and HDD operational vibration behaviors on linear and rotational shakers are measured. A system level hybrid method predicting HDD head position error in a data storage box is described, and both analytical and measured results will be presented.

Scanning probe-type data storage beyond hard disk drive and flash memory

MRS Bulletin ◽  
2018 ◽  
Vol 43 (5) ◽  
pp. 365-370 ◽  
Author(s):  
Yasuo Cho ◽  
Seungbum Hong
Keyword(s):  
Hard Disk Drive ◽  
Data Storage ◽  
Flash Memory ◽  
Hard Disk ◽  
Disk Drive ◽  
Scanning Probe ◽  
Probe Type ◽  
Type Data ◽  
Image Position

Abstract

PENDAMPINGAN PENGELOLAAN REKAM MEDIS DAN INFORMASI KESEHATAN DI PUSKESMAS CIBEUREUM KOTA TASIMALAYA TAHUN 2021

2021 ◽  
Vol 1 (1) ◽  
Author(s):  
Idasugiarti ◽  
Arief Tarmansyah Iman ◽  
Fadil Ahmad Junaedi
Keyword(s):  
Public Health ◽  
Health Center ◽  
Community Service ◽  
Medical Records ◽  
Storage System ◽  
Health Policies ◽  
Data Migration ◽  
Public Health Center ◽  
The Public ◽  
The Family

Management of medical records and health information is one of the elements in the assessment of Public Health Center accreditation. Medical records play an important role in collecting accurate and comprehensive data for targeted health policies. The most appropriate management of medical records at the Public Health Center is the regional storage system or often referred to as the family folder system. Community service activities at the Cibeureum Health Center are carried out using consultation, training, and mentoring methods. Compiled 10 quality documents and the implementation of the e-family folder in stages. Furthermore, continuous data migration was carried out assisted by RMIK students. Activities carried out well.

Sign in / Sign up

Export Citation Format

Share Document