scholarly journals Random access DNA memory in a scalable, archival file storage system

2020 ◽  
Author(s):  
James L. Banal ◽  
Tyson R. Shepherd ◽  
Joseph Berleant ◽  
Hellen Huang ◽  
Miguel Reyes ◽  
...  
Keyword(s):  
Data Storage ◽  
Storage System ◽  
Random Access ◽  
Boolean Logic ◽  
Direct Selection ◽  
Optical Channels ◽  
Data Encoding ◽  
File Storage ◽  
Selection Of

ABSTRACTDNA is an ultra-high-density storage medium that could meet exponentially growing worldwide demand for archival data storage if DNA synthesis costs declined sufficiently and random access of files within exabyte-to-yottabyte-scale DNA data pools were feasible. To overcome the second barrier, here we encapsulate data-encoding DNA file sequences within impervious silica capsules that are surface-labeled with single-stranded DNA barcodes. Barcodes are chosen to represent file metadata, enabling efficient and direct selection of sets of files with Boolean logic. We demonstrate random access of image files from an image database using fluorescence sorting with selection sensitivity of 1 in 106 files, which thereby enables 1 in 106N per N optical channels. Our strategy thereby offers retrieval of random file subsets from exabyte and larger-scale long-term DNA file storage databases, offering a scalable solution for random-access of archival files in massive molecular datasets.

Research and Design of the Distributed Mass Small File Storage System Based on WCF

2013 ◽  
Vol 765-767 ◽  
pp. 1087-1091
Author(s):  
Hong Lin ◽  
Shou Gang Chen ◽  
Bao Hui Wang
Keyword(s):  
Fault Tolerance ◽  
Distributed Computing ◽  
Data Storage ◽  
Large Scale ◽  
Storage System ◽  
Hardware Platform ◽  
File Storage ◽  
Computing Framework ◽  
Research And Design ◽  
Small File

Recently, with the development of Internet and the coming of new application modes, data storage has some new characters and new requirements. In this paper, a Distributed Computing Framework Mass Small File storage System (For short:Dnet FS) based on Windows Communication Foundation in .Net platform is presented, which is lightweight, good-expansibility, running in cheap hardware platform, supporting Large-scale concurrent access, and having certain fault-tolerance. The framework of this system is analyzed and the performance of this system is tested and compared. All of these prove this system meet requirements.

Development and Evaluation of Local Area Network Based Archiving System

2021 ◽  
Vol 5 (2) ◽  
pp. 286-296
Author(s):  
Reymon M Santiañez ◽  
Benedict M Sollano
Keyword(s):  
Data Storage ◽  
Local Area Network ◽  
Storage System ◽  
Local Area ◽  
Information Storage ◽  
Area Network ◽  
Efficient Operation ◽  
File Storage ◽  
Electronic File ◽  
Work Cycle

The goal of this study was to create the Local Area Network Based Archiving System, a cross-platform development system for electronic information storage, security, preservation, and retention. The system incorporates capabilities such as data storage for long-term preservation and retrieval, file searching and retrieval, security features such as user account information system and account access privilege levels, and an email-like messaging system. The researchers developed the Local Area Network Based Archiving System using the Agile Software Development Methodology to keep up with the stakeholders' ever-changing needs. After each iteration of the work cycle, this methodology employs a process of frequent feedback. Features are added or refined in each iteration to ensure that the study meets its goals and expectations. The developed system received an overall average weighted mean of 4.53 in the evaluation summary, which is considered excellent. The strongest point of the system, according to the respondents' responses, was its content, which received the highest average mean among the five major categories in the system evaluation. The system's mobile responsiveness was a huge plus, as it considerably aided accessibility. The system should also be deployed, according to the respondents, because it will provide a powerful answer to the ongoing challenges with storing, managing, securing, and retrieving electronic files. As a result, the researchers concluded that a Local Area Network Based Archiving System is required for the efficient operation of an electronic  file storage system. Having centralized electronic file storage and retrieval system not only saves time and money in the long run but also allows for disaster recovery and business continuity.

scholarly journals A Self-contained and Self-explanatory DNA Storage System

2021 ◽  
Author(s):  
Min Li ◽  
Junbiao Dai ◽  
Qingshan Jiang ◽  
Yang Wang
Keyword(s):  
Data Storage ◽  
Storage System ◽  
Data File ◽  
Data Redundancy ◽  
Dna Storage ◽  
Data Restoration ◽  
Gene Data ◽  
High Uncertainty ◽  
Term Data

Abstract Current research on DNA storage usually focuses on the improvement of storage density with reduced gene synthesis cost by developing effective encoding and decoding schemes while lacking the consideration on the uncertainty in ultra long-term data storage and retention. Consequently, the current DNA storage systems are often not self-containment, implying that they have to resort to external tools for the restoration of the stored gene data. This may result in high risks in data loss since the required tools might not be available due to the high uncertainty in far future. To address this issue, we propose in this paper a self-contained DNA storage system that can make self-explanatory to its stored data without relying on any external tools. To this end, we design a specific DNA file format whereby a separate storage scheme is developed to reduce the data redundancy while an effective indexing is designed for random read operations to the stored data file. We verified through experimental data that the proposed self-contained and self-explanatory method can not only get rid of the reliance on external tools for data restoration but also minimize the data redundancy brought about when the amount of data to be stored reaches a certain scale.

Evaluation of a Model-driven Knowledge Storage and Retrieval IDE for Interactive HRI Systems

2019 ◽  
Vol 13 (02) ◽  
pp. 207-227 ◽  
Author(s):  
Norman Köster ◽  
Sebastian Wrede ◽  
Philipp Cimiano
Keyword(s):  
Data Storage ◽  
User Study ◽  
Query Language ◽  
Storage System ◽  
Human Robot Interaction ◽  
Storage And Retrieval ◽  
Model Driven ◽  
Long Term Storage ◽  
Model Driven Software Development

Efficient storage and querying of long-term human–robot interaction data requires application developers to have an in-depth understanding of the involved domains. Creating syntactically and semantically correct queries in the development process is an error prone task which can immensely impact the interaction experience of humans with robots and artificial agents. To address this issue, we present and evaluate a model-driven software development approach to create a long-term storage system to be used in highly interactive HRI scenarios. We created multiple domain-specific languages that allow us to model the domain and seamlessly embed its concepts into a query language. Along with corresponding model-to-model and model-to-text transformations, we generate a fully integrated workbench facilitating data storage and retrieval. It supports developers in the query design process and allows in-tool query execution without the need to have prior in-depth knowledge of the domain. We evaluated our work in an extensive user study and can show that the generated tool yields multiple advantages compared to the usual query design approach.

Geo-Location-Based File Security System for Healthcare Data

2018 ◽  
pp. 125-135
Author(s):  
Govinda K.
Keyword(s):  
Data Storage ◽  
Credit Card ◽  
Medical Information ◽  
Storage Systems ◽  
Storage System ◽  
Security System ◽  
Sensitive Data ◽  
Healthcare Data ◽  
File Storage ◽  
Cryptographic Techniques

Nowadays, a person's medical information is just as important as their financial records as they may include not only names and addresses but also various sensitive data such as their employee details, bank account/credit card information, insurance details, etc. However, this fact is often overlooked when designing a file storage system for storing healthcare data. Storage systems are increasingly subject to attacks, so the security system is quickly becoming a mandatory feature of the data storage systems. For the purpose of security, we are dependent on various methods such as cryptographic techniques, two-step verification, and even biometric scanners. This chapter provides a mechanism to create a secure file storage system that provides two-layer security. The first layer is in the form of a password, through which the file is encrypted at the time of storage, and second is the locations at which the user wants the files to be accessed. Thus, this system would allow a user to access a file only at the locations specified by him/her. Therefore, the objective is to create a system that provides secure file storage based on geo-location information.

scholarly journals Diverse Mobile System for Location-Based Mobile Data

2018 ◽  
Vol 2018 ◽  
pp. 1-17
Author(s):  
Qing Liao ◽  
Haoyu Tan ◽  
Wuman Luo ◽  
Ye Ding
Keyword(s):  
Data Storage ◽  
Storage System ◽  
Location Based Services ◽  
Storage Space ◽  
Processing Efficiency ◽  
Mobile Data ◽  
Data Encoding ◽  
Research Fields ◽  
Trade Offs ◽  
The Cost

The value of large amount of location-based mobile data has received wide attention in many research fields including human behavior analysis, urban transportation planning, and various location-based services. Nowadays, both scientific and industrial communities are encouraged to collect as much location-based mobile data as possible, which brings two challenges: (1) how to efficiently process the queries of big location-based mobile data and (2) how to reduce the cost of storage services, because it is too expensive to store several exact data replicas for fault-tolerance. So far, several dedicated storage systems have been proposed to address these issues. However, they do not work well when the ranges of queries vary widely. In this work, we design a storage system based on diverse replica scheme which not only can improve the query processing efficiency but also can reduce the cost of storage space. To the best of our knowledge, this is the first work to investigate the data storage and processing in the context of big location-based mobile data. Specifically, we conduct in-depth theoretical and empirical analysis of the trade-offs between different spatial-temporal partitioning and data encoding schemes. Moreover, we propose an effective approach to select an appropriate set of diverse replicas, which is optimized for the expected query loads while conforming to the given storage space budget. The experiment results show that using diverse replicas can significantly improve the overall query performance and the proposed algorithms for the replica selection problem are both effective and efficient.

High End Inspection by Filmless Radiography on LSAW Large Diameter Pipes From EUROPIPE

2008 ◽  
Author(s):  
Thomas Kersting ◽  
Andreas Liessem ◽  
Ludwig Oesterlein ◽  
Stefan Schuster ◽  
Norbert Schoenartz
Keyword(s):  
Data Storage ◽  
Weld Seam ◽  
Computer Network ◽  
Storage System ◽  
Large Diameter ◽  
Third Party ◽  
Release Process ◽  
X Ray ◽  
Large Diameter Pipes

Pipes for transportation of combustible media are subject to the most severe safety requirements. In order to guarantee best performance during construction and long term services the level of quality and the productivity are continuously increased. After many years of experience with the Filmless-Radiography (FLORAD) for internal process control (detection of typical weld seam defects like slag and pores), EUROPIPE has eventually invested in the digital X-ray inspection technology for the final release. Therewith the classic X-ray film has been replaced, the environmental impact due to chemicals reduced and the complete NDT process enhanced. By the availability of safe digital images via computer network it became in addition much easier for third party inspectors to monitor the release process. Furthermore the use of a professional data storage system guarantees a safe and traceable long term archival storage with a quick access to all data within minutes. The new installation consists of two separate X-ray chambers. In each chamber two digital detector arrays (DDA) and two X-ray tubes are installed to inspect the weld seam at the pipe ends and areas having indications from the automated ultrasonic testing. EUROPIPE is the first company which has implemented this technology in a highly automated serial production of large diameter pipes.

scholarly journals A self-contained and self-explanatory DNA storage system

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Min Li ◽  
Jiashu Wu ◽  
Junbiao Dai ◽  
Qingshan Jiang ◽  
Qiang Qu ◽  
...  
Keyword(s):  
Data Storage ◽  
Storage System ◽  
Data File ◽  
Data Redundancy ◽  
Dna Storage ◽  
Data Restoration ◽  
High Uncertainty ◽  
Term Data ◽  
Far Future

AbstractCurrent research on DNA storage usually focuses on the improvement of storage density by developing effective encoding and decoding schemes while lacking the consideration on the uncertainty in ultra-long-term data storage and retention. Consequently, the current DNA storage systems are often not self-contained, implying that they have to resort to external tools for the restoration of the stored DNA data. This may result in high risks in data loss since the required tools might not be available due to the high uncertainty in far future. To address this issue, we propose in this paper a self-contained DNA storage system that can bring self-explanatory to its stored data without relying on any external tool. To this end, we design a specific DNA file format whereby a separate storage scheme is developed to reduce the data redundancy while an effective indexing is designed for random read operations to the stored data file. We verified through experimental data that the proposed self-contained and self-explanatory method can not only get rid of the reliance on external tools for data restoration but also minimise the data redundancy brought about when the amount of data to be stored reaches a certain scale.

scholarly journals On Models and Capacity Bounds for DNA-based Storage Channels

2021 ◽  
Author(s):  
Zihui Yan ◽  
Cong Liang
Keyword(s):  
Data Storage ◽  
Storage System ◽  
Synchronization Error ◽  
Dna Molecules ◽  
Capacity Limits ◽  
Dna Storage ◽  
Capacity Bounds ◽  
Dna Strands ◽  
Term Data

In recent years, DNA-based systems have become a promising medium for long-term data storage. There are two layers of errors in DNA-based storage systems. The first is the dropouts of the DNA strands, which has been characterized in the shuffling-sampling channel. The second is insertions, deletions, and substitutions of nucleotides in individual DNA molecules. In this paper, we describe a DNA noisy synchronization error channel to characterize the errors in individual DNA molecules. We derive non-trivial lower and upper capacity bounds of the DNA noisy synchronization error channel based on information theory. By cascading these two channels, we provide theoretical capacity limits of the DNA storage system. These results reaffirm that DNA is a reliable storage medium with high storage density potential.

scholarly journals Blockchain-Based Secure Data Storage for Distributed Vehicular Networks

2020 ◽  
Vol 10 (6) ◽  
pp. 2011 ◽  
Author(s):  
Muhammad Umar Javed ◽  
Mubariz Rehman ◽  
Nadeem Javaid ◽  
Abdulaziz Aldegheishem ◽  
Nabil Alrajeh ◽  
...  
Keyword(s):  
Data Storage ◽  
Trust Management ◽  
Vehicular Networks ◽  
Service Providers ◽  
Storage System ◽  
Security And Privacy ◽  
Service Provisioning ◽  
Smart Vehicles ◽  
File Storage ◽  
Secure Data

In this paper, a blockchain-based secure data sharing mechanism is proposed for Vehicular Networks (VNs). Edge service providers are introduced along with ordinary nodes to efficiently manage service provisioning. The edge service providers are placed in the neighborhood of the ordinary nodes to ensure smooth communication between them. The huge amount of data generated by smart vehicles is stored in a distributed file storage system, known as Interplanetary File System (IPFS). It is used to tackle the issues related to data storage in centralized architectures, such as data tampering, lack of privacy, vulnerability to hackers, etc. Monetary incentives are given to edge vehicle nodes to motivate them for accurate and timely service provisioning to ordinary nodes. In response, ordinary nodes give reviews to the edge nodes against the services provided by them, which are further stored in a blockchain to ensure integrity, security and transparency. Smart contracts are used to automate the system processes without the inclusion of an intermediate party and to check the reviews given to the edge nodes. To optimize gas consumption and to enhance the system performance, a Proof of Authority (PoA) consensus mechanism is used to validate the transactions. Moreover, a caching system is introduced at the edge nodes to store frequently used services. Furthermore, both security and privacy are enhanced in the proposed system by incorporating a symmetric key cryptographic mechanism. A trust management mechanism is also proposed in this work to calculate the nodes’ reputation values based upon their trust values. These values determine the authenticity of the nodes involved in the network. Eventually, it is concluded from the simulation results that the proposed system is efficient for VNs.

Sign in / Sign up

Export Citation Format

Share Document