RADAR: Runtime Asymmetric Data-Access Driven Scientific Data Replication

XRootd, disk-based, caching proxy for optimization of data access, data placement and data replication

Journal of Physics Conference Series ◽

10.1088/1742-6596/513/4/042044 ◽

2014 ◽

Vol 513 (4) ◽

pp. 042044 ◽

Cited By ~ 12

Author(s):

L A T Bauerdick ◽

K Bloom ◽

B Bockelman ◽

D C Bradley ◽

S Dasu ◽

...

Keyword(s):

Data Replication ◽

Data Access ◽

Data Placement ◽

Caching Proxy ◽

Access Data

Download Full-text

Consistency of Replicated Datasets in Grid Computing

Handbook of Research on Grid Technologies and Utility Computing ◽

10.4018/978-1-60566-184-1.ch006 ◽

2009 ◽

pp. 49-58

Author(s):

Gianni Pucciani ◽

Flavia Donno ◽

Andrea Domenici ◽

Heinz Stockinger

Keyword(s):

Distributed Systems ◽

Fault Tolerance ◽

Grid Computing ◽

Data Management ◽

Data Replication ◽

Data Access ◽

Grid Middleware ◽

Pros And Cons ◽

Consistency Problem ◽

Replica Consistency

Data replication is a well-known technique used in distributed systems in order to improve fault tolerance and make data access faster. Several copies of a dataset are created and placed at different nodes, so that users can access the replica closest to them, and at the same time the data access load is distributed among the replicas. In today’s Grid middleware solutions, data management services allow users to replicate datasets (i.e., flat files or databases) among storage elements within a Grid, but replicas are often considered read-only because of the absence of mechanisms able to propagate updates and enforce replica consistency. This entry analyzes the replica consistency problem and provides hints for the development of a Replica Consistency Service, highlighting the main issues and pros and cons of several approaches.

Download Full-text

Data replication techniques in the mobile ad hoc networks

International Journal of Pervasive Computing and Communications ◽

10.1108/ijpcc-06-2019-0051 ◽

2019 ◽

Vol 15 (3/4) ◽

pp. 174-198

Author(s):

A. Abdollahi Nami ◽

L. Rajabion

Keyword(s):

Ad Hoc ◽

Data Replication ◽

Data Access ◽

Data Consistency ◽

Mobility Limitations ◽

Data Accessibility ◽

Content Type ◽

Advantages And Disadvantages ◽

Replica Allocation ◽

The Future

Purpose A mobile ad hoc network (MANET) enables providers and customers to communicate without a fixed infrastructure. Databases are extended on MANETs to have easy data access and update. As the energy and mobility limitations of both servers and clients affect the availability of data in MANETs, these data are replicated. The purpose of this paper is to provide a literature review of data replication issues and classify the available strategies based on the issues they addressed. Design/methodology/approach The selected articles are reviewed based on the defined criteria. Also, the differences, the advantages and disadvantages of these techniques are described. The methods in the literature can be categorized into three groups, including cluster-based, location-based and group-based mechanisms. Findings High flexibility and data consistency are the features of cluster-based mechanisms. The location-based mechanisms are also appropriate for replica allocation, and they mostly have low network traffic and delay. Also, the group-based mechanism has high data accessibility compared to other mechanisms. Data accessibility and time have got more attention to data replication techniques. Scalability as an important parameter must be considered more in the future. The reduction of storage cost in MANETs is the main goal of data replication. Researchers have to consider the cost parameter when another parameter will be influenced. Research limitations/implications Data replication in MANETs has been covered in different available sources such as Web pages, technical reports, academic publications and editorial notes. The articles published in national journals and conferences are ignored in this study. This study includes articles from academic main international journals to get the best capability. Originality/value The paper reviews the past and the state-of-the-art mechanisms in data replication in MANET. Exclusively, data replication’s main goal, existing challenges, research terminologies and mechanisms in MANET are summarized using the answers to the research questions. This method will help researchers in the future to develop more effective data replication method in MANET.

Download Full-text

A Virtual Dataspaces Model for large-scale materials scientific data access

Future Generation Computer Systems ◽

10.1016/j.future.2015.05.004 ◽

2016 ◽

Vol 54 ◽

pp. 456-468 ◽

Cited By ~ 7

Author(s):

Changjun Hu ◽

Yang Li ◽

Xin Cheng ◽

Zhenyu Liu

Keyword(s):

Large Scale ◽

Data Access ◽

Scientific Data

Download Full-text

Migration Performance for Legacy Data Access

International Journal of Digital Curation ◽

10.2218/ijdc.v3i2.59 ◽

2008 ◽

Vol 3 (2) ◽

pp. 74-88 ◽

Cited By ~ 3

Author(s):

Kam Woods ◽

Geoffrey Brown

Keyword(s):

Floppy Disk ◽

Data Access ◽

The United States ◽

Scientific Data ◽

United States Government ◽

Government Printing ◽

Document Collections ◽

Cd Rom ◽

Depth Analysis ◽

File Migration

We present performance data relating to the use of migration in a system we are creating to provide web access to heterogeneous document collections in legacy formats. Our goal is to enable sustained access to collections such as these when faced with increasing obsolescence of the necessary supporting applications and operating systems. Our system allows searching and browsing of the original files within their original contexts utilizing binary images of the original media. The system uses static and dynamic file migration to enhance collection browsing, and emulation to support both the use of legacy programs to access data and long-term preservation of the migration software. While we provide an overview of the architectural issues in building such a system, the focus of this paper is an in-depth analysis of file migration using data gathered from testing our software on 1,885 CD-ROMs and DVDs. These media are among the thousands of collections of social and scientific data distributed by the United States Government Printing Office (GPO) on legacy media (CD-ROM, DVD, floppy disk) under the Federal Depository Library Program (FDLP) over the past 20 years.

Download Full-text

Blockchain Technology Changing Traditional Methods of Applied Research in Bioinformatics

Research Anthology on Blockchain Technology in Business, Healthcare, Education, and Government ◽

10.4018/978-1-7998-5351-0.ch098 ◽

2021 ◽

pp. 1813-1822

Author(s):

Natalia Rasskazova ◽

Liudmila Ratushnaia

Keyword(s):

Research Methods ◽

Applied Research ◽

Data Access ◽

Scientific Data ◽

Traditional Methods ◽

Blockchain Technology ◽

Traditional Research ◽

Search For Information ◽

New Research ◽

The Cost

It is evident that traditional research methods are going to change. The research should be based on the possibility of quick access to information, interactivity and interaction of participants in search for information, elimination of temporal and spatial obstacles. Everything mentioned above requires the use of new research technologies, including blockchain technology. This technology allows solving the problems of collection and systematization of scientific data, access to it within the framework of project operation and implementation at any organization, and joint efforts of various structures. Data saved in blocks and stored on different servers can be accessed by different users. It reduces the cost of coordinating the actions of different users who want to obtain certain information. This article explores how blockchain technology is changing traditional methods of applied research in bioinformatics.

Download Full-text

Scientific data from and for the citizen

First Monday ◽

10.5210/fm.v22i8.7842 ◽

2017 ◽

Cited By ~ 4

Author(s):

Sven Schade ◽

Chrisa Tsinaraki ◽

Elena Roglia

Keyword(s):

Citizen Science ◽

Mobile Phones ◽

Low Cost ◽

Data Access ◽

General Information ◽

Scientific Data ◽

Research Topic ◽

Data Preservation ◽

Science Projects ◽

Wide Range

Powered by advances of technology, today’s Citizen Science projects cover a wide range of thematic areas and are carried out from local to global levels. This wealth of activities creates an abundance of data, for example, in the forms of observations submitted by mobile phones; readings of low-cost sensors; or more general information about peoples’ activities. The management and possible sharing of this data has become a research topic in its own right. We conducted a survey in the summer of 2015 in order to collectively analyze the state of play in Citizen Science. This paper summarizes our main findings related to data access, standardization and data preservation. We provide examples of good practices in each of these areas and outline actions to address identified challenges.

Download Full-text