scholarly journals Enabling High Data Throughput in Desktop Grids through Decentralized Data and Metadata Management: The BlobSeer Approach

2009 ◽  
pp. 404-416 ◽  
Author(s):  
Bogdan Nicolae ◽  
Gabriel Antoniu ◽  
Luc Bougé
Keyword(s):  
Metadata Management ◽  
Desktop Grids ◽  
High Data ◽  
Data Throughput

scholarly journals Log-Less Metadata Management on Metadata Server for Parallel File Systems

2014 ◽  
Vol 2014 ◽  
pp. 1-8
Author(s):  
Jianwei Liao ◽  
Guoqiang Xiao ◽  
Xiaoning Peng
Keyword(s):  
Performance Improvement ◽  
File System ◽  
File Systems ◽  
Metadata Management ◽  
Distributed File Systems ◽  
Data Throughput ◽  
Management Schemes ◽  
Metadata Processing ◽  
Metadata Server ◽  
Metadata Service

This paper presents a novel metadata management mechanism on the metadata server (MDS) for parallel and distributed file systems. In this technique, the client file system backs up the sent metadata requests, which have been handled by the metadata server, so that the MDS does not need to log metadata changes to nonvolatile storage for achieving highly available metadata service, as well as better performance improvement in metadata processing. As the client file system backs up certain sent metadata requests in its memory, the overhead for handling these backup requests is much smaller than that brought by the metadata server, while it adopts logging or journaling to yield highly available metadata service. The experimental results show that this newly proposed mechanism can significantly improve the speed of metadata processing and render a better I/O data throughput, in contrast to conventional metadata management schemes, that is, logging or journaling on MDS. Besides, a complete metadata recovery can be achieved by replaying the backup logs cached by all involved clients, when the metadata server has crashed or gone into nonoperational state exceptionally.

scholarly journals Optical Camera Communications for IoT–Rolling-Shutter Based MIMO Scheme with Grouped LED Array Transmitter

Sensors ◽  
2020 ◽  
Vol 20 (12) ◽  
pp. 3361 ◽  
Author(s):  
Shivani Rajendra Teli ◽  
Vicente Matus ◽  
Stanislav Zvanovec ◽  
Rafael Perez-Jimenez ◽  
Stanislav Vitek ◽  
...  
Keyword(s):  
Signal To Noise Ratio ◽  
Light Emitting Diode ◽  
Multiple Input Multiple Output ◽  
Raspberry Pi ◽  
High Data ◽  
Data Throughput ◽  
Data Rates ◽  
Led Array ◽  
Communication Links ◽  
Input Multiple Output

In optical camera communications (OCC), the provision of both flicker-free illumination and high data rates are challenging issues, which can be addressed by utilizing the rolling-shutter (RS) property of the image sensors as the receiver (Rx). In this paper, we propose an RS-based multiple-input multiple-output OCC scheme for the Internet of things (IoT) application. A simplified design of multi-channel transmitter (Tx) using a 7.2 × 7.2 cm2 small 8 × 8 distributed light emitting diode (LED) array, based on grouping of LEDs, is proposed for flicker-free transmission. We carry out an experimental investigation of the indoor OCC system by employing a Raspberry Pi camera as the Rx, with RS capturing mode. Despite the small area of the display, flicker-free communication links within the range of 20–100 cm are established with data throughput of 960 to 120 bps sufficient for IoT. A method to extend link spans up to 1.8 m and the data throughput to 13.44 kbps using different configurations of multi-channel Tx is provided. The peak signal-to-noise ratio of ~14 and 16 dB and the rate of successfully received bits of 99.4 and 81% are measured for the shutter speeds of 200 and 800 µs for a link span of 1 m, respectively.

scholarly journals COTS based high data throughput acquisition system for a real-time reflectometry diagnostic

2010 ◽  
Author(s):  
J. Santos ◽  
M. Zilker ◽  
W. Treutterer ◽  
C. Amador ◽  
L. Guimarais ◽  
...  
Keyword(s):  
Real Time ◽  
Acquisition System ◽  
High Data ◽  
Data Throughput

scholarly journals Setup and commissioning of a high-throughput analysis cluster

2020 ◽  
Vol 245 ◽  
pp. 07007
Author(s):  
René Caspart ◽  
Max Fischer ◽  
Manuel Giffels ◽  
Ralf Florian von Cube ◽  
Christoph Heidecker ◽  
...  
Keyword(s):  
High Energy Physics ◽  
High Energy ◽  
High Throughput Analysis ◽  
High Data ◽  
Network Connection ◽  
Data Throughput ◽  
Tier 1 ◽  
Institute Of Technology ◽  
Local Storage ◽  
Energy Physics

Current and future end-user analyses and workflows in High Energy Physics demand the processing of growing amounts of data. This plays a major role when looking at the demands in the context of the High-Luminosity-LHC. In order to keep the processing time and turn-around cycles as low as possible analysis clusters optimized with respect to these demands can be used. Since hyper converged servers offer a good combination of compute power and local storage, they form the ideal basis for these clusters. In this contribution we report on the setup and commissioning of a dedicated analysis cluster setup at Karlsruhe Institute of Technology. This cluster was designed for use cases demanding high data-throughput. Based on hyper converged servers this cluster offers 500 job slots and 1 PB of local storage. Combined with the 100 Gb network connection between the servers and a 200 Gb uplink to the Tier-1 storage, the cluster can sustain a data-throughput of 1 PB per day. In addition, the local storage provided by the hyper converged worker nodes can be used as cache space. This allows employing of caching approaches on the cluster, thereby enabling a more efficient usage of the disk space. In previous contributions this concept has been shown to lead to an expected speedup of 2 to 4 compared to conventional setups.

High data throughput VCSELs

2010 ◽  
Author(s):  
J. A. Tatum ◽  
R. H. Johnson ◽  
J. K. Guenter ◽  
D. Gazula ◽  
G. Park ◽  
...  
Keyword(s):  
High Data ◽  
Data Throughput

scholarly journals FLIPR: A New Instrument for Accurate, High Throughput Optical Screening

1996 ◽  
Vol 1 (2) ◽  
pp. 75-80 ◽  
Author(s):  
Kirk S. Schroeder ◽  
Brad D. Neagle
Keyword(s):  
Integrated Design ◽  
Fluorescent Imaging ◽  
Imaging Plate ◽  
High Data ◽  
Fluid Handling ◽  
Data Throughput ◽  
New Instrument ◽  
Plate Reader ◽  
Data Fidelity ◽  
Screening Assays

Modern optical screening assays demand high data throughput along with uncompromised data fidelity. FLIPR (Fluorescent Imaging Plate Reader) was developed to perform quantitative optical screening for cell-based kinetic assays. FLIPR incorporates an integrated design, including low-level optical detection, precise temperature control, and precise fluid handling, all in one package. The unique aspect of FLIPR is that all 96 wells of a standard microplate are stimulated and optically measured simultaneously. Kinetic updates on all 96 wells can be obtained in under 1 sec, allowing for transient signals to be quantified. Demonstrated applications include measurements of intracellular calcium, intracellular pH, and membrane potential.

Sign in / Sign up

Export Citation Format

Share Document