Transparent Avoidance of Redundant Data Transfer on GPU-enabled Apache Spark

2018 ◽  
Author(s):  
Ryo Asai ◽  
Masao Okita ◽  
Fumihiko Ino ◽  
Kenichi Hagihara
Keyword(s):  
Data Transfer ◽  
Apache Spark ◽  
Redundant Data

scholarly journals An Edge-Fog Secure Self-Authenticable Data Transfer Protocol

Sensors ◽  
2019 ◽  
Vol 19 (16) ◽  
pp. 3612 ◽  
Author(s):  
Algimantas Venčkauskas ◽  
Nerijus Morkevicius ◽  
Vaidas Jukavičius ◽  
Robertas Damaševičius ◽  
Jevgenijus Toldinas ◽  
...  
Keyword(s):  
Data Transfer ◽  
Fog Computing ◽  
Transport Layer ◽  
Area Network ◽  
Lossy Networks ◽  
Redundant Data ◽  
Computing Paradigm ◽  
User Data ◽  
Constrained Devices ◽  
Transfer Protocol

Development of the Internet of Things (IoT) opens many new challenges. As IoT devices are getting smaller and smaller, the problems of so-called “constrained devices” arise. The traditional Internet protocols are not very well suited for constrained devices comprising localized network nodes with tens of devices primarily communicating with each other (e.g., various sensors in Body Area Network communicating with each other). These devices have very limited memory, processing, and power resources, so traditional security protocols and architectures also do not fit well. To address these challenges the Fog computing paradigm is used in which all constrained devices, or Edge nodes, primarily communicate only with less-constrained Fog node device, which collects all data, processes it and communicates with the outside world. We present a new lightweight secure self-authenticable transfer protocol (SSATP) for communications between Edge nodes and Fog nodes. The primary target of the proposed protocol is to use it as a secure transport for CoAP (Constrained Application Protocol) in place of UDP (User Datagram Protocol) and DTLS (Datagram Transport Layer Security), which are traditional choices in this scenario. SSATP uses modified header fields of standard UDP packets to transfer additional protocol handling and data flow management information as well as user data authentication information. The optional redundant data may be used to provide increased resistance to data losses when protocol is used in unreliable networks. The results of experiments presented in this paper show that SSATP is a better choice than UDP with DTLS in the cases, where the CoAP block transfer mode is used and/or in lossy networks.

scholarly journals Enhanced Event Coverage and Redundant Data Minimization Employing Pentagonal Scalar Premier Selection in Wireless Multimedia Sensor Networks (WMSNs)

2019 ◽  
Vol 8 (12S) ◽  
pp. 221-228
Keyword(s):  
Sensor Networks ◽  
Data Transfer ◽  
Experimental Studies ◽  
Wireless Multimedia Sensor Networks ◽  
Wireless Multimedia ◽  
Coverage Ratio ◽  
Multimedia Sensor Networks ◽  
Redundant Data ◽  
Event Information ◽  
Camera Sensors

In the modern era, data redundancy has become one among the predominant ultimatums encountered in Wireless Multimedia Sensor Networks (WMSNs), which occurs because of event information reporting through the scalars residing at the superimposing zones of field of views (FoVs) of multiple camera sensors. As a result, same data is transferred many times, thus leading to redundancy in data transfer. Therefore, the aim is to select the representatives of scalar sensors called scalar premiers (SPs) that can report the event information in lieu of all the scalars while diminishing the redundant data transfer and improving the event coverage. We have proffered a pentagonal scheme of SP selection that chooses five SPs in each of the virtual compartments of the monitored zone efficiently. The chosen SPs operate as nominee of scalars for event information transmittal. Extensive experiments have been accomplished to affirm the efficiency of our proffered method. We changed the number of cameras deployed (noc) and the number of scalars deployed (nos). The results attained from the experimental studies in terms of number of camera sensors activated (nca), coverage ratio (cr), redundancy ratio (rr), event loss ratio (elr) and energy expenditure for camera actuation (eeca) assert the superiority of our profferred approach over existing approaches.

scholarly journals Steganography using Spatial Domain Techniques

2019 ◽  
Vol 8 (4) ◽  
pp. 3369-3373
Keyword(s):  
Data Security ◽  
Data Transfer ◽  
Spatial Domain ◽  
Secret Message ◽  
Least Significant Bit ◽  
Secret Data ◽  
Stego Image ◽  
Hiding Capacity ◽  
Military Organization ◽  
Redundant Data

In present world data transfer using the internet is growing. It is very easy and fast way to transfer information like confidential documents, economic transactions, business applications and other covert information over internet. With the advent and growth of internet, people are more concerned about security of information. Data Security is important while data is transferred over internet because any illegal user can access important and private data also make it worthless. Research in data security area will help government agencies, military organization and private companies to securely transmit their confidential data over internet. From past few years various steganography techniques have been developed to hide secret message using various multimedia objects having large amount of redundant data to support steganography. In this paper introduction about steganography, related concepts and implementation of commonly used spatial domain techniques like LSB(Least Significant Bit Technique) with modulus, PVD(Pixel Value Difference) with LSB replacement and adaptive data hiding over edges with LSB are considered. It is observed(while visual, statistical analysis and experiments were carried out) with benchmark cover and stego objects that embedding same amount of secret data in each pixel leads to more visible distortions in a stego image because all pixels do not bear same amount of changes and this effect is more observed in smooth area then edges. Improving stego image imperceptibility and adjusting hiding capacity adaptively are major related research challenges about spatial domain techniques.

scholarly journals A Descriptive Algorithm for Sobel Image Edge Detection

10.28945/3351 ◽  
2009 ◽  
Author(s):  
Olufunke Vincent ◽  
Olusegun Folorunso
Keyword(s):  
Edge Detection ◽  
Data Transfer ◽  
Data Communication ◽  
Spatial Gradient ◽  
Data Set ◽  
Redundant Data ◽  
Sobel Operator ◽  
Image Edge Detection ◽  
Gradient Magnitude ◽  
Image Edge

Image edge detection is a process of locating the edge of an image which is important in finding the approximate absolute gradient magnitude at each point I of an input grayscale image. The problem of getting an appropriate absolute gradient magnitude for edges lies in the method used. The Sobel operator performs a 2-D spatial gradient measurement on images. Transferring a 2-D pixel array into statistically uncorrelated data set enhances the removal of redundant data, as a result, reduction of the amount of data is required to represent a digital image. The Sobel edge detector uses a pair of 3 x 3 convolution masks, one estimating gradient in the x-direction and the other estimating gradient in y-direction. The Sobel detector is incredibly sensitive to noise in pictures, it effectively highlight them as edges. Hence, Sobel operator is recommended in massive data communication found in data transfer.

SPECTRA: A program for processing electron images of crystals

1992 ◽  
Vol 50 (1) ◽  
pp. 132-133
Author(s):  
M.F. Schmid ◽  
R. Dargahi ◽  
M. W. Tam
Keyword(s):  
Lattice Distortion ◽  
Data Transfer ◽  
Reciprocal Lattice ◽  
Data Entry ◽  
Image Data ◽  
Distortion Correction ◽  
Specimen Preparation ◽  
Electron Image ◽  
Computer Controlled ◽  
Program Modules

Electron crystallography is an emerging field for structure determination as evidenced by a number of membrane proteins that have been solved to near-atomic resolution. Advances in specimen preparation and in data acquisition with a 400kV microscope by computer controlled spot scanning mean that our ability to record electron image data will outstrip our capacity to analyze it. The computed fourier transform of these images must be processed in order to provide a direct measurement of amplitudes and phases needed for 3-D reconstruction.In anticipation of this processing bottleneck, we have written a program that incorporates a menu-and mouse-driven procedure for auto-indexing and refining the reciprocal lattice parameters in the computed transform from an image of a crystal. It is linked to subsequent steps of image processing by a system of data bases and spawned child processes; data transfer between different program modules no longer requires manual data entry. The progress of the reciprocal lattice refinement is monitored visually and quantitatively. If desired, the processing is carried through the lattice distortion correction (unbending) steps automatically.

Information System for Post-marketing Drug Surveillance Scheme on Small Computers

1982 ◽  
Vol 21 (04) ◽  
pp. 181-186 ◽  
Author(s):  
M. A. A. Moussa
Keyword(s):  
Information System ◽  
Data Base ◽  
Data Transfer ◽  
Data Entry ◽  
Drug Reactions ◽  
Adverse Drug Reaction Monitoring ◽  
Desktop Computers ◽  
Post Marketing ◽  
The State Of Kuwait ◽  
Disc Drive

A drug information system (DARIS) has been created for handling reports on suspected drug reactions. The system is suitable for being run on desktop computers with a minimum of hardware requirements: 187 K read/write memory, flexible or hard disc drive and a thermal printer. The data base (DRUG) uses the QUERY and IMAGE programming capabilities for data entry and search. The data base to statistics link program (DBSTAT) enables data transfer from the data base into a file for statistical analysis and signalling suspected adverse drug reactions.The operational, medical and statistical aspects of the general population voluntary adverse drug reaction monitoring programme—recently initiated in the State of Kuwait—are described.

THE INCREASING OF DATA TRANSFER NOISE IMMUNITY IN DEPARTMENTAL COMMUNICATION SYSTEMS OF SHORT-WAVE RANGE

2018 ◽  
pp. 7-19
Author(s):  
B. G. Shadrin ◽  
◽  
D. E. Zachateyskiy ◽  
V. A. Dvoryanchikov Dvoryanchikov ◽  
◽  
...  
Keyword(s):  
Communication Systems ◽  
Noise Immunity ◽  
Data Transfer ◽  
Short Wave ◽  
Wave Range

WS-Security on PRODML

2014 ◽  
Vol 1 (1) ◽  
pp. 9-34
Author(s):  
Bobby Suryajaya
Keyword(s):  
Web Services ◽  
Digital Signature ◽  
Data Transfer ◽  
Web Services Security ◽  
Soap Message ◽  
Simulation Results ◽  
End To End

SKK Migas plans to apply end-to-end security based on Web Services Security (WS-Security) for Sistem Operasi Terpadu (SOT). However, there are no prototype or simulation results that can support the plan that has already been communicated to many parties. This paper proposes an experiment that performs PRODML data transfer using WS-Security by altering the WSDL to include encryption and digital signature. The experiment utilizes SoapUI, and successfully loaded PRODML WSDL that had been altered with WSP-Policy based on X.509 to transfer a SOAP message.

Sign in / Sign up

Export Citation Format

Share Document