Estimating the Completeness of Range Queries over Structured P2P Databases

Author(s):  
Alfredo Cuzzocrea ◽  
Marcel Karnstedt ◽  
Manfred Hauswirth ◽  
Kai-Uwe Sattler ◽  
Roman Schmidt

Range queries are a very powerful tool in a wide range of data management systems and are vital to a multitude of applications. The hierarchy of structured overlay systems can be utilized in order to provide efficient techniques for processing them, resulting in the support of applications and techniques based on range queries in large-scale distributed information systems. On the other hand, due to the rapid development of the Web, applications based on the P2P paradigm gain more and more interest, having such systems started to evolve towards adopting standard database functionalities in terms of complex query processing support. This goes far beyond simple key lookups, as provided by standard distributed hashtables (DHTs) systems, which makes estimating the completeness of query answers a crucial challenge. Unfortunately, due to the limited knowledge and the usually best-effort characteristics, deciding about the completeness of query results, e.g., getting an idea when a query is finished or what amount of results is still missing, is very challenging. There is not only an urgent need to provide this information to the user issuing queries, but also for implementing sophisticated and efficient processing techniques based on them. In this chapter, the authors propose a method for solving this task. They discuss the applicability and quality of the estimations, present an implementation and evaluation for the P-Grid system, and show how to adapt the technique to other overlays. The authors also discuss the semantics of completeness for complex queries in P2P database systems and propose methods based on the notion of routing graphs for estimating the number of expected query answers. Finally, they discuss probabilistic guarantees for the estimated values and evaluate the proposed methods through an implemented system.

Author(s):  
О. Кravchuk ◽  
V. Symonenkov ◽  
I. Symonenkova ◽  
O. Hryhorev

Today, more than forty countries of the world are engaged in the development of military-purpose robots. A number of unique mobile robots with a wide range of capabilities are already being used by combat and intelligence units of the Armed forces of the developed world countries to conduct battlefield intelligence and support tactical groups. At present, the issue of using the latest information technology in the field of military robotics is thoroughly investigated, and the creation of highly effective information management systems in the land-mobile robotic complexes has acquired a new phase associated with the use of distributed information and sensory systems and consists in the transition from application of separate sensors and devices to the construction of modular information subsystems, which provide the availability of various data sources and complex methods of information processing. The purpose of the article is to investigate the ways to increase the autonomy of the land-mobile robotic complexes using in a non-deterministic conditions of modern combat. Relevance of researches is connected with the necessity of creation of highly effective information and control systems in the perspective robotic means for the needs of Land Forces of Ukraine. The development of the Armed Forces of Ukraine management system based on the criteria adopted by the EU and NATO member states is one of the main directions of increasing the effectiveness of the use of forces (forces), which involves achieving the principles and standards necessary for Ukraine to become a member of the EU and NATO. The inherent features of achieving these criteria will be the transition to a reduction of tasks of the combined-arms units and the large-scale use of high-precision weapons and land remote-controlled robotic devices. According to the views of the leading specialists in the field of robotics, the automation of information subsystems and components of the land-mobile robotic complexes can increase safety, reliability, error-tolerance and the effectiveness of the use of robotic means by standardizing the necessary actions with minimal human intervention, that is, a significant increase in the autonomy of the land-mobile robotic complexes for the needs of Land Forces of Ukraine.


2020 ◽  
Vol 36 (10) ◽  
pp. 3011-3017 ◽  
Author(s):  
Olga Mineeva ◽  
Mateo Rojas-Carulla ◽  
Ruth E Ley ◽  
Bernhard Schölkopf ◽  
Nicholas D Youngblut

Abstract Motivation Methodological advances in metagenome assembly are rapidly increasing in the number of published metagenome assemblies. However, identifying misassemblies is challenging due to a lack of closely related reference genomes that can act as pseudo ground truth. Existing reference-free methods are no longer maintained, can make strong assumptions that may not hold across a diversity of research projects, and have not been validated on large-scale metagenome assemblies. Results We present DeepMAsED, a deep learning approach for identifying misassembled contigs without the need for reference genomes. Moreover, we provide an in silico pipeline for generating large-scale, realistic metagenome assemblies for comprehensive model training and testing. DeepMAsED accuracy substantially exceeds the state-of-the-art when applied to large and complex metagenome assemblies. Our model estimates a 1% contig misassembly rate in two recent large-scale metagenome assembly publications. Conclusions DeepMAsED accurately identifies misassemblies in metagenome-assembled contigs from a broad diversity of bacteria and archaea without the need for reference genomes or strong modeling assumptions. Running DeepMAsED is straight-forward, as well as is model re-training with our dataset generation pipeline. Therefore, DeepMAsED is a flexible misassembly classifier that can be applied to a wide range of metagenome assembly projects. Availability and implementation DeepMAsED is available from GitHub at https://github.com/leylabmpi/DeepMAsED. Supplementary information Supplementary data are available at Bioinformatics online.


Author(s):  
А.А. Boldyrev ◽  
А.А. Buben’shikov ◽  
D.I. Boldyrev

In modern conditions of rapid development of telecommunication technologies radio engineering means of different function are used everywhere in all spheres of ability to live of the person. Thus organizational-technical systems of civil appointment and power departments use the wide nomenclature of radio-electronic means of various classes with a wide spectrum of parameters, kinds of radiations and operating modes. In turn, it causes formation of difficult electromagnetic conditions in administrative-industrial regions and their near environment. The primary goal of services of radio control in these conditions is control over correctness of use by organizational-technical systems of the allocated resource of a radiofrequency spectrum and the parameters radiating of radio-electronic means. One of the main difficulties with which means of radio control in the course of the analysis of electromagnetic conditions in the set territorial area face a considerable quantity of radiating radio-electronic means with various parameters in a wide range of the relation a signal/noise, and also presence of stirring influence of any hindrances is. These factors make rigid demands to indicators of quality of functioning of panoramic detectors-direction finders which make a basis of mobile and stationary means of radio control. One of the basic indicators of quality of panoramic detectors-direction finders of means of radio control is range of detection of the radio-electronic means, defined by the set level of sensitivity and demanded values of probabilities of detection and a false alarm. Authors in article result results of working out of algorithm of increase of range of detection of signals by means of radio control on the basis of an estimated-correlation-compensatory way of measurement and indemnification of average capacity of additive hindrances in the reception channel. By results of the researches spent in article it is shown that: the increase in average capacity of cumulative external inadvertent and deliberate hindrances for the set typical initial data leads in VHF a range to reduction of range of detection of radio-electronic means not less, than in 1,4 times from the demanded; at demanded value of probability of detection, for example, and probabilities of a false alarm, at relative level of external set of a hindrance the panoramic detectors-direction finder of means of radio control with the realised procedure of measurement and indemnification of average value of capacity (dispersion) of inadvertent, deliberate hindrances and internal noise allows to lower the requirement to the threshold relation a signal/(noise) (on pressure) more, than in 1,3 times that will allow to approach value of range of detection to a reference value.


2011 ◽  
Vol 201-203 ◽  
pp. 2607-2610
Author(s):  
Wen Hui Zhao ◽  
She Liu

Large scale of the industrial waste is not timely disposed of due to economic rapid development. It is the main reason why environmental pollution problem is getting more and more serious and we should monitor the pollution of industrial waste. A MODIS (Moderate Resolution Imaging Spectroradiometer) senor is used for long-time and dynamic environment monitor because it has advantages of high time resolution and high spectral resolution characteristics etc. SPOT satellite data is used to analyze the ground vegetation for its higher ground resolution and rich product data bases. The influence of industrial waste on environment is analyzed and the result of research is verifyed with the information of local meteorological agent and observation data of site. This method can be used for monitoring wide-range industrial waste and have good performance of monitoring and early warning industrial waste sites which are in mountainous area.


2018 ◽  
Vol 2018 ◽  
pp. 1-10 ◽  
Author(s):  
Samira Melki ◽  
Moncef Gueddari

The production of phosphoric acid by the Tunisian Chemical Group, in Sfax, Tunisia, led to the degradation of the groundwater quality of the Sfax-Agareb aquifer mainly by the phosphogypsum leachates infiltration. Spatiotemporal monitoring of the quality of groundwater was carried out by performing bimonthly sampling between October 2013 and October 2014. Samples culled in the current study were subject to physicochemical parameters measurements and analysis of the major elements, orthophosphates, fluorine, trace metals, and stable isotopes (18O, 2H). The obtained results show that the phosphogypsum leachates infiltration has a major effect on the downstream part of the aquifer, where the highest values of conductivity, SO42-, Ortho-P, and F-, and the lowest pH were recorded. In addition, these results indicated that phosphogypsum leachates contained much higher amount of Cr, Cd, Zn, Cu, Fe, and Al compared to the groundwater. Spatiotemporal variation of the conductivity and concentrations of major elements is linked to the phosphogypsum leachates infiltration as well as to a wide range of factors such as the natural conditions of feeding and the water residence time. Contents of O18 and 2H showed that the water of the Sfax-Agareb aquifer undergoes a large scale evaporation process originated from recent rainfall.


2018 ◽  
Vol 175 ◽  
pp. 03001
Author(s):  
Han Yang ◽  
Chen Kerui ◽  
Li Yang ◽  
Qu Bao

In twenty-first Century, China vigorously promoted the research and construction of AC and DC transmission technology in order to ensure the optimal allocation of energy resources in a large scale[1]. In the construction of AC UHV transmission line, the welding quality of tower and stiffening plate as the load bearing tower and the tension of the welded structure plays an important role in the overall quality of the steel structure. In the past, the welding process of semi automatic carbon dioxide solid core welding wire often has the characteristics of weld spatter not easy to clean up and low efficiency of welding. The semi-automatic CO2 flux cored arc welding, has the characteristics of current and voltage to adapt to a wide range, melting speed, has important significance for improving the process, this paper describes the technology in practical engineering applications, and developed the basic strategy of training for grid steel structure welding technicians. This paper also lists both V groove plate butt FCAW welding typical welding project, hope this welding process will continue to spread.


2014 ◽  
Vol 610 ◽  
pp. 695-698
Author(s):  
Qian Tao ◽  
Bo Pan ◽  
Wen Quan Cui

In recent years, the rapid development of cloud computing brings significant innovation in the whole IT industry. For the local tasks scheduling on each computational node of the top model of weapon network, an open task scheduling framework was introduced a task accept control scheme based on the tasks based on load balancing, quality of service (QoS) and an improved constant bandwidth server algorithm was presented. The result of simulation shows that the scheduling policies can improve the schedule speed when the number of tasks increases and can meet the demand better for the real time requirementsof the tactical training evaluation system for complexity and Large-scale.


Author(s):  
Nataliia Korzhenivska ◽  
Nadiia Sydorak

The formation of information flows about the activities of the enterprise needs modern information technologies as a tool designed to carry out effective activities and ensure security and protection. Changing management systems requires making reasoned decisions and analyzing the current situation using flexible and adaptive technological tools. Therefore, today information acts as one of the primary resources, the value of which is no less than the value of other types of resource potential. The efficient use of these resources in the production process largely depends on the state and use of information and the sources of its receipt. Economic transformations, the growing need for protection in the formation and use of the resources of enterprises necessitate new approaches to the processing of large amounts of information and the study of individual economic processes. One of the key resources of enterprises are fixed assets as components of production potential. Having studied the advantages of the accounting and analytical support system in ensuring the quality of the information base for the formation and enhancement of the security of the formation and use of fixed assets, an appropriate structure is proposed, which is based on the level of ensuring such security, which allows separating the relevant elements and functions. In the context of the rapid development of digital technologies, the available software on the market for digital services and information processing is represented by a fairly wide range. New concepts of computer programs make it possible to more efficiently plan and manage resources, form and use the optimal size of fixed assets and effectively manage their movement. The elements and functions of the safety assurance levels of these processes make it possible to build a system of information and analytical support using modern means of information and accounting technologies. Further research involves the development of methodological recommendations for determining the economic efficiency of the use of fixed assets and the formation of proposals for the use of innovative forms of providing enterprises with fixed assets.


Author(s):  
С.И. Носков ◽  
М.П. Базилевский ◽  
Ю.А. Трофимов ◽  
А. Буяннэмэх

В статье рассматривается проблема разработки (формирования) функции эффективности (агрегированного критерия, свертки критериев) входящих в состав Улан-Баторской железной дороги (УБЖД) участков, которая содержала бы специальным образом взвешенные частные характеристики качества функционирования этих участков. Решение этой проблемы осуществляется на основе разработанной в Иркутском государственном университете путей сообщения информационно-вычислительной технологии (ИВТ) многокритериального оценивания эффективности функционирования сложных социально-экономических и технических систем. ИВТ позволяет на модельном уровне оценивать эту эффективность одним числом (выраженным, например, в процентах), что открывает широкие возможности в управлении этими системами, поскольку позволяет выполнять, в частности, масштабный многофакторный сравнительный анализ деятельности однородных организационных и других структур и принимать на этой основе решения самого различного характера. Построена функция эффективности функционирования участков УБЖД, включающая в свой состав взвешенные частные индикаторы такой эффективности: погрузка, статическая нагрузка, выгрузка, отправление вагонов, перевозка пассажиров, простои вагонов с одной переработкой, простои местных вагонов, простои транзитных вагонов с переработкой, простои транзитных вагонов без переработки. На основе этой функции рассчитана масштабированная на сто процентов эффективность каждого участка. При этом все показатели предпочтения упорядочены по убыванию значимости. Подобная информация, формируемая с годичной периодичностью, может быть весьма полезна руководству УБЖД для принятия широкого спектра управленческих, в том числе кадровых, решений. Аналогичная работа может быть выполнена в интересах РАО РЖД. The article discusses the problem of developing (forming) an efficiency function (aggregated criterion, convolution of criteria) of the sections included in the Ulan Bator Railway (UBZhD), which would contain specially weighted private characteristics of the quality of the functioning of these sections. The solution to this problem is carried out on the basis of the information and computational technology (ICT) developed at the Irkutsk State University of communication lines for multi-criteria assessment of the effectiveness of the functioning of complex socio-economic and technical systems. IWT makes it possible at the model level to evaluate this efficiency by one number (expressed, for example, as a percentage), which opens up ample opportunities in the management of these systems, since it allows performing, in particular, a large-scale multifactorial comparative analysis of the activities of homogeneous organizational and other structures and on this basis solutions of the most varied nature. The function of the effectiveness of the functioning of the UBZhD sections has been built, which includes weighted private indicators of such efficiency: loading, static load, unloading, dispatch of cars, transportation of passengers, idle time of cars with one processing, idle time of local cars, idle time of transit cars with processing, idle time of transit cars without processing. Based on this function, a 100% scaled efficiency is calculated for each site. Moreover, all preference indicators are sorted in descending order of importance. Such information, generated on a yearly basis, can be very useful to the UBZhD leadership for making a wide range of managerial, including personnel, decisions. Similar work can be performed in the interests of RAO Russian Railways.


Author(s):  
Donovan H Parks ◽  
Michael Imelfort ◽  
Connor T Skennerton ◽  
Philip Hugenholtz ◽  
Gene W Tyson

Large-scale recovery of genomes from isolates, single cells, and metagenomic data has been made possible by advances in computational methods and substantial reductions in sequencing costs. While this increasing breadth of draft genomes is providing key information regarding the evolutionary and functional diversity of microbial life, it has become impractical to finish all available reference genomes. Making robust biological inferences from draft genomes requires accurate estimates of their completeness and contamination. Current methods for assessing genome quality are ad hoc and generally make use of a limited number of ‘marker’ genes conserved across all bacterial or archaeal genomes. Here we introduce CheckM, an automated method for assessing the quality of a genome using a broader set of marker genes specific to the position of a genome within a reference genome tree and information about the collocation of these genes. We demonstrate the effectiveness of CheckM using synthetic data and a wide range of isolate, single cell and metagenome derived genomes. CheckM is shown to provide accurate estimates of genome completeness and contamination, and to outperform existing approaches. Using CheckM, we identify a diverse range of errors currently impacting publicly available isolate genomes and demonstrate that genomes obtained from single cells and metagenomic data vary substantially in quality. In order to facilitate the use of draft genomes, we propose an objective measure of genome quality that can be used to select genomes suitable for specific gene- and genome-centric analyses of microbial communities.


Sign in / Sign up

Export Citation Format

Share Document