Eunomia: Efficiently Eliminating Abnormal Results in Distributed Stream Join Systems

Author(s):  
Jie Yuan ◽  
Yonghui Wang ◽  
Hanhua Chen ◽  
Hai Jin ◽  
Haikun Liu
Keyword(s):  
2021 ◽  
Vol 11 (12) ◽  
pp. 5523
Author(s):  
Qian Ye ◽  
Minyan Lu

The main purpose of our provenance research for DSP (distributed stream processing) systems is to analyze abnormal results. Provenance for these systems is not nontrivial because of the ephemerality of stream data and instant data processing mode in modern DSP systems. Challenges include but are not limited to an optimization solution for avoiding excessive runtime overhead, reducing provenance-related data storage, and providing it in an easy-to-use fashion. Without any prior knowledge about which kinds of data may finally lead to the abnormal, we have to track all transformations in detail, which potentially causes hard system burden. This paper proposes s2p (Stream Process Provenance), which mainly consists of online provenance and offline provenance, to provide fine- and coarse-grained provenance in different precision. We base our design of s2p on the fact that, for a mature online DSP system, the abnormal results are rare, and the results that require a detailed analysis are even rarer. We also consider state transition in our provenance explanation. We implement s2p on Apache Flink named as s2p-flink and conduct three experiments to evaluate its scalability, efficiency, and overhead from end-to-end cost, throughput, and space overhead. Our evaluation shows that s2p-flink incurs a 13% to 32% cost overhead, 11% to 24% decline in throughput, and few additional space costs in the online provenance phase. Experiments also demonstrates the s2p-flink can scale well. A case study is presented to demonstrate the feasibility of the whole s2p solution.


2010 ◽  
Vol 116 (6) ◽  
pp. 1332-1340 ◽  
Author(s):  
Zahava Berkowitz ◽  
Mona Saraiya ◽  
Vicki Benard ◽  
K. Robin Yabroff

Author(s):  
Pim B.B. Schol ◽  
Natascha M. de Lange ◽  
Luc J.M. Smits ◽  
Yvonne M.C. Henskens ◽  
Hubertina C.J. Scheepers

2006 ◽  
Vol 130 (5) ◽  
pp. 641-644 ◽  
Author(s):  
Virginia A. LiVolsi ◽  
Stanley Leung

Abstract Critical values in anatomic pathology are usually information sensitive, whereas most such values in laboratory medicine are time sensitive. However, there is an important time element in anatomic pathology as well. Pathologists should be aware that many medicolegal actions against radiologists are based on failure to communicate “abnormal” results in a timely manner. Are pathologists the next group that will be targeted? Pathologists can spend much time trying to communicate important data that will affect patient care to someone who will accept the information. This is not an efficient use of pathologists' professional time. Most important, what are our obligations to patients to communicate “critical” abnormal results to the treating physician? What results need to be so communicated? Are pathologists obliged to contact the patient directly if there is a failure to communicate the critical results to a clinician? We explore these questions to promote discussion of these important issues as they relate to pathologists' liability and to patient care.


2007 ◽  
Vol 13 (1) ◽  
pp. 17-20
Author(s):  
Raquel Rego ◽  
Paulo Breno Noronha Liberalesso ◽  
Mônica Jaques Spinosa ◽  
Simone Carreiro Vieira ◽  
Alaídes S. Fojo Olmos ◽  
...  

INTRODUCTION: It is currently estimated that more than 10 million children all over the world have epilepsy and the EEG is the most commonly used diagnostic test in the investigation of these patients. The aim of this study was to analyze the sensibility of the EEG in revealing abnormalities in children with the clinical hypothesis of an epileptic seizure. METHODS: Out of 970 EEGs obtained between April 2005 and August 2006 at Pequeno Príncipe Children's Hospital, Curitiba, PR, Brazil, 692 fit the criteria proposed (clinical hypothesis of an epileptic seizure after the evaluation of a pediatric neurologist). All EEGs were recorded digitally, with minimal duration of 20 minutes and electrodes positioned according to the International System 10-20. Neonates were excluded. RESULTS: Age ranged from 30 days to 16.5 years (mean of 6.4 years and median of 4.1 years), 403 were female (58.2%). Out of the 692 EEG included in the study, 281 (40.6%) yielded abnormal results, 96 (34.2%) with abnormalities of the background activity (disorganization and/or asymmetry) and 185 (65.8%) with epileptiform paroxysms. The sensibility of the EEG was 40.6%. Sharpe wave occurred in 77 cases (41.6%), spike in 21 (11.4%), polispike in 14 (7.6%), spike-wave in 17 (9.2%), polispike-wave in 24 (13.0%) and exams with discharges of more than one morphology in 32 (17.3%). CONCLUSION: Our data strengthen the concept that even though the diagnosis of epilepsy is clinical and based on the semiological description of the epileptic crisis, the EEG has a good sensibility when properly indicated.


BMJ ◽  
1983 ◽  
Vol 287 (6400) ◽  
pp. 1188-1190
Author(s):  
K A Mills ◽  
P M Reilly

2001 ◽  
Vol 17 (3) ◽  
pp. 275-304 ◽  
Author(s):  
Steven H. Woolf

Objective: To review published data regarding the accuracy and effectiveness of three screening tests: mammography, prostate-specific antigen (PSA), and prenatal ultrasound.Methods: Published evidence regarding the accuracy and effectiveness of the three tests was collected by computerized literature search and supplemented by manual review of relevant bibliographies.Results: Screening mammograms lower breast cancer mortality by about 20%. Most data come from women aged 50–64 years; women aged 40–49 years may also benefit, but the absolute risk reduction is lower. Up to 1,500 to 2,500 women must undergo screening to prevent one death from breast cancer. Mammograms miss approximately 12% to 37% of cancers, generate false-positive results, and cause anxiety while abnormal results are evaluated. PSA screening can detect 80% to 85% of prostate cancers but has a high false-positive rate. There is little direct evidence that early detection reduces morbidity or mortality. Indirect evidence includes a trend toward earlier stage tumors and steadily declining mortality rates in geographic areas where PSA screening has become common. Potential harms include the morbidity associated with evaluating abnormal results, and complications from treatment (e.g., impotence, incontinence). The overall balance of benefits and harms remains uncertain in the absence of better evidence. Prenatal ultrasound may reduce perinatal mortality, primarily through elective abortions for congenital anomalies, but does not appear to lower live birth rates. Although ultrasound has no proven effect on neonatal morbidity, it provides more accurate estimates of gestational age that prevent unnecessary inductions for post-term pregnancy. Screening detects multiple gestations, congenital anomalies, and intrauterine growth retardation, but direct health benefits from having this knowledge are unproved. Ultrasound has both positive and negative psychological effects on parents. The scans do not appear to harm childhood development.Conclusions: Even for the most established screening tests, the appropriateness of routine testing depends on subjective value judgments about the quality of supporting evidence and about the trade-offs between benefits and harms. Individuals, clinicians, policy makers, and governments must weigh the evidence in light of these values and the constraints imposed by available resources.


Sign in / Sign up

Export Citation Format

Share Document