BloomyCAN: Probabilistic Data Structures for Software-defined Controller Area Networks

Author(s):  
Dennis Grewe ◽  
Naresh Nayak ◽  
Deeban Babu ◽  
Wenwen Chen ◽  
Sebastian Schildt ◽  
...  
2018 ◽  
Author(s):  
Juan P. A. Lopes ◽  
Fabiano S. Oliveira ◽  
Paulo E. D. Pinto

In recent years, probabilistic data structures have been extensively employed to handle large volumes of streaming data in a timely fashion. However, their use in algorithms on giant graphs has been poorly explored. We introduce the concept of probabilistic implicit graph representation, which can represent large graphs using much less memory asymptotically by allowing adjacency test to have a constant probability of false positives or false negatives. This is an extension from the concept of implicit graph representation, comprehensively studied by Muller and Spinrad. Based on that, we also introduce two novel representations using probabilistic data structures. The first uses Bloom filters to represent general graphs with the same space complexity as the adjacency matrix (outperforming it however for sparse graphs). The other uses MinHash to represent trees with lower space complexity than any deterministic implicit representation. Furthermore, we prove some theoretical limitations for the latter approach.


Author(s):  
Michel Bonfim ◽  
Kelvin Dias ◽  
Stenio Fernandes

A comprehensive monitoring system is essential to assist solutions for most of SFC problems. Therefore, in this work, we propose SFCMon, an efficient and scalable monitoring solution to keep track network flows in SFC environments. To achieve the desired goals, SFCMon works with a pipeline of probabilistic data structures to detect and store large flows as well as perflow counters. For evaluation purposes, based on the SFC reference architecture defined by RFC 7665, we implement a Proof-of-Concept (PoC) framework, which provides a P4-based SFC switch and Python-based SFC Controller. Presented initial experiments demonstrate that SFCMon introduces a negligible performance penalty while providing significant scalability gains.


2022 ◽  
Vol 6 (POPL) ◽  
pp. 1-29
Author(s):  
Jialu Bao ◽  
Marco Gaboardi ◽  
Justin Hsu ◽  
Joseph Tassarotti

Formal reasoning about hashing-based probabilistic data structures often requires reasoning about random variables where when one variable gets larger (such as the number of elements hashed into one bucket), the others tend to be smaller (like the number of elements hashed into the other buckets). This is an example of negative dependence , a generalization of probabilistic independence that has recently found interesting applications in algorithm design and machine learning. Despite the usefulness of negative dependence for the analyses of probabilistic data structures, existing verification methods cannot establish this property for randomized programs. To fill this gap, we design LINA, a probabilistic separation logic for reasoning about negative dependence. Following recent works on probabilistic separation logic using separating conjunction to reason about the probabilistic independence of random variables, we use separating conjunction to reason about negative dependence. Our assertion logic features two separating conjunctions, one for independence and one for negative dependence. We generalize the logic of bunched implications (BI) to support multiple separating conjunctions, and provide a sound and complete proof system. Notably, the semantics for separating conjunction relies on a non-deterministic , rather than partial, operation for combining resources. By drawing on closure properties for negative dependence, our program logic supports a Frame-like rule for negative dependence and monotone operations. We demonstrate how LINA can verify probabilistic properties of hash-based data structures and balls-into-bins processes.


2020 ◽  
Vol 188 ◽  
pp. 104987 ◽  
Author(s):  
Amritpal Singh ◽  
Sahil Garg ◽  
Ravneet Kaur ◽  
Shalini Batra ◽  
Neeraj Kumar ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document