Property Testing in Massive Graphs

We introduce Tiered Sampling , a novel technique for estimating the count of sparse motifs in massive graphs whose edges are observed in a stream. Our technique requires only a single pass on the data and uses a memory of fixed size M , which can be magnitudes smaller than the number of edges. Our methods address the challenging task of counting sparse motifs—sub-graph patterns—that have a low probability of appearing in a sample of M edges in the graph, which is the maximum amount of data available to the algorithms in each step. To obtain an unbiased and low variance estimate of the count, we partition the available memory into tiers (layers) of reservoir samples. While the base layer is a standard reservoir sample of edges, other layers are reservoir samples of sub-structures of the desired motif. By storing more frequent sub-structures of the motif, we increase the probability of detecting an occurrence of the sparse motif we are counting, thus decreasing the variance and error of the estimate. While we focus on the designing and analysis of algorithms for counting 4-cliques, we present a method which allows generalizing Tiered Sampling to obtain high-quality estimates for the number of occurrence of any sub-graph of interest, while reducing the analysis effort due to specific properties of the pattern of interest. We present a complete analytical analysis and extensive experimental evaluation of our proposed method using both synthetic and real-world data. Our results demonstrate the advantage of our method in obtaining high-quality approximations for the number of 4 and 5-cliques for large graphs using a very limited amount of memory, significantly outperforming the single edge sample approach for counting sparse motifs in large scale graphs.

Download Full-text

Enumerating maximum cliques in massive graphs

IEEE Transactions on Knowledge and Data Engineering ◽

10.1109/tkde.2020.3036013 ◽

2020 ◽

pp. 1-1

Author(s):

Can Lu ◽

Jeffrey Xu Yu ◽

Hao Wei ◽

Yikai Zhang

Keyword(s):

Maximum Cliques ◽

Massive Graphs

Download Full-text

The Book Review Column1

ACM SIGACT News ◽

10.1145/3444815.3444817 ◽

2021 ◽

Vol 51 (4) ◽

pp. 4-5

Author(s):

Frederic Green

Keyword(s):

Parameterized Complexity ◽

Property Testing ◽

The Third ◽

Geometric Problems ◽

The Subject

The three books reviewed in this column are about central ideas in algorithms, complexity, and geometry. The third one brings together topics from the first two by applying techniques of both property testing (the subject of the first book) and parameterized complexity (including its more focused incarnation studied in the second book, kernelization) to geometric problems.

Download Full-text

Property Testing of Regular Tree Languages

Algorithmica ◽

10.1007/s00453-007-9028-3 ◽

2007 ◽

Vol 49 (2) ◽

pp. 127-146 ◽

Cited By ~ 7

Author(s):

Frédéric Magniez ◽

Michel de Rougemont

Keyword(s):

Property Testing ◽

Regular Tree ◽

Tree Languages

Download Full-text