Better Space-Time-Robustness Trade-Offs for Set Reconciliation
Date
2024-07
Journal Title
Journal ISSN
Volume Title
Publisher
Schloss Dagstuhl – Leibniz-Zentrum für Informatik
Abstract
We consider the problem of reconstructing the symmetric difference between similar sets from their representations (sketches) of size linear in the number of differences. Exact solutions to this problem are based on error-correcting coding techniques and suffer from a large decoding time. Existing probabilistic solutions based on Invertible Bloom Lookup Tables (IBLTs) are time-efficient but offer insufficient success guarantees for many applications. Here we propose a tunable trade-off between the two approaches combining the efficiency of IBLTs with exponentially decreasing failure probability. The proof relies on a refined analysis of IBLTs proposed in (Bæk Tejs Houen et al. SOSA 2023) which has an independent interest. We also propose a modification of our algorithm that enables telling apart the elements of each set in the symmetric difference.
Description
Keywords
Data structures, Hashing, Set reconciliation, Invertible Bloom lookup tables, Random hypergraphs, BCH codes