Better Space-Time-Robustness Trade-Offs for Set Reconciliation

Date

2024-07

Journal Title

Journal ISSN

Volume Title

Publisher

Schloss Dagstuhl – Leibniz-Zentrum für Informatik

Abstract

We consider the problem of reconstructing the symmetric difference between similar sets from their representations (sketches) of size linear in the number of differences. Exact solutions to this problem are based on error-correcting coding techniques and suffer from a large decoding time. Existing probabilistic solutions based on Invertible Bloom Lookup Tables (IBLTs) are time-efficient but offer insufficient success guarantees for many applications. Here we propose a tunable trade-off between the two approaches combining the efficiency of IBLTs with exponentially decreasing failure probability. The proof relies on a refined analysis of IBLTs proposed in (Bæk Tejs Houen et al. SOSA 2023) which has an independent interest. We also propose a modification of our algorithm that enables telling apart the elements of each set in the symmetric difference.

Description

Keywords

Data structures, Hashing, Set reconciliation, Invertible Bloom lookup tables, Random hypergraphs, BCH codes

Citation

Endorsement

Review

Supplemented By

Referenced By