Papers for

distributed database developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Amortized relaxed codes enable efficient data recovery with low probes

Amortized Relaxed Locally Decodable Codes

Abstract: Locally decodable codes (LDCs) enable recovery of any message symbol by probing only a small number of positions in a possibly corrupted codeword. The central parameters of an LDC are its rate, locality, and error tolerance. Ideally, one would like all three parameters to be constant. However, classical lower bounds show that such codes cannot exist. A recent line of work introduced amortized locally decodable codes (aLDCs), in which the decoder is tasked with recovering an entire block of consecutive message symbols rather than a single symbol. While prior work obtained ideal aLDCs with constant rate, constant error tolerance, and constant amortized locality, those constructions relied on either shared randomness hidden from the channel or computational assumptions restricting the channel. Another well-studied relaxation is the notion of a relaxed locally decodable code (RLDC), in which the decoder may output a special failure symbol $\bot$ rather than risk decoding incorrectly. In this work, we introduce the notion of an amortized relaxed locally decodable code (aRLDC), combining amortized decoding with the relaxed decoding paradigm. Unlike prior ideal aLDC constructions, our model is fully information-theoretic and makes no assumptions about shared randomness or computational limitations of the adversarial channel. We construct the first aRLDC with constant rate, constant error tolerance, and constant amortized locality. Moreover, for any block of length $Ω(\mathrm{polylog}(k))$, our decoder achieves amortized locality $1+δ^{1 - o(1)}$, where $δ$ is the error tolerance parameter. Thus, asymptotically, recovering a long block requires essentially less than two codeword probe per message symbol recovered. By contrast, without amortization no RLDC can simultaneously achieve constant rate, constant error tolerance, and constant locality.

Mon 14 SeptInformation TheoryDiscrete Mathematics
The gist
Locally decodable codes let you recover parts of a message by checking only a few spots in the coded data, even if some parts got messed up, but making them work well for many parameters at once is hard. The authors worked on a new kind of code that combines two relaxations—decoding multiple message parts at once and allowing the decoder to say "I don’t know" sometimes instead of making mistakes. They built such codes that achieve good rates, tolerate errors, and require very few probes per symbol on average, without relying on assumptions about the communication channel or secret randomness. This advances the theoretical possibilities for error-correcting codes in noisy environments.
Open → 2609.16332v1

Scientific knowledge graphs improve distributed vector search efficiency

COMPASS: Steering Distributed Vector Search with Scientific Knowledge Graphs

Abstract: Vector databases use hashing to partition data across "shards," logical units for distributed execution. This placement, however, destroys semantic locality, forcing each query into scatter-gather limited by the slowest shard. Vector-space clustering can help, but scientific evidence is often connected by factual relations that do not align with embedding distance. We present COMPASS, a framework that uses a knowledge graph (KG) to determine data placement and query-time shard selection. COMPASS detects communities, splits oversized communities, inserts embeddings by subject entity, and routes queries to a small set of shards. Across four biomedical KGs, our method searches only 13-18% of the corpus while preserving broadcast recall and recovering up to 2.6x more multi-hop evidence than an embedding-based baseline. On 15 HPC nodes, COMPASS sustains 7.9x higher throughput with lower tail latency than hash-based broadcast. These results show that KG structure provides a compact complement to embedding geometry for scalable vector search.

Fri 11 SeptDatabasesDistributed, Parallel, and Cluster Computing
The gist
Searching large collections of data with vector databases can be slow because data is split randomly across many parts, causing queries to check everything. The authors show that using scientific knowledge graphs, which capture relationships between facts, can better group data and guide queries to fewer relevant parts. Their approach, COMPASS, checks less data while still finding the important connections between pieces of information. This leads to much faster searching without losing important results.
Open → 2609.13452v1