Papers for

distributed systems engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Verifiable delay proofs linked to fresh public challenges limit fast cheating

Fresh-Challenge VDF Attestations for Model-Relative Response Latency

Abstract: Can a finite verifier obtain public, model-relative evidence about response latency for sequential computation? Verifiable delay functions (VDFs) make this possible in principle: evaluation requires T sequential steps, whereas verification is efficient in the security parameter and polylogarithmic in the numerical value of T for standard constructions. Thus a delay can be astronomically large to evaluate yet succinctly represented and feasibly checked. A VDF proof for a chosen message alone is insufficient because it may be precomputed. We specify and analyze Fresh-Challenge VDF Attestations (FCLA), a protocol composition that binds a VDF to an unpredictable public challenge, a message, and independently auditable release and receipt records. Under explicit assumptions about VDF sequentiality, the challenge source, witness logs, and a calibrated upper bound on an adversary's sequential evaluation rate, an accepted FCLA transcript is inconsistent with post-challenge generation by an adversary in that bounded model. The result neither identifies a named claimant nor excludes relaying, outsourcing, or a faster unmodeled machine. A benchmark of the public reference implementation confirms the expected empirical separation between evaluation and verification on one documented machine. Our contribution is a protocol/design analysis and benchmarked reference implementation layer, not a new VDF construction or cryptographic primitive.

Fri 11 SeptCryptography and Security
The gist
The paper looks at how to prove that a certain amount of time was genuinely spent computing something in a way that others can verify quickly. While Verifiable Delay Functions (VDFs) can show a delay took place, just having a proof isn't enough because someone could prepare it in advance. The authors introduce Fresh-Challenge VDF Attestations, which tie the proof to a new unpredictable challenge and records of when the messages were sent and received. This method helps ensure that no one could have created the proof after seeing the challenge, as long as certain technical assumptions hold. They also provide a tested implementation showing that checking these proofs is much faster than creating them.
Open 2609.12727v1

Computation and cooperation evolve together in self-replicating programs

Tapes Together Strong: The Co-evolution of Computation and Cooperation

Abstract: How does cooperation evolve in complex agentic systems? Prior work in evolutionary game theory studies why individuals are incentivized to cooperate by isolating social interactions from the physical costs of behavior, while artificial life models traditionally study emergent self-replication without formalizing the dilemma between acquiring resources and preserving the shared energy needed to reproduce. In contrast, we introduce Autopoietic Game Theory, a computational model where social interactions, replication mechanisms, and their associated computational costs are endogenous and simultaneously co-evolving. We study these dynamics using a computational substrate of randomly initialized programs in Z80 machine code, showing empirically, and motivating with a simplified theoretical model, that embedding a social dilemma directly into the physics of computation can favor the emergence of self-replicating, cooperative strategies. When resources are scarce, our analysis shows that defection can become self-limiting even in well-mixed populations: parasitic stealing destroys shared energy, slows execution, and can prevent reliable replication. Empirically, evolved programs suppress stealing across several Z80 environments, while spatial assortment further supports structural complexity and task performance. We further show that the framework can incorporate exogenous pressures, such as math tasks structured as sequential social dilemmas, when rewards are tied to computation budgets. These results suggest that coupling an agent's capacity for computation to its available energy transforms cooperation into a dominant scaffolding for building sustainable, self-organizing systems.

Wed 9 SeptMultiagent SystemsArtificial Intelligence
The gist
The paper studies how cooperation can naturally emerge in complex systems that both compute and replicate themselves. The researchers created a computational model where social behaviors, resource use, and replication evolve together, rather than being separate factors. They found that when resources are limited, selfish cheating behaviors harm shared energy and slow down replication, which encourages cooperative strategies to win out. Their experiments using small computer programs show that cooperative behaviors help these programs replicate better and perform tasks more reliably.
Open 2609.10817v1

Graph clustering method improves distributed algorithms for edge coloring and cuts

Introvert Clustering for Distributed Graph Algorithms

Abstract: We introduce a graph decomposition primitive called introvert clustering, which strengthens standard low-diameter clustering by guaranteeing that every clustered vertex keeps at least a $\left(\frac12-\varepsilon\right)$-fraction of its relevant neighbors in its own cluster. Repeatedly applying this primitive yields a layered introvert network decomposition with $O(\log n)$ layers and weak diameter $O(\log n)$. We give two applications in the $\mathsf{LOCAL}$ model. For every constant $\varepsilon>0$, we obtain a $\widetilde O(\log^2 n)$-round deterministic algorithm for list $\left(\frac32+\varepsilon\right)Δ$-edge coloring on graphs of maximum degree $Δ\geqΔ_0(\varepsilon)$; for bipartite graphs, the result holds for all $Δ$. For every constant $0<\varepsilon<1/4$, we also obtain a $\widetilde O(\log^2 n)$-round deterministic algorithm for a $\left(\frac14-\varepsilon\right)$-locally balanced cut, where every vertex has at least a $\left(\frac14-\varepsilon\right)$-fraction of its neighbors on the opposite side. The resulting algorithms are remarkably simple: edge coloring processes the layers in reverse order and colors each cluster, while locally balanced cut processes them forward and computes a locally maximum cut within each cluster. The introvert guarantee enables these procedures beyond the usual greedy regime of network decomposition. We construct the decomposition in $O(\log^2 n)$ randomized rounds using Miller--Peng--Xu low-diameter clustering and a simple trimming procedure, and deterministically in $\widetilde O(\log^2 n)$ rounds via a white-box adaptation of the recursive network decomposition algorithm of Ghaffari and Grunau [FOCS 2024].

Wed 9 SeptDistributed, Parallel, and Cluster ComputingData Structures and Algorithms
The gist
This work introduces a new way to split networks into clusters called introvert clustering, which keeps most neighbors together in the same cluster. By repeating this process, the authors create a structure that helps solve problems like coloring edges with few colors and finding balanced cuts in the network efficiently. Their methods run in a predictable amount of time and work well even when decisions are made step-by-step within small clusters. The algorithms are simpler than previous ones and rely on this neat clustering property to work effectively.
Open 2609.10044v1

SemBridge creates communication plans linking distributed tensor systems

SemBridge: Compiling Consumer Observations into Cross-Stack Communication Plans

Abstract: Distributed-tensor systems specify where values reside, while collective systems optimize how requested operations execute. At a boundary between vendor runtimes that cannot share a native communicator, neither abstraction states what a remote consumer must observe. SemBridge fills this gap by compiling graph and runtime facts into a typed contract for the consumer-visible result and its delivery obligations. The contract captures provenance, substitutability, completion, authority, demand, and native-domain locality. A deterministic lowerer constructs backend-neutral communication plans, and a symbolic checker validates each plan before execution across CUDA/NCCL and CANN/HCCL. An independent layout-only planner handles all 72 structural transitions but establishes only 54 complete obligations; a byte-only minimizer proposes 40 semantically invalid candidates, all rejected by SemBridge. On nine real edges, SemBridge produces distinct observation-aware plans that reduce startups on all nine and payload bytes on the three result edges. A live CUDA/CANN run derives and executes full-logit reconstruction, source projection, and owner-token delivery from log-probability, token-only, and owner-scoped requests. On a measured two-host 1-GbE capacity-spillover deployment, source projection cuts result traffic by more than 99.97% and increases throughput by 8.92-80.20% across Dense, MoE, and MiniMax workloads. All 18 MiniMax restart pairs at concurrency 1, 8, and 16 favor source projection. A Qwen3-14B MLP slice additionally verifies bitwise activation-shard delivery and HCCL completion of row-parallel partials. These results establish consumer observation as a semantic layer between placement and collective execution.

Tue 8 SeptDistributed, Parallel, and Cluster Computing
The gist
When computers work together to process complex data, they need clear rules about who sees what and when. This paper presents SemBridge, a system that builds precise contracts explaining how data moves between parts of a distributed system. The authors show that these contracts help create efficient communication plans that work across different hardware and software setups. Their tests demonstrate big reductions in data traffic and faster processing in real-world workloads.
Open 2609.08231v1

Benchmarking Byzantine broadcast algorithms reveals trade offs in cloud environments

From Bracha to Coded MBRB: Benchmarking Byzantine Reliable Broadcast Implementations

Abstract: Byzantine Reliable Broadcast (BRB) and Message-Adversary-Tolerant Byzantine Reliable Broadcast (MBRB) are reliable-dissemination abstractions for fault-tolerant distributed systems. Yet their operational behavior is shaped not only by specifications and asymptotic communication bounds, but also by serialization, cryptography, buffering, orchestration, deployment environment, and fault-injection semantics. This paper implements and evaluates Bracha [Information and Computation, 1987], AFRT by Albouy et al. [TCS, 2023], and Coded MBRB by Albouy et al. [OPODIS, 2024]. We implement the algorithms in a shared Go codebase with common orchestration, instrumentation, parser-based specification checks, fault injection, and an open-source reproducibility artifact. The evaluation uses single-shot broadcasts in the Shadow network simulator, native profiling, a Google Cloud Platform deployment, and a distributed FABRIC testbed, covering controlled experiments up to 30 nodes, payloads up to 40 MB, 92,190 runs, and 2,361,600 parser-checked entries. The results show that Coded MBRB reduces transmitted data and improves latency in the evaluated cloud setting for larger payloads, but shifts cost to cryptographic and coding computation. Bracha and AFRT incur lower CPU costs at smaller payloads, but their full-payload dissemination increases processing, allocation, and network costs as payloads grow. Across the tested configurations, the parser found no duplicate deliveries, conflicting deliveries, or deliveries of values different from the sender's payload. The paper contributes implementation-level evidence and an extensible artifact for benchmarking BRB and MBRB as executable distributed-system components, exposing bottlenecks and operational trade-offs that are hidden by algorithmic descriptions alone.

Mon 7 SeptDistributed, Parallel, and Cluster Computing
The gist
Ensuring that messages are reliably shared even when some parts of a network misbehave (called Byzantine faults) is important for secure distributed systems. This paper compares three key algorithms for this problem by implementing and testing them in realistic settings. The researchers found that one new method, called Coded MBRB, sends less data and is faster for bigger messages in cloud environments, but it costs more in computation. Older methods use less CPU for small messages but become costly as message size grows. Their work provides detailed performance insights beyond theoretical descriptions.
Open 2609.07521v1