Exact rates found for sharing and communicating correlated data
Exact Common Information and Exact Channel Synthesis for Correlated Discrete Sources
Information Theory
Summary
The paper identifies exact formulas to understand how two connected pieces of data share information and how much communication is needed to perfectly recreate one data source from the other. The authors focus on discrete sources, which are data points that come from specific categories or values. Their work provides a clear way to calculate the minimal amount of shared randomness and communication required. This helps in tasks where precise reproduction of data is important.
What this means in practice
- •For network protocol engineers: Design exact communication methods to reproduce correlated data sources using minimal shared randomness and transmission rates.
- •For distributed system architects: Optimize system protocols to synchronize correlated discrete data between nodes with guaranteed exact reproduction.
A theory result. No direct application yet.
Authors
Lei Yu
Abstract
In this paper, we provide a single-letter characterization of the exact common information for a pair of correlated discrete sources, as well as a single-letter characterization of the admissible region for the shared randomness rate and the communication rate in exact channel synthesis.