Summary
Measuring how similar two texts are usually gives just one overall score, but that doesn't explain what parts came from which sources when many documents are involved. The authors propose Semantic Conditional Similarity, a new method that compares two documents while removing the shared content from a third, helping to identify each source’s unique contribution. This approach adds direction to comparisons and avoids arbitrary thresholds, giving a clearer ranking of how each source impacts a target document. It works for different numbers of source and target documents and reveals information that simple pairwise comparisons miss.
What this means in practice
- •For content recommendation teams: Identify unique content contributions from different documents to improve personalized recommendations by filtering out shared information.
- •For legal document reviewers: Disentangle overlapping source contributions in documents to better assess originality and influence in legal case files.
A theory result. No direct application yet.
Abstract
Semantic Textual Similarity (STS) operates on document pairs, returning a single scalar per comparison. In a multi-document setting where several sources may have contributed to one or more targets, pairwise STS cannot disentangle each source's marginal semantic contribution from their shared vocabulary. In this paper, Semantic Conditional Similarity (SCS) is introduced as a conditional form of STS that computes similarity between two documents after eliminating semantic elements shared with a third via set-theoretic operations. SCS makes four contributions: 1) it introduces directionality, partitioning pairwise relations into lateral (inter-source) and vertical (source-to-target) classes; 2) conditioning induces role-dependent asymmetry by extending the comparison domain from unordered pairs to ordered, conditioned triples of a target, a reference, and a conditioning document; 3) SCS introduces inter-document conditioning by subtracting shared content from a third document, complementing the intra-document conditioning in recent C-STS work; and 4) the set-theoretic decomposition achieves threshold-free partitioning of shared and residual content, requiring no arbitrary similarity cutoff. Although developed for the $n \to 1$ configuration, the framework extends to $1 \to n$ via vertical role reversal and to $m \to n$ via independent composition of source- and target-side conditioning. With the established $1 \to 1$ case, these span the full spectrum of document cardinality. SCS scores should be interpreted ordinally, as rankings of marginal contributions rather than absolute measurements. The broader implication is that metric space axioms commonly assumed in similarity formalizations constrain expressiveness in role-differentiated multi-document settings, and that extending the domain to conditioned triples can recover information that pairwise-symmetric comparisons suppress.