Papers for

statistical data analysts

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Competitive betting improves test power but limits expected gains

Competitive optimality in testing by betting via Bell-Cover randomization

Abstract: Bell and Cover showed that an investor who multiplies the initial unit of capital by an independent uniform random variable on $(0,2)$, and then uses the log-optimal portfolio, wins a head-to-head wealth comparison with probability at least one half against every independently randomized competitor. We explain very simply how this result transfers to testing by betting: for any composite null $\mathcal P$ and simple alternative $Q$, denoting $E^*$ as the corresponding numeraire e-variable, we show that $UE^*$ exceeds any other e-variable $E$ with probability at least half. Interestingly, we show that this competitive optimality result is actually equivalent to the numeraire inequality $\mathbb E_Q[E/E^*]\leq1$, and in general randomization only helps the numeraire and fails to improve the competitive advantage of an arbitrary e-variable. Under optional stopping with or without knowledge of $U$, we emphasize a key distinction between e-process validity and competitive optimality. We also show that competitive optimality comes at the price of expected log wealth and power: thresholding $UE^*$ at $1/α$ has sharp size at most $α/2$, but the factor of two actually disappears under optional stopping. Even after correcting for this factor of two, the test is dominated in conditional rejection probability by randomizing the testing threshold (randomized Markov's inequality). Thus, Bell-Cover randomization is optimal for a specific competitive objective, at the cost of others.

Mon 28 SeptComputer Science and Game TheoryInformation Theory
The gist
The paper studies a way to improve statistical tests by randomizing betting amounts, inspired by a finance method that beats opponents half the time. The authors show this approach can outperform other methods in certain competitive settings but at a cost to the average success of the test. They also explain when and how randomizing bets helps or doesn't, especially when stopping tests early. This work clarifies trade-offs between maximizing test power and maintaining strong overall performance.
Open → 2609.35714v1

Learning conditional expectations without fixed bases using functional Newton updates

Learning Conditional Expectation Operators via Functional Newton Updates

Abstract: We introduce the Functional Spectral-Newton Method (FSNM) for learning the leading singular structure of a conditional expectation operator without fixing a basis or reproducing kernel Hilbert space. FSNM fits a low-rank representation of the centered joint-to-product density ratio kernel by alternating functional Newton updates. Each update reduces to a preconditioned regression, which we approximate with vector-valued regression trees in a stagewise boosting procedure. At the population level, we establish descent and an $O(1/T)$ best-iterate block-stationarity rate under a relative weak-learner accuracy condition, and show that every nondegenerate local minimum over the full centered $L^2$ spaces is a globally optimal rank-$d$ approximation. Synthetic experiments show that FSNM recovers a low-rank density ratio and its leading spectral structure, and that the same learned kernel can answer multiple conditional queries without refitting.

Mon 28 SeptMachine Learning
The gist
Predicting how one variable depends on another can be tricky when you want to find the main patterns efficiently. The authors came up with a new method called FSNM that learns these patterns without relying on preset building blocks or fixed frameworks. Their approach repeatedly improves its guesses through updates that solve easier problems, eventually finding a simple but accurate representation. Tests show this method can recover key structures and answer many related questions with the same learned model.
Open → 2609.35598v1

Agent comparisons often overcount independent evidence in evaluations

When Pair Count Is Not the Sample Size: What All-Pairs Agent Comparisons Estimate

Abstract: When an agent benchmark compares every pair of leaderboard entries, the number of comparisons can look much larger than the independent evidence behind them: A versus B and A versus C both reuse A. Whether this reuse affects inference depends on what the analysis is meant to describe. If the board and its outcomes are fixed, the all-pairs mean is an exact summary of those entries, and any interval must come from another declared source of randomness. If the entries are instead treated as iid draws from a population of future configurations and the pair rule is regular and nondegenerate, the same mean is an order-two U-statistic whose first-order uncertainty depends on the number of configurations, not the number of pairs. We use near ties as the running example, but the distinction extends to other symmetric pair summaries when their regularity conditions hold. We examine both interpretations using a fixed SWE-bench Verified snapshot and an exact binary model with known truth. On SWE-bench, intervals that accounted for shared configurations were more than twice as wide as a pair-iid reference that treated the pairs as independent. In the exact model, pair-iid coverage fell far below the nominal level when edges shared endpoints but remained near nominal for matched independent edges. Results on two other fixed leaderboards show that exact summaries also depend on which pairs are included and how they are weighted. An all-pairs analysis must therefore state what is fixed, what is sampled, and how it handles shared entries and pair aggregation.

Sat 26 SeptArtificial Intelligence
The gist
When comparing many agents by looking at every pair, it might seem like there is a lot of independent information. But because some agents appear in multiple pairs, the actual unique evidence is less than the number of pairs suggests. The authors show that if agents are seen as fixed, pairs summarize them exactly, but if agents are random samples from a larger group, uncertainty depends more on the number of agents than pairs. Their findings help clarify how to interpret comparison results, especially in leaderboards that rate agent performance.
Open → 2609.33012v1

Preordered semirings completed for better comparison of large powers

Asymptotic completions of preordered semirings

Abstract: The study of preordered semirings is motivated by applications in computer science, graph theory, and information theory, and provides tools for understanding the asymptotic preorder, which compares large powers of a pair of elements. This paper studies sequences which behave approximately as sequences of powers, but are not necessarily equivalent to geometric sequences. Our main result is that preordered semirings admit completions where such sequences, that we call approximately geometric, become equivalent to geometric sequences, and that existing characterizations of the asymptotic preorder extend to the completion. We provide several classes of examples of approximately geometric sequences in the semiring of tensors, and in the semiring of graphs. As a concrete application, we determine the strong converse exponent for binary hypothesis testing with composite Markov hypotheses.

Fri 25 SeptInformation Theory
The gist
The paper studies mathematical structures called preordered semirings, which help compare how elements grow when raised to high powers. The authors introduce a way to complete these structures so that sequences behaving like powers, even if not exact powers, can be treated similarly to true power sequences. This completion helps extend known methods for comparing these elements to more general cases. They give examples in areas like tensors and graphs, and show a practical use in statistical hypothesis testing.
Open → 2609.31021v1

Contraction analysis improves privacy for bounded data distributions

Contraction and Statistical Inference under Privacy for Uniformly Bounded Distributions

Abstract: We investigate $c$-interior pointwise maximal leakage (PML) as a tool for contraction analyses and disclosure control. Based on the strong adversarial threat models from maximal leakage, $c$-interior PML generalizes local differential privacy (LDP) to data-generating distributions with densities uniformly bounded away from zero by $c>0$. Viewing $c$-interior PML as an algebraic constraint on a kernel yields more flexible (and often tighter) contraction analyses than standard LDP. We provide tight bounds on the Dobrushin coefficient, and bound the contraction coefficient of the Hockeystick-divergence. We further derive strong data processing inequalities on $f$-divergences under $c$-interior PML constraints when the input distributions to the divergence are restricted to be in the $c$-interior. These results extend beyond the regime of pure LDP to cover a larger class of kernels, including, e.g., arbitrary stochastic matrices. We apply the results to minimax theory and provide asymptotically optimal strategies under $c$-interior PML constraints for binary hypothesis testing and mean estimation. The results show that disclosure control with PML allows analysts to reason about systems in a more differentiated manner: For example, it allows us to quantify the privacy leakage of deterministic systems, and can give precise adversarial guarantees with respect to arbitrary distributional assumptions. Interestingly, a recurring theme in the disclosure analyses is that if the privacy problem is relatively regular (if the density bound $c$ is large), private inference can be possible without incurring any additional cost in terms of sample complexity.

Wed 23 SeptInformation TheoryCryptography and Security
The gist
Protecting individual data while drawing statistical conclusions is hard, especially when privacy threats are strong. The authors study a privacy method called c-interior pointwise maximal leakage, which extends local differential privacy to cases where data values are never too close to zero. This approach allows better understanding of how data privacy changes through transformations and gives clear guarantees for tasks like hypothesis testing and estimating averages. Interestingly, when data is well-behaved, protecting privacy may not require more data than usual.
Open → 2609.28297v1

Wasserstein-Fisher-Rao gradient flows preserve log-concavity and speed convergence

Preservation of Log-Concavity and Convergence of Wasserstein-Fisher-Rao Gradient Flows

Abstract: We study the convergence of Wasserstein-Fisher-Rao (WFR) gradient flows for sampling from probability distributions known up to a normalisation constant. By combining Wasserstein transport with Fisher-Rao birth-death dynamics, WFR flows balance exploration and selection. These flows have been recognised as a promising mechanism to accelerate convergence beyond Langevin dynamics. We show that for a class of strongly log-concave target distributions satisfying additional curvature conditions, WFR flows preserve strong log-concavity, in contrast to Wasserstein flows which enjoy this property only in the Gaussian setting. Exploiting this result, we derive explicit non-asymptotic convergence rates for the symmetrised Kullback-Leibler divergence, without requiring a warm-start as required in current estimates. In particular, we show that the convergence rate decomposes additively into Wasserstein and Fisher-Rao contributions, thereby confirming a recent conjecture within this setting. These results provide refined convergence guarantees and further develop the theoretical foundations of WFR gradient flows for sampling and Bayesian inference.

Wed 16 SeptMachine Learning
The gist
Sampling from complex probability distributions is important for many applications but can be slow. The authors studied a method called Wasserstein-Fisher-Rao (WFR) gradient flows that mixes movement and birth-death dynamics to explore and select samples more effectively. They found that for certain well-behaved distributions, the WFR method keeps useful mathematical properties that other methods lose, which helps them show faster and more reliable convergence. This understanding helps improve algorithms for Bayesian inference and other sampling tasks.
Open → 2609.18118v1

Faster accurate sampling from complex data with warm start methods

Accelerated High-Accuracy Sampling from a Warm Start via the Proximal Bouncy Particle Sampler

Abstract: We study the problem of sampling from $μ(\mathrm{d}x)\propto e^{-V(x)}\,\mathrm{d}x$ on $\mathbb{R}^d$, where $V$ is $α$-strongly convex and $β$-smooth, and write $κ:=β/α$. We design and analyze the Proximal Bouncy Particle Sampler (Proximal BPS), a new sampler that combines ideas from the proximal sampler and the bouncy particle sampler. From a warm start initialization with $ O(1) $ Rényi divergence w.r.t. $μ$, Proximal BPS returns a sample whose law is $\varepsilon$-close to $μ$ in total variation distance using $\widetilde O(\sqrtκ\,d^{1/4} \,\mathrm{polylog}(1/\varepsilon))$ gradient queries in expectation.

Mon 7 SeptData Structures and AlgorithmsMachine Learning
The gist
When computers need to understand messy, high-dimensional data better, they often use a process called sampling from a probability distribution. This paper introduces a new way to do this faster and more accurately, especially when starting close to the solution. The authors combined two previous methods to create the Proximal Bouncy Particle Sampler, which requires fewer calculations to get a good sample. This can speed up many computational tasks that rely on sampling.
Open → 2609.06905v1