Papers for

statistical machine learning engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Conformal test martingales have blind spots for some data shifts

Information-Geometric Blind Spots of Conformal Test Martingales

Abstract: Conformal test martingales (CTMs) are e-processes for sequentially testing exchangeability via p-values produced by a conformity function $A$. However, any distribution shift that preserves the push-forward $P\circ A^{-1}$ leaves the p-value distribution invariant, rendering it invisible to every CTM based on $A$. We formalise this blind spot through the \emph{$A$-equivalence class} $[P]_A$ and show that, for any target distribution $T$, there is a unique closest element $Q^\ast\in[P]_A$ in KL divergence---the \emph{$A$-cryptic I-projection}---with explicit density $q^\ast(z) = t(z)\,p_S(A(z))/t_S(A(z))$ and a Pythagorean decomposition into detectable and cryptic components. When $A$ is the Neyman-Pearson likelihood ratio, the cryptic component vanishes, connecting our result to optimal e-value design. We demonstrate the theory on high-dimensional image data by empirically constructing this I-projection. By conditionally resampling EMNIST letters to identically match the conformity scores of MNIST digits, we demonstrate that a distribution can be shifted to a disjoint support while leaving the test martingale mathematically blinded.

Fri 16 OctMachine Learning
The gist
This paper shows that a certain statistical method called conformal test martingales, used to detect changes in data streams, can fail to notice some types of shifts in data. The authors explain that if the method's scoring function produces the same output distributions for two different data sources, then the test cannot tell them apart. They mathematically characterize these invisible shifts and demonstrate with image data that a data distribution can change drastically without being detected by these tests. This helps us understand the limitations of current methods in detecting some kinds of changes in data.
Open → 2610.23131v1

Finite graph shapes determine sharp growth of random matrix norms

Sharp Norms from Finite Structure: Graph Matrices and Structured Chaoses

Abstract: Graph matrices encode dependencies in random matrices built from shared random variables and arise in spectral algorithms, sum-of-squares (SoS), and high-dimensional statistics. We determine how finite graph structure controls their sharp spectral growth. For every fixed simple graph shape in the dense Rademacher model, including overlapping or empty matrix boundaries, we prove $\mathbb E\|M_α\|=Θ_α(n^{(v+h-s)/2}(\log n)^{a_*/2})$, where $v$ counts vertices, $h$ isolated summation vertices, $s$ the minimum boundary-separator size, and $a_*$ maximizes an active-component count over minimum separators. Thus two finite cut optimizations determine both the polynomial and logarithmic exponents. The formula closes the polylogarithmic gap in separator bounds, and an infinite family with identical coarse parameters but different norms shows that the logarithmic exponent records genuinely new structure. The proof controls all defect layers in growing trace moments by converting label loss into separator excess; conditional flattening and synchronized fluctuations yield matching lower bounds. We extend the analysis to specified independent-factor chaoses, local weights, unequal dimensions, bounded asymmetric noise, Gaussian inputs, and fixed-degree Hermite inputs. Applications include degree-four clique SoS feasibility for $9\le k\le c\sqrt n$ without an asymptotic logarithmic loss, and Gaussian random tensor networks: deviation thresholds, sharp expected scales, entropy estimates, and, for connected loopless equal-dimensional networks, convergence of the rescaled largest output eigenvalue to the exact right edge of the limiting law. These results connect finite structure to sharp growth scales, and additional algebraic and spectral structure to full feasibility and exact limiting constants.

Sun 13 SeptData Structures and Algorithms
The gist
Predicting the size of certain large random matrices is hard because their entries depend on shared random values linked by graphs. This paper shows exactly how the shape of these graphs controls the expected size of the largest value in these matrices. The authors provide a precise formula that accounts for both polynomial and logarithmic factors based on the graph’s structure, resolving previous uncertainties. They also extend their results to more general settings and apply them to problems in statistics and tensor networks.
Open → 2609.14266v1