Papers for

data scientists in finance

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Nonasymptotic error bounds for conformalized quantile regression under covariate shift

Conformalized Quantile Regression and Minimax Limits of Fixed-Score Calibration under Known Covariate Shift

Abstract: In this paper, we study nonasymptotic $L^p$ error bounds for interval length and conditional coverage in split conformalized quantile regression (CQR). Our bounds rely on local regularity conditions and accuracy guarantees for the estimated quantiles. We further instantiate our bounds for quantile regression with sparse ReLU neural networks. We also consider covariate shift, where the calibration and test covariates have different distributions, and derive nonasymptotic bounds for this setting. We obtain matching minimax upper and lower bounds in expectation for two constructed fixed-score calibration benchmarks under known covariate shift. The bounds match for every $p\in[1,\infty]$ in the scalar problem and for finite $p$ in the $K$-threshold problem; for the latter, a high-probability minimax lower bound holds for every $p\in[1,\infty]$.

Mon 21 SeptMachine Learning
The gist
Predicting accurate ranges for future events based on data is tricky when conditions change between training and testing. The authors studied how well a method called conformalized quantile regression works when the data used to adjust the method differs from the data where predictions happen. They provided detailed mathematical limits on the errors in these predictions, even when relying on neural networks. Their work helps understand how reliable these prediction intervals are under different conditions.
Open 2609.24929v1

Low-rank classifiers limit noise influence under adversarial attacks

Tail-Weight Control and Localized Generalization in Nearly Low-Rank Adversarial Classification

Abstract: We study norm-constrained linear classification under Eu clidean adversarial perturbations in a Gaussian model with a low-dimen sional informative subspace and an independent noise tail. For bounded ramp loss, we prove that a principal-space witness with risk below one half forces every near-optimal predictor to have small tail weight. A path-specific density bound yields constants without requiring positive tail variance. Under isotropic principal covariance, we establish a unique population minimizer and joint local growth. Boundary normalization then removes the common attack penalty from centered margins, giving localized finite-sample guarantees governed by principal dimension and total tail energy. Globalized growth removes the entrance condition at weaker constants; a model-aware comparison retains local guarantees. Experiments with twenty paired repetitions show decreasing excess risk and tail use with sample size, and nearly unchanged behavior when tail dimension grows at fixed total energy. Pure-noise controls and optimizer diagnostics clarify the scope and limitations of these conclusions.

Sun 20 SeptMachine LearningArtificial Intelligence
The gist
This paper looks at how machine learning classifiers that use only a few important features handle attacks that try to fool them by changing inputs slightly. The authors show mathematically and with experiments that good classifiers tend to ignore noisy features and focus on important ones. They prove that under specific conditions, these classifiers keep their accuracy even when bad data tries to trick them. Their work helps understand why and when classifiers resist certain attacks and how sample size or number of noisy features affects this.
Open 2609.23688v1

Aggregated posterior sampling improves data generation realism

Aggregated Posterior Predictive Checks for Generative Modeling

Abstract: Latent variable generative models are commonly fit using simple priors over latent variables, but draws from these priors often fail to produce realistic data. This failure is due to a mismatch between the prior and the aggregated posterior, the distribution of latent variables induced by the fitted model and the data. This mismatch is often viewed as evidence that the prior is misspecified and should be replaced. Alternatively, in modern generative models, a two-stage strategy is increasingly used where first, the model is fit, and second, the aggregated posterior is estimated (van den Oord et al.,2017; Rombach et al., 2022.). Synthetic data are then obtained by sampling from this aggregated posterior instead of the prior. To check such procedures, we introduce the aggregated posterior predictive check (APPC). Theoretically, we establish sufficient conditions under which the APPC is asymptotically calibrated. For probabilistic principal component analysis, we show that the APPC can remain calibrated under a misspecified latent prior when pervasive factors permit recovery of the signal space. Experiments with variational autoencoders show that aggregated posterior sampling improves generation for heavy-tailed and clustered data relative to Gaussian prior sampling while performing comparably to models with more flexible latent priors.

Thu 17 SeptMachine Learning
The gist
Generative models try to create realistic data by learning from examples, but they often use simple assumptions that make the generated data look unrealistic. The authors study a method that samples from a more accurate distribution of hidden factors learned by the model, rather than from the simple initial assumptions. They introduce a way to check if this improved sampling method works well and confirm it behaves as expected under certain conditions. Their tests show this approach makes generated data look better for complex types of data without needing more complicated assumptions beforehand.
Open 2609.20999v1