Papers for

signal processing developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Complex valued network improves joint noise and channel estimation

CRFCAN: A Complex-Valued Cross-Domain Residual Network for Joint Channel and Phase Noise Estimation in Sub-THz OFDM Systems

Abstract: In sub-terahertz (sub-THz) communications, the coupling of ultra-wide bandwidth and severe phase noise (PN) impairments renders conventional joint channel and PN estimation highly complex and computationally prohibitive. To address this, we propose CRFCAN, a complex-valued residual FFT convolutional attention network designed for joint channel and PN estimation. Unlike existing deep learning schemes that rely on cascaded networks or hybrid frameworks combining neural networks with conventional iterative estimators, CRFCAN performs joint recovery in a truly end-to-end fashion through a physics-inspired cross-domain structure. Specifically, Fast Fourier Transform (FFT) and inverse FFT modules are embedded within residual groups to enable iterative feature interaction across the time and frequency domains, thereby capturing both frequency-selective fading and time-varying phase distortions. In addition, two dedicated residual blocks are introduced for complex feature extraction and multiplicative phase-distortion modeling, respectively. A physics-aware PN output tail with soft normalization is further employed to improve estimation stability while preserving the physical characteristics of the effective PN process. Simulation results demonstrate that CRFCAN significantly outperforms conventional algorithms and state-of-the-art deep learning models in terms of normalized mean square error (NMSE) and bit error rate (BER). Notably, CRFCAN achieves superior performance with single-shot, fixed-complexity inference and generalizes well to unseen PN models without fine-tuning, highlighting its robustness and practicality for sub-THz receivers.

Thu 10 SeptMachine Learning
The gist
Communication at very high frequencies, like sub-terahertz, faces big problems because signals quickly lose quality and random shifts called phase noise happen. The authors developed a new type of neural network called CRFCAN that processes signal data in both time and frequency domains simultaneously to better estimate these issues. This method works in one step, is faster than traditional methods, and adapts well to different types of noise without extra training. Their tests show their approach reduces errors and improves data decoding in these challenging signals.
Open 2609.12244v1

Machine learning models predict out of distribution data before failure

PLSP (Pre-hoc Liminal Space Profiling): OOD Prediction over Detection -- An Anticipatory Approach for Machine Learning Model Reliability

Abstract: Out-of-Distribution (OOD) data poses a significant threat to machine learning models, often leading to model failure during deployment. All existing OOD detection methods are post-hoc, relying on evaluation metrics such as accuracy and AUC-ROC during inference to indirectly assess the model's response to OOD data by measuring deviations. In contrast to existing approaches, the proposed work shifts the paradigm from OOD detection to OOD prediction by proposing a pre-hoc anticipatory framework called PLSP for OOD prediction. We make several key contributions: (a) a dataset-independent metric called the CREDibility Score (CREDS) is proposed for OOD prediction; (b) credibility curves are introduced to study the maximum credibility a model can attain; and (c) credibility heat maps (and volume under surface) are introduced to characterize pre-hoc model behavior across different datasets. This work provides a novel perspective on signal processing under distributional shifts. Experiments across multiple datasets demonstrate that the proposed metric serves as a valuable measure for improving the robustness of machine learning models toward OOD prediction.

Thu 10 SeptMachine LearningComputer Vision and Pattern Recognition
The gist
Machine learning models can fail when they encounter data unlike anything they were trained on, called out-of-distribution (OOD) data. Instead of spotting OOD data only after the fact, the authors propose a new way that predicts when such data will appear and how the model will behave. They introduce a new measure called the CREDibility Score that works across different datasets to estimate model reliability ahead of deployment. Their tests show this approach helps understand and prepare for these challenging situations better than existing methods.
Open 2609.12225v1

Stationary gaussian channel capacity achieved with optimal feedback scheme

Feedback Capacity of Stationary Gaussian Channels: An Optimal Schalkwijk-Kailath Scheme

Abstract: We consider channels with additive colored Gaussian noise and noiseless feedback. Kim's seminal work derived a stationary variational characterization of feedback capacity and further asserted that the capacity-achieving stationary input need not contain a feedback-independent Gaussian component. These results led to the construction of a simple coding scheme, based on the Schalkwijk--Kailath (SK) refinement principle, which was shown to be capacity-achieving. A recent note identified a gap in the proof of the feedback-independent component-removal assertion, thereby leaving the optimality of the SK scheme and subsequent results that rely on it incomplete. In this paper, we prove the component-removal assertion for channels with stationary Gaussian noise that has a rational power spectral density. Our proof uses a perturbation analysis of a convex optimization formulation of feedback capacity and, indeed, shows that every optimizer assigns zero power to the feedback-independent component. Using this stronger property, we construct from any optimizer an explicit SK coding scheme that achieves every rate below feedback capacity with doubly-exponentially decaying maximal error probability.

Thu 10 SeptInformation Theory
The gist
This paper solves a problem about how to send messages over noisy communication channels when you get perfect feedback. The authors prove that a certain straightforward way of encoding messages, based on an older technique called the Schalkwijk-Kailath scheme, indeed achieves the best possible transmission rate. They also show that you don’t need to waste power on sending parts of the message unrelated to feedback. This strengthens understanding of communication limits for channels that have certain types of noise.
Open 2609.12069v1

Time frequency framework improves lattice gkp quantum code analysis

A Time-Frequency Framework for GKP Codes

Abstract: We develop a time--frequency framework for lattice GKP codes in which ideal codewords are realized in the modulation space $M^\infty$ and identified, through a vector-valued Zak transform, with a finite logical fibre over the continuous syndrome torus. Multi-window Gabor analysis then represents the logical vector by a finite block of adjoint-lattice coefficients. We prove that the normalized block map is an isometry, obtain an explicit recovering projection, and derive stable logical reconstruction. We further construct normalizable GKP approximants as lattice-envelope Gabor multipliers and establish weak-$*$ convergence and asymptotically isometric encoding. Finally, we recover displacement syndromes from phase relations between translated coefficient blocks and quantify their stability under additive perturbations.

Wed 9 SeptInformation Theory
The gist
Quantum error correction helps protect quantum information, but designing and analyzing these codes can be complex. The authors created a new mathematical framework using time and frequency concepts to better understand certain quantum codes called lattice GKP codes. Their approach allows for stable reconstruction of logical quantum information and helps detect error syndromes more reliably. This could make it easier to work with these codes for future quantum technologies.
Open 2609.10802v1

Sum of squares method improves quantum message transmission bounds quickly

A Sum-of-Squares Hierarchy with Quadratic Convergence for Quantum Channel Coding

Abstract: Computing the optimal success probability for transmitting classical messages through a single use of a quantum channel is NP-hard, even for two messages. An existing semidefinite programming hierarchy based on symmetric extensions provides convergent upper bounds with an a priori error estimate that decays as the inverse square root of the extension level. In this work, we construct a Hermitian sum-of-squares hierarchy for an arbitrary number of messages and prove quadratic convergence in its level. The error bound is proportional to the advantage over random guessing. Our approach combines state-discrimination duality with positive polynomial kernels on products of spheres to construct feasible polynomial dual certificates. For binary messages, the resulting bounds give a multiplicative approximation from above of the trace-norm contraction coefficient.

Wed 9 SeptInformation Theory
The gist
Sending classical messages through a quantum channel can be very hard to do perfectly. The authors study how to estimate the best possible success rate for sending messages using a quantum channel. They develop a new mathematical method that gives better and faster approximations than earlier techniques. Their approach works for any number of messages and improves error rates significantly, especially compared to guessing randomly.
Open 2609.09629v1

Fisher information sets speed limits on learning in neural networks

Speed Limit for Information Acquisition in Stochastic Learning Dynamics

Abstract: Neural networks acquire internal representations through learning. In this work, we formulate stochastic gradient descent (SGD) as a Markovian stochastic process and derive a Fisher-information flow speed limit that bounds the rate at which trainable parameters can acquire information about latent variables in the data-generating process. The resulting inequality decomposes the information flow into drift and noise contributions, thereby quantifying the roles of deterministic learning forces and SGD-induced fluctuations from an information-theoretic perspective. We verify the bound in analytically tractable basis-function linear regression, where the information budget predicted by the bound reproduces the ordering and characteristic time scales with which different latent variables are encoded in the learned parameters. These results establish Fisher-information speed limits as a quantitative framework for diagnosing when and how different aspects of the data-generating mechanism are acquired during stochastic learning.

Tue 8 SeptMachine Learning
The gist
Learning in neural networks happens step-by-step and involves some randomness. The authors describe how fast these networks can gather information about hidden features in their training data by thinking of learning as a random process. They found a mathematical rule that limits the speed of information gain, which depends on the balance between steady learning forces and the noise from randomness. They checked their rule with simple models and found it correctly predicts how and when networks learn different hidden details.
Open 2609.08219v1