Papers for

particle accelerator operators

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Foundation model improves sensor data use for particle accelerators

SensOFormer: Foundation Models for Particle Accelerators

Abstract: Large-scale scientific facilities, such as particle accelerators, are complex systems composed of thousands of interacting components that must operate collectively to support diagnostics and control, and ensure safe, reliable operation. These facilities rely on extensive sensor networks that generate large volumes of heterogeneous, incomplete, and noisy telemetry, often sampled at different rates across subsystems. In this paper, we adopt the foundation-model paradigm to learn general-purpose sensor representations from historical accelerator data through self-supervised pretraining. We introduce SensOFormer, a denoising masked transformer with a Perceiver-style encoder-decoder architecture designed to handle variable sensor sets, accommodate heterogeneous sampling rates, and learn robust representations from noisy measurements. The model is pretrained on multiple particle-accelerator datasets and transferred to downstream tasks, including missing-data imputation, anomaly detection, cavity identification, and fault identification. Through extensive evaluations and comparisons, we demonstrate that a single self-supervised model can learn reusable representations for diverse operational tasks in large-scale scientific facilities. Project page: https://mahindrautela.github.io/sensoformer.

Sun 1 NovMachine Learning
The gist
Particle accelerators use many sensors that produce lots of noisy and incomplete data, making it hard to monitor and control the machines. The authors created SensOFormer, an AI model that learns from past sensor data to understand and clean this information. SensOFormer can work with different sets and speeds of sensors, and it helps with tasks like filling in missing data and detecting faults. They trained this model on several accelerator datasets and showed it can handle many problems using one general approach.
Open → 2611.02031v1

Seq-Flow improves forecast updates using fewer sampling steps

Seq-Flow: Efficient Probabilistic Forecasting with Self-Rollout Error Control

Abstract: Many scientific forecasting tasks require updating a distribution over future trajectories as new observations arrive. Conventional diffusion and flow models generate each forecast from Gaussian noise, often at the cost of many sampling steps. Warm-start methods reuse earlier predictions to reduce this cost, but their models are not trained to perform the forecast update itself, which can compromise quality under few-step sampling. In this work, we introduce Seq-Flow, a conditional flow model whose ODE transports samples from the previous forecast distribution to the updated one. Because successive forecasts often differ only modestly, this transport starts from an informative distribution and can produce accurate updates with few flow evaluations. Recursive reuse also creates a challenge: errors in one forecast become errors in the initial states of subsequent flows. We address this with self-rollout training, in which a moving average copy of the model generates forecasts that initialize later training updates. Unlike self-forcing methods, which reuse generated outputs as conditioning context, Seq-Flow reuses them as the source of the next flow. Experiments On particle-accelerator beam spill forecasting show Seq-Flow reduces CRPS by 65% under a few-NFE sampling budget, while remaining competitive with strong baselines on fluid-dynamics forecasting tasks. Although trained on self-rollouts of at most four updates, Seq-Flow remains accurate over more than 400 consecutive updates. Our code is available at https://github.com/Graph-COM/Seq-Flow.

Wed 7 OctMachine Learning
The gist
Forecasting how something will change over time can be hard because predictions often need to be updated with new information. The authors propose Seq-Flow, a method that improves these updates by transforming old predictions into new ones directly, making it faster and more accurate when only a few update steps are used. They also developed a training approach that helps the method avoid building up errors over many updates. Experiments show Seq-Flow can give better predictions in scientific tasks like particle accelerator and fluid dynamics forecasting, even when making hundreds of updates.
Open → 2610.10440v1