Observation assimilation transformer improves weather forecasts from sparse stations
Observation Assimilation Transformer: Probabilistic Weather Analysis from Sparse Station Observations
Machine Learning
Summary
Weather forecasts use data from many weather stations, but sometimes these observations are few and spread out. The authors created the Observation Assimilation Transformer (OAT), a model that improves weather predictions by smartly combining weather data and prior forecast information. It can make detailed, location-specific predictions even where there are no direct observations. Tests showed OAT gives more accurate and reliable weather details, for example turning coarse weather data into finer, more precise forecasts.
What this means in practice
- •For weather forecasting teams: Generate higher-resolution weather analyses by combining sparse station observations with existing coarse forecasts using OAT.
- •For climate modelers: Refine continental-scale climate datasets with OAT to improve regional climate insights from sparse measurement networks.
Authors
Christian Donner, Michele Cattaneo, Maxim Samarin, Francesco Zanetta, Icíar Lloréns Jover, Garbiela Aznar Siguan, Michele Volpi
Abstract
We present the Observation Assimilation Transformer (OAT), a geometry-aware neural process that corrects and refines a prior numerical weather prediction (NWP) field into a high-resolution posterior field by assimilating sparse observations. OAT is an encoder-decoder transformer that considers a set of observed locations and their NWP prior to condition predictions at a set of arbitrary unobserved query locations. Its sparse attention mechanism makes it scalable to thousands of station observations and depends on relative positions between locations, never on the absolute coordinates. The model allows for partially missing observations, predictions at arbitrary continuous locations without grid projection, and outputs are parametric distributions. A station-randomized training algorithm is developed with continuous ranked probability score (CRPS) loss. We test OAT on two datasets - one at regional scale with hundreds of stations, and one at continental scale with thousands of stations. On these datasets OAT outperforms several baselines and shows well calibrated predictions. In an illustrative case study, OAT's downscaling capabilities are demonstrated by downscaling ERA5 (~31km) to COSMO (1km), where OAT achieves lower mean absolute error (MAE) and CRPS for temperature and precipitation on test stations compared to COSMO.