Improving high-resolution future weather forecasts with low-rank adaptation
PROLA: Principal-Orthogonal Low-rank Adaptation for Predictive Spatiotemporal Weather Downscaling
Machine LearningArtificial Intelligence
Summary
Predicting detailed, high-resolution weather in the future is hard when starting from rough, low-resolution weather data. The paper’s authors created a new way to improve these forecasts by breaking down the problem into spatial and temporal parts, using an existing weather model with small, smart adjustments. Their method, called PROLA, changes only a small part of the model’s settings but does so more effectively by focusing on key directions. Tests show this approach works better than other techniques for improving weather forecasts, and it might help in other areas too.
What this means in practice
- •For weather forecasting teams: Produce more accurate high-resolution future weather maps by refining coarse global forecasts efficiently using pretrained backbones with PROLA adaptation.
- •For climate simulation engineers: Improve spatial and temporal resolution in climate or atmospheric simulations using PROLA for adapting large pretrained weather models with limited new training.
Authors
Minseo Yoon, Minseong Bae, Sojin Lee, Hyunwoo J. Kim
Abstract
High-resolution weather prediction is important for resolving local atmospheric patterns missed by coarse global forecasts. Large pretrained weather backbones have improved global forecasting, but adapting them to produce future high-resolution fields from recent coarse states remains challenging and costly. We formulate this setting as Predictive Spatiotemporal Weather Downscaling (PSWD), a task that jointly refines spatial and temporal resolution while predicting future high-resolution trajectories. To this end, we propose a framework that decomposes prediction into spatial and temporal stages using a shared pretrained backbone, fixed numerical scaffolds, and lightweight residual heads. For backbone adaptation, we introduce PROLA (PRincipal-Orthogonal Low-rank Adaptation), which allocates a fixed low-rank budget between pretrained weights' principal directions and their orthogonal complement. PROLA further rescales rank-1 optimizer updates using gradient signals, improving adaptation without increasing trainable rank. Experiments in the PSWD setting show that PROLA outperforms representative low-rank adaptation baselines. Further experiments across diverse datasets and tasks support the broader applicability of PROLA, showing that its benefits extend beyond the primary weather downscaling setting.