Papers for

climate data platform builders

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

AI weather models reveal forecast steps through intermediate decoding

Interpretability of AI weather models via intermediate decoding

Abstract: AI weather prediction models are often regarded as black boxes. Despite their impressive skill, there is little understanding of how the input data is processed during inference to produce the forecast. This limitation arises from the use of high-dimensional latent representations in which individual dimensions are no longer directly interpretable in physical terms. To gain insight into how forecasts are constructed, we propose the method of intermediate decoding for AI weather models and apply it to GraphCast, Aurora and ArchesWeather. In this approach, latent states from intermediate depths are decoded back into meteorological fields. To do this, we use the decoder that has been trained to output the forecast at the end of processing. Since latent states at different depths do not share a consistent basis, we train affine transformations that align intermediate latent states with the decoder's expected input space. Applying this framework to the three models yields the following results. First, the skill of forecasts at intermediate stages of processing improves gradually through the processor layers. Second, bypassing all processor blocks shows that the encoder-decoder pair is not an identity mapping returning the input, but instead plays a significant role in the forecast construction. Third, by examining increments of individual processor blocks across model depth, we show that all three models progressively refine the forecast from coarse to finer spatial scales. Finally, we assess the physical consistency of the intermediate decoding forecasts and find that large scales remain physically balanced throughout processing, while small scales become more balanced with each additional processor block.

Fri 16 OctMachine Learning
The gist
AI weather models are usually like black boxes, making it hard to understand how they produce forecasts. The authors studied three such models by decoding signals inside the AI at different steps to see how the forecast is gradually formed. They found that the forecast improves step-by-step, starting from broad weather patterns and becoming more detailed. Also, the models keep large-scale weather patterns physically consistent throughout the process while refining smaller details progressively.
Open → 2610.24110v1