Cascading short forecasts helps predict complex flows from coarse data

Generative Forecasting from Coarse-Grained Observations: When Does Cascading Help?

Machine Learning

Summary

Predicting how things like fluids or waves move can be tricky when you only see rough or coarse data because the hidden small details affect the future. The authors made new test data sets showing many possible detailed versions of the future from a single coarse start. They found that common forecasting methods often get the full range of outcomes wrong. Breaking a forecast into many small steps, called cascading, often improves predictions but sometimes makes them worse depending on the problem. They also developed a simple math model to explain when cascading helps or hurts.

What this means in practice

  • For climate modelers: Improve uncertainty estimates in weather and climate simulations by better representing fine-scale variability from coarse measurements.
  • For computational fluid dynamics engineers: Use cascading short-term forecasts to better capture the range of possible fluid flow behaviors when only low-resolution data is available.

Tested on simulated data.

Authors

Alexandra Spitzer, Giovanni Abati, Lorenzo Baldassari, Till Muser, Cheng Shi, Ivan Dokmanić

Abstract

We study probabilistic forecasting of dynamical systems such as fluids and waves from coarse observations. Since the unseen fine scales influence the dynamics, the same coarse initial state can evolve into a whole distribution of futures. Generative forecasters may produce visually plausible samples, but it is hard to tell whether they sample the right conditional distribution, since trajectory data contain a single future for each initial state. We address this problem by generating reference data in a hierarchical way: for each coarse initial state, we generate many different fine-scale components and numerically evolve the full states. Using these conditional ensembles, we show that standard diffusion models and stochastic interpolants make substantial distributional errors. We then show that cascading shorter forecasts greatly reduces these errors for the turbulent flows and waves we study, but we also find and characterize cases in which it hurts. Since the coarse process is not Markov, cascading discards information about the unresolved fine scales even with exact transitions. To understand this, we propose a solvable analytic model which shows that the optimal cascade depth decreases as the coupling between the unresolved and observed scales gets stronger, and increases as the dependence of the forecast on the observation becomes more oscillatory. Consistent with our experiments, cascading is detrimental when the direct forecast is ``easy'' to learn, for example Gaussian as in the passive scalar case. We release our datasets as a first benchmark for probabilistic forecasting with ground-truth conditional ensembles.