Generative model reduces error in estimating missing scientific data steps
Generative Refinement Learning for Temporal Interpolation in Scientific Machine Learning
Machine LearningArtificial Intelligence
Summary
Some scientific data come at slow speeds, so we don’t see what happens in between moments. The authors created a method called iFLEX to better guess what the data looks like in these missing times. Their method starts with a simple guess based on nearby moments and then uses a special AI model to improve that guess by learning the difference between the guess and true data. This approach works better than older methods when tested on things like weather and fluid flow data.
What this means in practice
- •For weather forecasting teams: Improve the precision of short-term weather data by generating accurate intermediate states between slow radar observations.
- •For ocean monitoring groups: Generate more precise estimates of sea surface temperature changes at times without direct measurements for better analysis of ocean conditions.
Authors
Pu Ren, Michael W. Mahoney, N. Benjamin Erichson
Abstract
Computationally expensive simulations and real-world observations often provide data at a lower temporal resolution than downstream tasks require. Averaging observations at fixed grid points can introduce errors, and motion estimates alone do not determine how the physical field values change. In this work, we study whether learning to correct a simple numerical interpolation improves the reconstruction of intermediate scientific fields. Our model, interpolative FLow EXpert (iFLEX), first estimates the missing field by taking a weighted average of the two observations at each grid point, giving more weight to the observation closer to the requested time. During training, subtracting this estimate from an observed intermediate field gives the residual that a conditional diffusion model learns to generate. Both observations condition the model, together with the target time, the interval between observations, and available physical parameters. To reconstruct an unobserved intermediate field, the generated residual is added to the weighted average. We evaluate iFLEX on Navier-Stokes Kraichnan turbulence, Shanghai radar precipitation, and sea surface temperature. Across these datasets, iFLEX achieves lower reconstruction error than the evaluated baselines, including optical-flow and diffusion models developed for video frame interpolation in computer vision. In a controlled turbulence comparison at a Reynolds number of 36,000, learning the residual reduces relative Frobenius norm error from about 13.7 for direct field generation to 10.5, with the diffusion backbone and training setup held fixed. Code is available at https://github.com/paulpuren/iflex.