Physxai detects weather model outputs that break physical laws
PhysXAI: A Theoretical Framework for Diagnosing Physical Hallucinations in Weather Foundation Models
Machine Learning
Summary
Weather forecasting AI models can make impressively accurate predictions, but sometimes their forecasts contain impossible results that break basic physics rules like mass conservation. The authors call these mistakes physical hallucinations. They created PhysXAI, a system that spots these errors by comparing forecast outputs against physical laws and highlighting where and why the model went wrong. This tool helps make weather AI forecasts more trustworthy by showing exactly what physics rules were broken and how certain the system is about its diagnosis.
What this means in practice
- •For weather forecast engineers: Integrate PhysXAI to diagnose when AI weather forecasts produce physically impossible results and improve model reliability.
- •For climate model developers: Use PhysXAI to identify and categorize physical inconsistencies in large-scale climate simulations for more accurate scientific studies.
Authors
Anjan Mahapatra, Nikhil Raj
Abstract
Modern machine learning models for global weather forecasting achieve remarkable predictive accuracy, yet they frequently produce states that violate fundamental physical laws, including conservation of mass, hydrostatic balance, or spectral energy scaling. We term these outputs physical hallucinations and propose PhysXAI, a rigorous diagnostic framework that detects, localises, and attributes such inconsistencies. Unlike existing post-hoc metric suites, PhysXAI is a learnable system that explicitly decouples forecast error from physical plausibility. We formalise the problem through a novel joint condition on numerical and physical residuals, and introduce a multi-branch encoder that extracts representations from conservation, dynamical, spectral, cross-variable, and spatiotemporal residuals. A key innovation is a physics-consistency contrastive learning objective, which we theoretically show the latent representation to be approximately isometric to the physical residual space, ensuring that diagnostic decisions remain grounded in physically meaningful deviations. We further derive an adaptive multi-objective loss with gradient-based weighting to balance competing diagnostic objectives. The framework produces spatially resolved hallucination maps, violation-type classifications, and calibrated Bayesian uncertainty, enabling both detection and interpretable attribution of physical inconsistencies. We conduct a comprehensive comparative evaluation of PhysXAI across ERA5, WeatherBench 2, and MERRA-2, using forecasts from GraphCast, Pangu-Weather, and NeuralGCM, with Python-written code and a fully reproducible experimental protocol. Our theoretical analysis and empirical evaluation establish PhysXAI as a principled framework for diagnosing physical hallucinations and advancing trustworthy AI for weather forecasting.