Renormalising Generative Models for Active Inference: Foundations, Derivations, and Verification

2026-08-10Artificial Intelligence

Artificial IntelligenceComputer Vision and Pattern Recognition
AI summary

The authors explain a method called renormalising generative models (RGMs) that helps make complex systems easier to understand by organizing information from small details to bigger ideas in space and time. They provide a clear, step-by-step explanation and a simple software version, making it easier for others to use and test these models. Their work helps clarify confusing parts of previous explanations and separates the ideas from specific software, so more people can explore and improve these models in machine learning.

active inferencerenormalising generative modelsdiscrete generative modelshierarchical modelscoarse-grainingbelief updatingmachine learningperceptionaction selectionspatial-temporal modeling
Authors
Karim Zaghw, Andrew Pashea, Marc Pritsch, Wouter Nuijten, Karl Friston, Lancelot Da Costa
Abstract
Active inference offers a unified framework for perception, learning, and action, but scaling discrete active-inference models to rich spatial and temporal domains remains difficult. Renormalising generative models (RGMs) address this challenge by composing discrete generative models across spatial and temporal scales, coarse-graining lower-level states and paths into higher-level causes for objects, events, and action. However, fully reproducing and adapting the framework remains difficult: the mathematical exposition is compact, and the reference implementations are deeply integrated within specialized software environments, leaving many algorithmic details implicit. This paper addresses these challenges by providing a self-contained, derivation-oriented account of RGMs together with an open, verified implementation. We explain how the hierarchy is built, how beliefs and actions are updated within it, and how information is passed between levels. Where the published equations and implementation differ in emphasis, we make those choices explicit and explain their modelling consequences. By clarifying the theory and separating it from its original implementation context, this work lowers practical barriers to entry and makes RGMs more transparent, auditable, and reproducible, providing a foundation for future quantitative evaluation and development on machine-learning benchmarks.