Markov chains produce work only with non-Gaussian models in Bayesian inference
Thermodynamic Cyclic Processes with Markov Samplers in Bayesian Inference
Artificial Intelligence
Summary
The paper looks at Bayesian inference—the process computers use to make decisions based on data—and draws an analogy to heat engines that do cycles. The authors develop a way to run Markov chain Monte Carlo cycles by tuning parameters during sampling. They find that these cycles can produce a measurable effect, or "work," only when the statistical model is non-Gaussian, meaning it doesn't follow the simple bell curve. This discovery offers a way to tell if data or models are non-Gaussian, tested on a cosmology example with supernova data.
What this means in practice
- •For statistical modelers: Detect non-Gaussian behavior in complex Bayesian models using thermodynamic MCMC cycle outputs.
- •For cosmology data analysts: Assess non-Gaussian features in cosmological data sets like supernova observations to better understand astrophysical phenomena.
Tested on one dataset.
Authors
Heinrich von Campe, Bjoern Malte Schaefer
Abstract
The concept of Markov chain Monte Carlo (MCMC) cycles, an analogy to cyclic processes in heat engines, is presented in order to examine Bayesian inference problems. In this effort, we develop adaptive ensemble schedulers that allow the tuning of external parameters of a Bayesian canonical ensemble during an MCMC run, realising the MCMC cycles in practice. We run these cycles on different statistical models. As a fundamental insight, we find (both theoretically and in practice) that such systems can produce a non-zero net work output if and only if the considered model is non-Gaussian. As such, they may serve as a measure of non-Gaussianity in Bayesian inference, which we test on an example from supernova cosmology.