Skip to content

Information Spreading in Diffusion Models from Effective Field Theory

Aug 2026 · 0 citations · 24 references
Physics Computer Science

TL;DR

It is argued that the inductive bias of locality means that the machinery of effective field theory from physics can be usefully applied to describe the denoising dynamics of Brownian motion.

Abstract

We study score-matching diffusion models with a convolutional architecture. We argue that the inductive bias of locality means that the machinery of effective field theory from physics can be usefully applied to describe the denoising dynamics. We apply this formalism first to a simple toy example which permits an analytical description, and thereafter to MNIST, and show that in both cases, the mutual information between two points grows in a manner predicted by a simple effective field theory of Brownian motion.

View source

Similar papers

Preprint Aug 2026

Jump-Diffusion Stochastic Quantization for Euclidean Lattice Field Theories

We construct the natural generalization of stochastic quantization (in the Markovian sense) by considering jump-diffusion processes. This class of stochastic processes exhibits non-continuous paths, so-called L\'evy flights. In the presence of jumps, action landscapes with barriers can be efficiently explored, improvin...

A. Rothkopf · 0 citations
Preprint Aug 2026

Microscopic derivation of a field equation for active Brownian particles

To understand the phenomena displayed in active phase separation, general top-down theories like Active Model B+ (AMB+) add fluxes that break time reversal symmetry. Starting from an Enskog-like kinetic theory of hard-core active Brownian particles in the high persistence regime, we derive AMB+ from first principles. F...

Martín Pinto-Goldberg, Rodrigo Soto · 1 citation
Preprint Aug 2026

Propagation of Chaos and Gaussian Fluctuations for Mean-field Coupled Maps

We study a class of discrete-time interacting particle systems arising from mean-field coupled maps. We establish a Dobrushin-type estimate, a relative entropy estimate and Central Limit Theorem (CLT) type results for this class of systems. First we control the growth of the 1-Wasserstein distance between the empirical...

Ruilai Cheng · 0 citations
Preprint Aug 2026

Persistent anisotropy in multi-dimensional branching Brownian motion

We study angular variation in the frontier of branching Brownian motion (BBM) in multiple dimensions. The time average of this frontier is tied to the long-time limit of the critical derivative martingale, which is a random integrable function on the sphere. We show that this function is nowhere locally bounded. As a c...

Cole Graham, L. Mytnik, L. Ryzhik · 0 citations
#machine learning Preprint Aug 2026

Simulation-free and finite-time diffusion model

A framework for designing the reference process that achieves tractable time-dependent conditional distributions and then construct the reference process realizing them as its marginals is proposed, revealing that score matching is not fundamental to diffusion-model training but instead emerges naturally through revers...

Kentaro Kaba, Masayuki Ohzeki, Yuki Sughiyama · 0 citations

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.