Skip to content

PosteriorBench: From Point Estimates to Posterior Matching in Evaluating Generative Inverse Solvers

Sep 2026 · 0 citations · 69 references
Computer Science

Abstract

Generative models are increasingly used to solve scientific inverse problems, but existing evaluations still focus primarily on whether a method can produce a single plausible reconstruction. This is insufficient for ill-posed problems, where multiple solutions may be consistent with the same sparse or noisy observations. In these settings, a method can achieve strong pointwise accuracy while still failing to capture the true posterior through mode collapse, overconfident uncertainty, or averaging incompatible solutions. We introduce PosteriorBench, a benchmark for evaluating the distributional accuracy of generative inverse solvers. PosteriorBench evaluates four physics-based inverse problems: Darcy flow inversion, Poisson source recovery, carbon capture and storage, and light transport material inference. For each task, we construct high-fidelity reference posteriors using computationally heavy but established procedures such as rejection sampling and Markov chain Monte Carlo, enabling direct assessment of whether solvers recover the full set of solutions rather than the single best sample. We pair these references with a five-metric posterior evaluation suite: posterior-mean error, posterior-standard-deviation error, maximum mean discrepancy, sliced Wasserstein distance, and radially averaged power-spectrum error. These metrics assess pointwise accuracy, marginal uncertainty, distributional alignment, and global frequency fidelity. The benchmark spans sparse sensing, low-resolution observations, nonlinear forward models, varying noise levels, and multimodal priors, with a unified pipeline for distribution matching and uncertainty quantification. Our experiments reveal substantial distribution-matching gaps across current solvers, while showing that neural operators improve resolution robustness, and guidance weights and generation noise are key to posterior-variance calibration.

View source

Similar papers

Preprint Sep 2026

SNaP: One-Step Posterior Sampling for Noisy Inverse Problems

SNaP is introduced, a one-step MeanFlow posterior sampler for linear inverse problems with Gaussian noise, which produces diverse, high-quality samples with one network evaluation per draw, 30 to 2250 $\times$ faster than iterative samplers.

Shirin Shoushtari, Edward P. Chandler, Xiao Shi et al. · 0 citations
#machine learning Preprint Sep 2026

Source Distribution Estimation by Posterior Averaging

Simulation-based science often requires a distribution over simulator parameters whose push-forward reproduces a set of real observations: this is the source distribution estimation (SDE) problem. Existing methods fit the source against a likelihood surrogate trained once from a fixed proposal prior. Their objective is...

Trung-Dung Hoang, Lisa M. Koch · 0 citations
#machine learning Conference Open access Sep 2026

Conditional Flow Matching for ML-Based Inverse Design Problems

Comparing CFM against conditional Diffusion and cGAN across structural and thermal benchmarks from EngiBench under matched downstream optimization conditions supports CFM as a competitive warm-start prior for engineering inverse design, substantially reducing inference cost relative to the evaluated Diffusion baseline...

Juliana Felder, Milad Habibi, Soheyl Massoudi et al. · 0 citations
Open access Sep 2026

Dynamic operator-guided flow matching: A generative physical inverse solver for arbitrary sparse observations

Solving ill-posed physical inverse problems under extremely sparse observations remains a fundamental engineering challenge. Conventional inversion frameworks require repeated, computationally prohibitive forward simulations. While deep learning-accelerated approaches (e.g., Diffusion Posterior Sampling) mitigate the...

Wei-Jie Yang, Zhang Xun, Si-Min Jiang · 0 citations
#machine learning Preprint Oct 2026

Flow Matching for Fast Posterior Sampling in Bayesian Inverse Problems

Sampling from the posterior is the central task of computational Bayesian inverse problems. The standard workhorse in Bayesian inference - Markov chain Monte Carlo (MCMC) - is sequential, yields correlated samples, and must be rerun for each observation. Conditional flow matching offers an amortized alternative: a tran...

Jan Blechschmidt, O. Ernst, Moritz Poguntke et al. · 0 citations
#machine learning Preprint Oct 2026

Twist Flow for Inverse Problems

In Bayesian inverse problems, posterior sampling requires generating samples that are consistent with given observations while capturing the range of plausible solutions. Direct conditional generative models introduce latent noise to model this ambiguity, but paired inverse-problem training can still encourage an almos...

Shi-Qin Zeng, Zi-Jun Deng, Felix J. Herrmann · 0 citations

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 7, 2026

Discovering the value of humanistic inquiry

Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.