Skip to content
Preprint

Optimal Scaling of Langevin Proposals with Generalized Acceptance Rules

Sep 2026 · 0 citations · 31 references
Mathematics

Abstract

Langevin-based Markov chain Monte Carlo (MCMC) algorithms use gradient information to improve sampling, particularly in high dimensions. Classical optimal scaling theory for these algorithms has largely focused on the Metropolis-Hastings (MH) acceptance rule. However, there has been a recent surge in acceptance rules beyond MH for applications spanning differential privacy, stochastic MCMC, diffusion models, and molecular dynamics. We develop optimal scaling results for Langevin proposals employed with generalized acceptance rules belonging to a suitable class. For high-dimensional targets, we recover the usual $O(d^{-1/3})$ scaling, while different acceptance rules lead to different optimal acceptance probabilities.

View source

Similar papers

Preprint Oct 2026

Locally adaptive step sizes for Hamiltonian Monte Carlo methods

Exact reversible locally adaptive step sizes are introduced by Bou-Rabee et al. (2026) in the context of the No-U-Turn Hamiltonian Monte Carlo (HMC) sampler for the purpose of high performance HMC sampling in challenging target distributions. This paper carefully explains and illustrates the locally adaptive step size...

Jimmy Huy Tran, Tore Selland Kleppe, Nawaf Bou-Rabee · 0 citations
Preprint Oct 2026

Anchored Reversible Jump Sequential Monte Carlo

Reversible Jump Markov Chain Monte Carlo (RJMCMC) is a principled framework for Bayesian model comparison, but its practical use is often limited due to the difficulty of designing between-model proposals that reach regions of high posterior probability. In addition, its inherently sequential nature limits efficient us...

Jan Jaap R. van Assen, Max Hinne · 0 citations
#machine learning Preprint Sep 2026

HyperMC: Multi-Fidelity Hyperparameter Tuning for Stochastic Gradient MCMC

Experiments on logistic regression, probabilistic matrix factorization, and Bayesian neural networks show that HyperMC improves posterior approximation or predictive calibration relative to MAMBA, grid search, and heuristic baselines, while Robust HyperMC yields more stable and reproducible tuning results.

Min-Chin Tan, Xi-Yun Jiao · 0 citations
Preprint Oct 2026

Optimal sampling strategies in event-chain Monte Carlo

Event-chain Monte Carlo (ECMC) has revolutionised computational sampling over recent years, providing a powerful alternative to the molecular-dynamics (MD) and Hamiltonian Monte Carlo (HMC) algorithms. Each method outperforms the ubiquitous random-walk Metropolis algorithm by advancing particles along deterministic tra...

James Gulliford, Gareth O. Roberts, Michael F. Faulkner · 0 citations
Preprint Oct 2026

Convergence of Independence Metropolis-Hastings Algorithms in High Dimensions: Iteration Lengths, Cutoff Profiles, and Diagnostic Unreliability

We characterize the high-dimensional convergence of the arithmetic mean from the independence Metropolis-Hastings algorithm initialized at its proposal. Convergence is measured in the worst-case expected absolute error over bounded functions. We prove necessary and sufficient conditions for the mean to converge in rela...

Austin Brown · 0 citations
Open access Sep 2026

Nii-MALA: A Fast Metropolis-Adjusted Langevin Sampler with Radial Velocity Benchmarks

Nii-MALA is introduced, a high-performance C implementation of the Metropolis-Adjusted Langevin Algorithm, which leverages Message Passing Interface for parallelization and incorporates automatic differentiation backends for gradient evaluation and benchmark it against several other codes using radial velocity data fro...

Jia-Men Jiao, Sheng Jin, Wen-Xin Jiang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.