The p(parameter)-CSMC algorithm is proposed, which incorporates both parameter learning and ancestor sampling, leading to much better mixing properties compared to (particle) Gibbs sampling in settings where strong internal correlations may challenge effective exploration.
Abstract
In this work, we explore particle learning strategies for the joint estimation of static parameters and latent states within conditional sequential Monte Carlo (CSMC) algorithms. Building on this idea, we propose the p(parameter)-CSMC algorithm, which incorporates both parameter learning and ancestor sampling, leading to much better mixing properties compared to (particle) Gibbs sampling in settings where strong internal correlations may challenge effective exploration. We also include two applications in the context of a branching process model: one using synthetic data, where we estimate the infectivity profile while assuming the reproductive number to be known, and another using real data, where we address the joint inference of the reproductive number and the infectivity profile based on daily hospital incidence from the arrival of the SARS-CoV-2 lineage B.1.1.7 (Alpha) in Norway in February 2021. We show that, in these settings, performance is dramatically enhanced, with substantially faster mixing and markedly reduced autocorrelation compared with standard particle Gibbs.
Neural Optimal Particle Filters are introduced, which learn an amortized approximation to the optimal proposal from offline simulated one-step conditioning tuples, and improve sample efficiency and distributional accuracy over standard PF baselines with modest computational overhead.
As agents are deployed with increased autonomy, even extremely rare events along their stochastic output trajectories can occur and prove catastrophic. Safe deployment therefore does not depend on whether these events can occur, but on how often they might. We study the problem of estimating the probability of rare eve...
Han-Ming Yang, Daksh Mittal, Jing Dong et al.· 0 citations
A new paradigm that has recently emerged at the interface of machine learning and computational statistical physics: the use of generative models as tools for sampling through flexible probabilistic models that can assist the sampling of distributions known only up to a normalization constant is explored.
This work introduces an algorithm for learning Boltzmann distributions that does not require any true samples for training and establishes a new method for sample-free learning of complex physical distributions.
V. Kanaujia, Vipul Arora· Trans. Mach. Learn. Res.· 1 citation
It is demonstrated that the Markovian assumption can both hamper signal propagation during training and catastrophically reduce the learned sampler's expressivity due to state aliasing.
Tiago da Silva, Esmeralda S. Whitammer, S. Lahlou· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.