Efficient sampling from Bayesian posterior distributions in high dimensions remains a hard problem, despite advances in theory and algorithms. Multiple steps are usually required to draw unbiased samples, for example, iterations of an MCMC algorithm or integration steps in a diffusion-based amortised sampler. However,...
Vincent Pauline, Kirill Tamogashev, Arran Carter et al.· 0 citations
This work proposes Large Language Gibbs, a scheme for structured probabilistic inference that uses conditional distributions of an LLM as transition operators, and iteratively resample individual variables conditioned on others using an LLM's next-token conditionals to produce a stationary distribution.
Sanghyeok Choi, H. Gouk, Esmeralda S. Whitammer· arXiv.org· 0 citations
The teacher, an auxiliary behavior model, is trained to sample high-loss regions of the student and can generalize across unexplored modes, thereby enhancing mode coverage by providing an efficient training curriculum.
Minsu Kim, Sanghyeok Choi, Taeyoung Yun et al.· International Conference on...· 27 citations· ⚡6
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.