Annealed importance sampling

  title={Annealed importance sampling},
  author={Radford M. Neal},
  journal={Statistics and Computing},
Simulated annealing—moving from a tractable distribution to a distribution of interest via a sequence of intermediate distributions—has traditionally been used as an inexact method of handling isolated modes in Markov chain samplers. [] Key Method The Markov chain aspect allows this method to perform acceptably even for high-dimensional problems, where finding good importance sampling distributions would otherwise be very difficult, while the use of importance weights ensures that the estimates found…
Importance tempering
A new optimal method for combining multiple IS estimators is derived and it is proved that the resulting estimator has a highly desirable property related to the notion of effective sample size.
Importance Sampling Schemes for Evidence Approximation in Mixture Models
Two importance sampling schemes are proposed through choices for the importance function; a MLE proposal and a Rao-Blackwellised importance function, called dual importance sampling, which is demonstrated to be a valid estimator of the evidence and to increase the statistical efficiency of estimates.
Annealed Importance Sampling (AIS) is one of the most effective methods for marginal likelihood estimation. It relies on a sequence of distributions interpolating between a tractable initial
Importance sampling type correction of Markov chain Monte Carlo and exact approximations
This work uses an importance sampling (IS) type correction of approximate Markov chain Monte Carlo (MCMC) output in order to provide consistent estimators and proves strong consistency of the suggested estimators under mild assumptions, and provides central limit theorems with expressions for asymptotic variances.
Revisiting the balance heuristic for estimating normalising constants
The focus of this work lies within the previous context, exploring some improvements and variations of the balance heuristic via a novel extended-space representation of the estimator, leading to straightforward annealing schemes for variance reduction purposes.
An Implementation of the Annealed Importance Sampling Algorithm for Model Comparison by
The Annealed Importance Sampling algorithm for estimating marginal likelihoods, which is a vital task in model comparison, has been implemented and can be installed as an additional plugin for BioBayes.
Simulated Tempering Langevin Monte Carlo II: An Improved Proof using Soft Markov Chain Decomposition
This work combines Langevin diffusion with simulated tempering to create a Markov chain that mixes more rapidly by transitioning between different temperatures of the distribution, and introduces novel techniques for proving spectral gaps based on decomposing the action of the generator of the diffusion.
Stochastic Gradient Annealed Importance Sampling for Efficient Online Marginal Likelihood Estimation †
The resulting stochastic gradient annealed importance sampling (SGAIS) technique enables us to estimate the marginal likelihood of a number of models considerably faster than traditional approaches, with no noticeable loss of accuracy.
Advances in Markov chain Monte Carlo methods
This thesis proposes and investigates several new Monte Carlo algorithms, both for evaluating normalizing constants and for improved sampling of distributions, and develops novel exact-sampling-based MCMC methods, the Exchange Algorithm and Latent Histories.
Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo
The IS approach provides a natural alternative to delayed acceptance (DA) pseudo‐marginal/particle MCMC, and has many advantages over DA, including a straightforward parallelization and additional flexibility in MCMC implementation, and is often competitive even without parallelization.


Sampling from multimodal distributions using tempered transitions
A new Markov chain sampling method appropriate for distributions with isolated modes that uses a series of distributions that interpolate between the distribution of interest and a distribution for which sampling is easier, with the advantage that it does not require approximate values for the normalizing constants of these distributions.
Annealing Markov chain Monte Carlo with applications to ancestral inference
This work proposes MCMC methods distantly related to simulated annealing, which simulate realizations from a sequence of distributions, allowing the distribution being simulated to vary randomly over time.
Metropolized independent sampling with comparisons to rejection sampling and importance sampling
In this paper, a special Metropolis-Hastings algorithm, Metropolized independent sampling, proposed first in Hastings (1970), is studied in full detail and shown to be superior to rejection sampling in two respects: asymptotic efficiency and ease of computation.
Monte Carlo Sampling Methods Using Markov Chains and Their Applications
SUMMARY A generalization of the sampling method introduced by Metropolis et al. (1953) is presented along with an exposition of the relevant theory, techniques of application and methods and
Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling
It is shown that the acceptance ratio method and thermodynamic integration are natural generalizations of importance sampling, which is most familiar to statistical audiences.
Sequential importance sampling for nonparametric Bayes models: The next generation
There are two generations of Gibbs sampling methods for semiparametric models involving the Dirichlet process. The first generation suffered from a severe drawback: the locations of the clusters, or
Regeneration in Markov chain samplers
Abstract Markov chain sampling has recently received considerable attention, in particular in the context of Bayesian computation and maximum likelihood estimation. This article discusses the use of
Markov Chain Monte Carlo in Practice
The Markov Chain Monte Carlo Implementation Results Summary and Discussion MEDICAL MONITORING Introduction Modelling Medical Monitoring Computing Posterior Distributions Forecasting Model Criticism Illustrative Application Discussion MCMC for NONLINEAR HIERARCHICAL MODELS.
Bayesian Inference in Econometric Models Using Monte Carlo Integration
Methods for the systematic application of Monte Carlo integration with importance sampling to Bayesian inference are developed. Conditions under which the numerical approximation converges almost