Corpus ID: 233210402

Couplings for Multinomial Hamiltonian Monte Carlo

  title={Couplings for Multinomial Hamiltonian Monte Carlo},
  author={Kai Xu and Tor Erlend Fjelde and Charles Sutton and Hong Ge},
Hamiltonian Monte Carlo (HMC) is a popular sampling method in Bayesian inference. Recently, Heng & Jacob (2019) studied Metropolis HMC with couplings for unbiased Monte Carlo estimation, establishing a generic parallelizable scheme for HMC. However, in practice a different HMC method, multinomial HMC, is considered as the go-to method, e.g. as part of the no-U-turn sampler. In multinomial HMC, proposed states are not limited to end-points as in Metropolis HMC; instead points along the entire… Expand

Figures and Tables from this paper

Coupling-based convergence assessment of some Gibbs samplers for high-dimensional Bayesian regression with shrinkage priors
We consider Markov chain Monte Carlo (MCMC) algorithms for Bayesian high-dimensional regression with continuous shrinkage priors. A common challenge with these algorithms is the choice of the numberExpand


Unbiased Hamiltonian Monte Carlo with couplings
We propose a methodology to parallelize Hamiltonian Monte Carlo estimators. Our approach constructs a pair of Hamiltonian Monte Carlo chains that are coupled in such a way that they meet exactlyExpand
Unbiased Markov chain Monte Carlo methods with couplings
Markov chain Monte Carlo (MCMC) methods provide consistent approximations of integrals as the number of iterations goes to 1. MCMC estimators are generally biased after any fixed number ofExpand
2019) again with the momentum variable
  • 2019
A Conceptual Introduction to Hamiltonian Monte Carlo
This review provides a comprehensive conceptual account of these theoretical foundations of Hamiltonian Monte Carlo, focusing on developing a principled intuition behind the method and its optimal implementations rather of any exhaustive rigor. Expand
Coupling of Particle Filters
Particle filters provide Monte Carlo approximations of intractable quantities such as point-wise evaluations of the likelihood in state space models. In many scenarios, the interest lies in theExpand
Displacement Interpolation Using Lagrangian Mass Transport
Interpolation between pairs of values, typically vectors, is a fundamental operation in many computer graphics applications. In some cases simple linear interpolation yields meaningful resultsExpand
CODA: convergence diagnosis and output analysis for MCMC
[1st paragraph] At first sight, Bayesian inference with Markov Chain Monte Carlo (MCMC) appears to be straightforward. The user defines a full probability model, perhaps using one of the programsExpand
As the leapfrog integrator is of order two (Hairer et al., 2006; Bou-Rabee et al., 2020), for any sufficently small step size ε and number of step l states
  • 2020
Unbiased Contrastive Divergence Algorithm for Training Energy-Based Latent Variable Models
An unbiased version of the contrastive divergence algorithm is proposed that completely removes its bias in stochastic gradient methods, based on recent advances on unbiased Markov chain Monte Carlo methods. Expand
AdvancedHMC.jl: A robust, modular and e cient implementation of advanced HMC algorithms
AdvancedHMC.jl (AHMC) contributes a modular, well-tested, standalone implementation of NUTS that recovers and extends Stan’s NUTE algorithm, and is demonstrated empirically by comparison with Stan through a third-party Markov chain Monte Carlo benchmarking suite. Expand