# A Conceptual Introduction to Hamiltonian Monte Carlo

@article{Betancourt2017ACI, title={A Conceptual Introduction to Hamiltonian Monte Carlo}, author={M. Betancourt}, journal={arXiv: Methodology}, year={2017} }

Hamiltonian Monte Carlo has proven a remarkable empirical success, but only recently have we begun to develop a rigorous understanding of why it performs so well on difficult problems and how it is best applied in practice. Unfortunately, that understanding is confined within the mathematics of differential geometry which has limited its dissemination, especially to the applied communities for which it is particularly important. In this review I provide a comprehensive conceptual account of… Expand

#### Figures and Topics from this paper

figure 1 figure 2 figure 3 figure 4 figure 5 figure 6 figure 7 figure 8 figure 9 figure 10 figure 11 figure 12 figure 13 figure 14 figure 15 figure 16 figure 17 figure 18 figure 19 figure 20 figure 21 figure 22 figure 23 figure 24 figure 25 figure 26 figure 27 figure 28 figure 29 figure 30 figure 31 figure 32 figure 33 figure 34 figure 35 figure 36 figure 37 figure 38 figure 39 figure 40 figure 41 figure 42

#### Paper Mentions

#### 511 Citations

Geometry and Dynamics for Markov Chain Monte Carlo

- Mathematics, Computer Science
- ArXiv
- 2017

The aim of this review is to provide a comprehensive introduction to the geometric tools used in Hamiltonian Monte Carlo at a level accessible to statisticians, machine learners, and other users of the methodology with only a basic understanding of Monte Carlo methods. Expand

Unbiased Hamiltonian Monte Carlo with couplings

- Mathematics
- 2017

We propose a methodology to parallelize Hamiltonian Monte Carlo estimators. Our approach constructs a pair of Hamiltonian Monte Carlo chains that are coupled in such a way that they meet exactly… Expand

Discontinuous Hamiltonian Monte Carlo for discrete parameters and discontinuous likelihoods

- Mathematics
- 2020

Hamiltonian Monte Carlo has emerged as a standard tool for posterior computation. In this article, we present an extension that can efficiently explore target distributions with discontinuous… Expand

Implicit Hamiltonian Monte Carlo for Sampling Multiscale Distributions

- Mathematics
- 2019

Hamiltonian Monte Carlo (HMC) has been widely adopted in the statistics community because of its ability to sample high-dimensional distributions much more efficiently than other Metropolis-based… Expand

Probabilistic Path Hamiltonian Monte Carlo

- Computer Science, Biology
- ICML
- 2017

Probabilistic Path HMC (PPHMC) is developed as a first step to sampling distributions on spaces with intricate combinatorial structure, and a surrogate function to ease the transition across a boundary on which the log-posterior has discontinuous derivatives can greatly improve efficiency. Expand

Magnetic Hamiltonian Monte Carlo

- Physics, Computer Science
- ICML
- 2017

A theoretical basis for the use of non-canonical Hamiltonian dynamics in MCMC is established, and a symplectic, leapfrog-like integrator is constructed allowing for the implementation of magnetic HMC. Expand

A general perspective on the Metropolis-Hastings kernel

- Mathematics
- 2020

Since its inception the Metropolis–Hastings kernel has been applied in sophisticated ways to address ever more challenging and diverse sampling problems. Its success stems from the flexibility… Expand

Hamiltonian Dynamics Sampling

- 2018

Hamiltonian Dynamics Monte Carlo is a popular method used in simulating complicated distribution. The performance of HMC highly depends on geometry of the momentum-state dual space; we investigate… Expand

A Condition Number for Hamiltonian Monte Carlo.

- Mathematics
- 2019

Hamiltonian Monte Carlo is a popular sampling technique for smooth target densities. The scale lengths of the target have long been believed to influence sampling efficiency, but quantitative… Expand

Discontinuous Hamiltonian Monte Carlo for Probabilistic Programs

- Computer Science
- ArXiv
- 2018

This paper introduces a sufficient set of language restrictions, a corresponding mathematical formalism that ensures that any joint density denoted in such a language has a suitably low measure of discontinuous points, and a recipe for how to apply DHMC in the more general probabilistic-programming context. Expand

#### References

SHOWING 1-10 OF 28 REFERENCES

Optimizing The Integrator Step Size for Hamiltonian Monte Carlo

- Mathematics
- 2014

Hamiltonian Monte Carlo can provide powerful inference in complex statistical problems, but ultimately its performance is sensitive to various tuning parameters. In this paper we use the underlying… Expand

CURVATURE AND CONCENTRATION OF HAMILTONIAN MONTE CARLO IN HIGH DIMENSIONS

- Mathematics
- 2014

In this article, we analyze Hamiltonian Monte Carlo (HMC) by placing it in the setting of Riemannian geometry using the Jacobi metric, so that each step corresponds to a geodesic on a suitable… Expand

On the Geometric Ergodicity of Hamiltonian Monte Carlo

- Mathematics
- 2016

We establish general conditions under which Markov chains produced by the Hamiltonian Monte Carlo method will and will not be geometrically ergodic. We consider implementations with both… Expand

MCMC Using Hamiltonian Dynamics

- Mathematics, Physics
- 2011

Hamiltonian dynamics can be used to produce distant proposals for the Metropolis algorithm, thereby avoiding the slow exploration of the state space that results from the diffusive behaviour of… Expand

Generalizing the No-U-Turn Sampler to Riemannian Manifolds

- Mathematics
- 2013

Hamiltonian Monte Carlo provides efficient Markov transitions at the expense of introducing two free parameters: a step size and total integration time. Because the step size controls discretization… Expand

Riemann manifold Langevin and Hamiltonian Monte Carlo methods

- Mathematics
- 2011

The paper proposes Metropolis adjusted Langevin and Hamiltonian Monte Carlo sampling methods defined on the Riemann manifold to resolve the shortcomings of existing Monte Carlo algorithms when… Expand

Diagnosing Suboptimal Cotangent Disintegrations in Hamiltonian Monte Carlo

- Mathematics
- 2016

When properly tuned, Hamiltonian Monte Carlo scales to some of the most challenging high-dimensional problems at the frontiers of applied statistics, but when that tuning is suboptimal the… Expand

Control functionals for Monte Carlo integration

- Mathematics
- 2014

Summary
A non-parametric extension of control variates is presented. These leverage gradient information on the sampling density to achieve substantial variance reduction. It is not required that… Expand

A General Metric for Riemannian Hamiltonian Monte Carlo

- Mathematics
- 2013

A General Metric for Riemannian Hamiltonian Monte Carlo Michael Betancourt University College London August 30th, 2013 I’m going to talk about probability and geometry, but not information geometry!… Expand

Numerical Integrators for the Hybrid Monte Carlo Method

- Mathematics, Computer Science
- SIAM J. Sci. Comput.
- 2014

Limited, proof-of-concept numerical experiments suggest that the new integrators constructed may provide an improvement on the efficiency of the standard Verlet method, especially in problems with high dimensionality. Expand