Second Order Ensemble Langevin Method for Sampling and Inverse Problems

  title={Second Order Ensemble Langevin Method for Sampling and Inverse Problems},
  author={Ziming Liu and Andrew M. Stuart and Yixuan Wang},
. We propose a sampling method based on an ensemble approximation of second order Langevin dynamics. The log target density is appended with a quadratic term in an auxiliary momentum variable and damped-driven Hamiltonian dynamics introduced; the resulting stochastic differential equation is invariant to the Gibbs measure, with marginal on the position coordinates given by the target. A preconditioner based on covariance under the law of the dynamics does not change this invariance property, and… 

Figures from this paper

Birth-death dynamics for sampling: Global convergence, approximations and their asymptotics

It is proved that the probability density of the birth-death governed by Kullback-Leibler divergence or by χ 2 divergence converge exponentially fast to the Gibbs equilibrium measure with a universal rate that is independent of the potential barrier.



Interacting Langevin Diffusions: Gradient Structure and Ensemble Kalman Sampler

A new version of such a methodology for solving inverse problems without the use of derivatives or adjoints of the forward model is proposed, and numerical evidence of the practicality of the method is presented.

A Complete Recipe for Stochastic Gradient MCMC

This paper provides a general recipe for constructing MCMC samplers--including stochastic gradient versions--based on continuous Markov processes specified via two matrices, and uses the recipe to straightforwardly propose a new state-adaptive sampler: stochastics gradient Riemann Hamiltonian Monte Carlo (SGRHMC).

Affine invariant interacting Langevin dynamics for Bayesian inference

A computational method for sampling from a given target distribution based on first-order (overdamped) Langevin dynamics which satisfies the property of affine invariance is proposed, which enables application to high-dimensional sampling problems.

Handbook of Markov Chain Monte Carlo

A Markov chain Monte Carlo based analysis of a multilevel model for functional MRI data and its applications in environmental epidemiology, educational research, and fisheries science are studied.

MCMC Methods for Functions: ModifyingOld Algorithms to Make Them Faster

An approach to modifying a whole range of MCMC methods, applicable whenever the target measure has density with respect to a Gaussian process or Gaussian random field reference measure, which ensures that their speed of convergence is robust under mesh refinement.

Efficient derivative-free Bayesian inference for large-scale inverse problems

We consider Bayesian inference for large-scale inverse problems, where computational challenges arise from the need for repeated evaluations of an expensive forward model. This renders most Markov

Optimal friction matrix for underdamped Langevin sampling

The algorithm is applied to the estimation of posterior means in Bayesian inference problems and reduced variance is demonstrated when compared to the original underdamped and overdamped Langevin dynamics in both full and stochastic gradient cases.

Ensemble Markov chain Monte Carlo with teleporting walkers

An ensemble Markov chain Monte Carlo approach to sampling from a probability density with known likelihood is introduced and how interaction can be applied selectively to a subset of state variables in order to maintain advantage on very high-dimensional problems is explained.

Consensus‐based sampling

The analysis and numerical simulation establish that the method has potential for general purpose optimization tasks over Euclidean space; contraction properties of the algorithm are established under suitable conditions, and computational experiments demonstrate wide basins of attraction for various specific problems.

Unscented Kalman Inversion

It is demonstrated that unscented Kalman methods also provide an effective tool for derivative-free inversion in the setting of black-box forward models, introducing UKI based methods, of particular value for parameter estimation problems in which the number of parameters is moderate but the forward model is expensive and provided as a black box which is impractical to differentiate.