Monte Carlo Sampling Methods Using Markov Chains and Their Applications

  title={Monte Carlo Sampling Methods Using Markov Chains and Their Applications},
  author={W. K. Hastings},
SUMMARY A generalization of the sampling method introduced by Metropolis et al. (1953) is presented along with an exposition of the relevant theory, techniques of application and methods and difficulties of assessing the error in Monte Carlo estimates. Examples of the methods, including the generation of random orthogonal matrices and potential applications of the methods to numerical problems arising in statistics, are discussed. For numerical problems in a large number of dimensions, Monte… 
Introduction to Markov Chain Monte Carlo Methods in Molecular Evolution
Markov chain Monte Carlo has proved to be highly useful because of its great flexibility and its success at solving many high-dimensional integration problems where other methods are computationally prohibitive.
A Guide to Exact Simulation
The results show that CFTP works at least as well as standard MCMC, with convergence monitored by the method of Raftery & Lewis (1992, 1996).
Asymptotically Independent Markov Sampling: a new MCMC scheme for Bayesian Inference
This paper introduces a new scheme for Bayesian inference, called Asymptotically Independent Markov Sampling (AIMS), which is based on the Markov chain Monte Carlo method and derives important ergodic properties of AIMS.
Monte Carlo Methods for Statistical Inference
Various ways random numbers are used in statistical inference are discussed, including Monte Carlo methods and pseudorandom numbers, which is a sample constrained to reflect closely the distribution of the population the authors are simulating.
Estimation via Markov chain Monte Carlo
  • J. Spall
  • Computer Science, Mathematics
    Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301)
  • 2002
A survey of popular implementations of Markov chain Monte Carlo, focusing especially on the two most popular specific implementations of MCMC: Metropolis-Hastings and Gibbs sampling.
Markov Chain Monte Carlo and Gibbs Sampling
This work focuses here on Markov Chain Monte Carlo (MCMC) methods, which attempt to simulate direct draws from some complex distribution of interest, and on the powerful machinery of MCMC methods,which have their roots in the Metropolis algorithm.
A survey of Monte Carlo methods for parameter estimation
A thorough review of MC methods for the estimation of static parameters in signal processing applications is performed, describing many of the most relevant MCMC and IS algorithms, and their combined use.
High dimensional Markov chain Monte Carlo methods : theory, methods and applications
The analysis of Markov Chain Monte Carlo (MCMC) methods and the development of new methodologies to sample from a high dimensional distribution and new Metropolis-Hastings type algorithms which have a better optimal scaling compared the MALA algorithm are studied.
The application of Monte Carlo methods for learning generalized linear model
  • B. Jia
  • Computer Science
    Biometrics & Biostatistics International Journal
  • 2018
The Monte Carlo method for calculating coefficients in Generalized Linear Model (GLM) and Stochastic Approximation in Monte Carlo Computation (SAMC) is introduced.
A simulation approach to convergence rates for Markov chain Monte Carlo algorithms
This paper proposes the use of auxiliary simulations to estimate the numerical values needed in this theorem and makes it possible to compute quantitative convergence bounds for models for which the requisite analytical computations would be prohibitively difficult or impossible.


Probability plotting methods for the analysis of data.
SUMMARY This paper describes and discusses graphical techniques, based on the primitive empirical cumulative distribution function and on quantile (Q-Q) plots, percent (P-P) plots and hybrids of
SUMMARY A METHOD of applying the formula for the sampling variance of the mean of a section of stationary time series, using an analysis of half the squared differences between sample values, is
The Monte Carlo method in quantum statistical mechanics
  • D. Handscomb
  • Mathematics, Physics
    Mathematical Proceedings of the Cambridge Philosophical Society
  • 1962
ABSTRACT This paper describes, in general terms, a Monte Carlo method for estimating statistical parameters of quantum-mechanical systems. In this method, we construct a Markov chain of transitions
Computation of Order Parameters in an Ising Lattice by the Monte Carlo Method
The long‐range and short‐range order parameters are computed for the Ising lattice using a Monte Carlo sampling scheme. The square lattice, the simple cubic lattice, and the body‐centered cubic
Monte Carlo calculations of the radial distribution functions for a proton-electron plasma
A general method is presented for computation of radial distribution functions for plasmas over a wide range of temperatures and densities. The method uses the Monte Carlo technique applied by Wood
Conditional Monte Carlo
Let α be a random vector distributed over a space U with probability density function f(α) so that Ephi = Ephi( α) for α ≥ 1 using LaSalle's inequality.
Equation of state calculations by fast computing machines
A general method, suitable for fast computing machines, for investigating such properties as equations of state for substances consisting of interacting individual molecules is described. The method
The Structure of Inference.