Stationarity and Convergence of the Metropolis-Hastings Algorithm: Insights into Theoretical Aspects

  title={Stationarity and Convergence of the Metropolis-Hastings Algorithm: Insights into Theoretical Aspects},
  author={Stacy D. Hill and James C. Spall},
  journal={IEEE Control Systems},
Markov chain Monte Carlo (MCMC) is a versatile sampling approach that is useful in a wide range of estimation and simulation applications. Fundamentally, MCMC is a powerful general means of generating random samples from probability distributions from which it is otherwise difficult to draw samples. The MCMC method is named for its reliance on the construction of a Markovian (dependent) sequence of random variables. Under modest conditions, the sequence has a limiting probability distribution… Expand
Objective Bayesian meta-analysis based on generalized multivariate random effects model
Objective Bayesian inference procedures are derived for the parameters of the multivariate random effects model generalized to elliptically contoured distributions. The posterior for the overall meanExpand
State estimation for the electro-hydraulic actuator based on particle filter with an improved resampling technique
  • Runxia Guo, Zhile Wei, Yeo Wei
  • Computer Science
  • Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability
  • 2019
The novel resampling method based on support vector regression-particle filters can keep the diversity of particles as well as relieve the degeneracy phenomenon and eventually make the estimated state more realistic. Expand
MADFU: An Improved Malicious Application Detection Method Based on Features Uncertainty
A malicious application detection model based on features uncertainty (MADFU) is proposed, which uses logistic regression function to describe the input (permissions) and output (labels) relationship and the Markov chain Monte Carlo algorithm to solve features’ uncertainty. Expand
Analysis of Online Learning Time in Flipped classroom Based on MCMC
The MCMC algorithm is used to analyze the online learning time of the flipped classroom, and analyzes the student learning time in the form of probability. Expand


Estimation via Markov Chain Monte Carlo
Markov chain Monte Carlo (MCMC) is a powerful means for generating random samples that can be used in computing statistical estimates, numerical integrals, and marginal and joint probabilities. TheExpand
Markov Chains for Exploring Posterior Distributions
Several Markov chain methods are available for sampling from a posterior distribution. Two important examples are the Gibbs sampler and the Metropolis algorithm. In addition, several strategies areExpand
Geometric convergence and central limit theorems for multidimensional Hastings and Metropolis algorithms
We develop results on geometric ergodicity of Markov chains and apply these and other recent results in Markov chain theory to multidimensional Hastings and Metropolis algorithms. For those based onExpand
Markov Chains and Stochastic Stability
This second edition reflects the same discipline and style that marked out the original and helped it to become a classic: proofs are rigorous and concise, the range of applications is broad and knowledgeable, and key ideas are accessible to practitioners with limited mathematical background. Expand
Bayesian system identification via Markov chain Monte Carlo techniques
The work here explores new numerical methods for supporting a Bayesian approach to parameter estimation of dynamic systems. This is primarily motivated by the goal of providing accurateExpand
A Monte Carlo Approach to Nonnormal and Nonlinear State-Space Modeling
Abstract A solution to multivariate state-space modeling, forecasting, and smoothing is discussed. We allow for the possibilities of nonnormal errors and nonlinear functionals in the state equation,Expand
A new proof of convergence of MCMC via the ergodic theorem
A key result underlying the theory of MCMC is that any [eta]-irreducible Markov chain having a transition density with respect to [eta] and possessing a stationary distribution [pi] is automaticallyExpand
Simulation and the Monte Carlo Method, 3rd ed.
  • D. Vats
  • Physics
  • Journal of the American Statistical Association
  • 2019
weighted sum of the claims, which is related to discounting the future cash flows. The latter is related to real life applications when interest rate is accounted in the ruin model. Chapter 9Expand
Modes of convergence of Markov chain transition probabilities
Abstract Suppose {Pn(x, A)} denotes the transition law of a general state space Markov chain {Xn}. We find conditions under which weak convergence of {Xn} to a random variable X with law LExpand
Explaining the Gibbs Sampler
Abstract Computer-intensive algorithms, such as the Gibbs sampler, have become increasingly popular statistical tools, both in applied and theoretical work. The properties of such algorithms,Expand