Stationarity and Convergence of the Metropolis-Hastings Algorithm: Insights into Theoretical Aspects

@article{Hill2019StationarityAC,
  title={Stationarity and Convergence of the Metropolis-Hastings Algorithm: Insights into Theoretical Aspects},
  author={Stacy D. Hill and James C. Spall},
  journal={IEEE Control Systems},
  year={2019},
  volume={39},
  pages={56-67}
}
Markov chain Monte Carlo (MCMC) is a versatile sampling approach that is useful in a wide range of estimation and simulation applications. Fundamentally, MCMC is a powerful general means of generating random samples from probability distributions from which it is otherwise difficult to draw samples. The MCMC method is named for its reliance on the construction of a Markovian (dependent) sequence of random variables. Under modest conditions, the sequence has a limiting probability distribution… Expand
View on IEEE
doi.org
4 Citations
Background Citations
1
Methods Citations
1

4 Citations

Citation Type

Citation Type

Objective Bayesian meta-analysis based on generalized multivariate random effects model
Objective Bayesian inference procedures are derived for the parameters of the multivariate random effects model generalized to elliptically contoured distributions. The posterior for the overall mean… Expand
State estimation for the electro-hydraulic actuator based on particle filter with an improved resampling technique
  • Runxia Guo, Zhile Wei, Yeo Wei
  • Computer Science
  • Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability
  • 2019
TLDR
The novel resampling method based on support vector regression-particle filters can keep the diversity of particles as well as relieve the degeneracy phenomenon and eventually make the estimated state more realistic. Expand
MADFU: An Improved Malicious Application Detection Method Based on Features Uncertainty
TLDR
A malicious application detection model based on features uncertainty (MADFU) is proposed, which uses logistic regression function to describe the input (permissions) and output (labels) relationship and the Markov chain Monte Carlo algorithm to solve features’ uncertainty. Expand
Analysis of Online Learning Time in Flipped classroom Based on MCMC
TLDR
The MCMC algorithm is used to analyze the online learning time of the flipped classroom, and analyzes the student learning time in the form of probability. Expand

References

SHOWING 1-10 OF 17 REFERENCES
Estimation via Markov Chain Monte Carlo
Markov chain Monte Carlo (MCMC) is a powerful means for generating random samples that can be used in computing statistical estimates, numerical integrals, and marginal and joint probabilities. The… Expand
Markov Chains for Exploring Posterior Distributions
Several Markov chain methods are available for sampling from a posterior distribution. Two important examples are the Gibbs sampler and the Metropolis algorithm. In addition, several strategies are… Expand
Geometric convergence and central limit theorems for multidimensional Hastings and Metropolis algorithms
We develop results on geometric ergodicity of Markov chains and apply these and other recent results in Markov chain theory to multidimensional Hastings and Metropolis algorithms. For those based on… Expand
Markov Chains and Stochastic Stability
TLDR
This second edition reflects the same discipline and style that marked out the original and helped it to become a classic: proofs are rigorous and concise, the range of applications is broad and knowledgeable, and key ideas are accessible to practitioners with limited mathematical background. Expand
Bayesian system identification via Markov chain Monte Carlo techniques
The work here explores new numerical methods for supporting a Bayesian approach to parameter estimation of dynamic systems. This is primarily motivated by the goal of providing accurate… Expand
A Monte Carlo Approach to Nonnormal and Nonlinear State-Space Modeling
Abstract A solution to multivariate state-space modeling, forecasting, and smoothing is discussed. We allow for the possibilities of nonnormal errors and nonlinear functionals in the state equation,… Expand
A new proof of convergence of MCMC via the ergodic theorem
A key result underlying the theory of MCMC is that any [eta]-irreducible Markov chain having a transition density with respect to [eta] and possessing a stationary distribution [pi] is automatically… Expand
Simulation and the Monte Carlo Method, 3rd ed.
  • D. Vats
  • Physics
  • Journal of the American Statistical Association
  • 2019
weighted sum of the claims, which is related to discounting the future cash flows. The latter is related to real life applications when interest rate is accounted in the ruin model. Chapter 9… Expand
Modes of convergence of Markov chain transition probabilities
Abstract Suppose {Pn(x, A)} denotes the transition law of a general state space Markov chain {Xn}. We find conditions under which weak convergence of {Xn} to a random variable X with law L… Expand
Explaining the Gibbs Sampler
Abstract Computer-intensive algorithms, such as the Gibbs sampler, have become increasingly popular statistical tools, both in applied and theoretical work. The properties of such algorithms,… Expand
...
1
2
...