Markov chain

Known as: Discrete time Markov chain, Discrete-time Markov process, Markoff Chain 
In probability theory and statistics, a Markov chain or Markoff chain, named after the Russian mathematician Andrey Markov, is a stochastic process… (More)
Wikipedia

Topic mentions per year

Topic mentions per year

1936-2019
02000400019362018

Related topics

Related topics

50 relations
A Mathematical Theory of CommunicationBioinformaticsChvátal–Sankoff constantsCoarse space (numerical analysis)
(More)

Broader (1)

Graph theory

Related mentions per year

Related mentions per year

1936-2019
19401960198020002020
Markov chain
Numerical analysis
Data compression
State space
Hidden Markov model
Kalman filter

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
Highly Cited
2005
Highly Cited
2005
Monte Carlo sampling methods using Markov chains and their applications
  • B Y W. K. HASTINGS
  • 2005
A generalization of the sampling method introduced by Metropolis et al. (1953) is presented along with an exposition of the… (More)
Is this relevant?
Highly Cited
2004
Highly Cited
2004
Fastest Mixing Markov Chain on a Graph
We consider a symmetric random walk on a connected graph, where each edge is labeled with the probability of transition between… (More)
  • table 1
  • figure 1
  • table 2
  • figure 2
  • figure 3
Is this relevant?
Highly Cited
2003
Highly Cited
2003
Model-Checking Algorithms for Continuous-Time Markov Chains
Continuous-time Markov chains (CTMCs) have been widely used to determine system performance and dependability characteristics… (More)
  • figure 1
  • table 1
  • figure 2
  • figure 3
  • figure 4
Is this relevant?
Highly Cited
2002
Highly Cited
2002
Interactive Markov Chains
ion obviously has no impact on Markovian transitions. It is thus easily adapted from Definition 2.1.4. Definition 4.2.3. Let P be… (More)
  • figure 1.1
  • figure 2.1
  • figure 2.2
  • figure 2.3
  • table 2.1
Is this relevant?
Highly Cited
2000
Highly Cited
2000
Markov Chain Sampling Methods for Dirichlet Process Mixture Models
Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at http://www.jstor.org… (More)
  • figure 1
  • table 1
Is this relevant?
Highly Cited
1998
Highly Cited
1998
Wavelet-based statistical signal processing using hidden Markov models
Wavelet-based statistical signal processing techniques such as denoising and detection typically model the wavelet coefficients… (More)
Is this relevant?
Highly Cited
1996
Highly Cited
1996
Exact sampling with coupled Markov chains and applications to statistical mechanics
For many applications it is useful to sample from a nite set of objects in accordance with some particular distribution. One… (More)
  • figure 3
Is this relevant?
Highly Cited
1994
Highly Cited
1994
Regeneration in Markov Chain Samplers
Markov chain sampling has recently received considerable attention in particular in the context of Bayesian computation and… (More)
Is this relevant?
Highly Cited
1994
Highly Cited
1994
A Markov Chain Model for Statistical Software Testing
AbstructStatistical testing of software establishes a basis for statistical inference about a software system's expected field… (More)
  • figure 1
  • figure 2
  • table I
  • table I
  • figure 3
Is this relevant?
Highly Cited
1991
Highly Cited
1991
Geometric Bounds for Eigenvalues of Markov Chains
Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at http://www.jstor.org… (More)
Is this relevant?