Skip to search form
Skip to main content
Skip to account menu
Semantic Scholar
Semantic Scholar's Logo
Search 205,509,927 papers from all fields of science
Search
Sign In
Create Free Account
Markov chain
Known as:
Discrete time Markov chain
, Discrete-time Markov process
, Markoff Chain
Expand
In probability theory and statistics, a Markov chain or Markoff chain, named after the Russian mathematician Andrey Markov, is a stochastic process…
Expand
Wikipedia
Create Alert
Alert
Related topics
Related topics
50 relations
A Mathematical Theory of Communication
Bioinformatics
Chvátal–Sankoff constants
Coarse space (numerical analysis)
Expand
Broader (1)
Graph theory
Papers overview
Semantic Scholar uses AI to extract papers important to this topic.
Highly Cited
2013
Highly Cited
2013
Markov chains and mixing times
V. Climenhaga
2013
Corpus ID: 14443332
For our purposes, a Markov chain is a (finite or countable) collection of states S and transition probabilities pij, where i, j…
Expand
Highly Cited
2008
Highly Cited
2008
Non-negative Matrices and Markov Chains
E. Seneta
2008
Corpus ID: 123838383
Finite Non-Negative Matrices.- Fundamental Concepts and Results in the Theory of Non-negative Matrices.- Some Secondary Theory…
Expand
Highly Cited
2005
Highly Cited
2005
FINITE MARKOV CHAINS
B. Nordstrom
2005
Corpus ID: 14151262
This paper provides basic information and theorems about finite Markov chains. The inspiration for this paper came from Professor…
Expand
Highly Cited
2004
Highly Cited
2004
Fastest Mixing Markov Chain on a Graph
Stephen P. Boyd
,
P. Diaconis
,
Lin Xiao
SIAM Rev.
2004
Corpus ID: 5696331
We consider a symmetric random walk on a connected graph, where each edge is labeled with the probability of transition between…
Expand
Review
2000
Review
2000
Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues
John Odentrantz
Technometrics
2000
Corpus ID: 205458983
Preface * 1 Probability Review * 2 Discrete Time Markov Models * 3 Recurrence and Ergodicity * 4 Long Run Behavior * 5 Lyapunov…
Expand
Highly Cited
1994
Highly Cited
1994
Introduction to the numerical solution of Markov Chains
W. Stewart
1994
Corpus ID: 5365353
* Markov Chains * Direct Methods * Iterative Methods * Projection Methods * Block Hessenberg Matrices * Decompositional Methods…
Expand
Highly Cited
1993
Highly Cited
1993
Markov Chains and Stochastic Stability
S. Meyn
,
R. Tweedie
Communications and Control Engineering Series
1993
Corpus ID: 58179897
Meyn & Tweedie is back! The bible on Markov chains in general state spaces has been brought up to date to reflect developments in…
Expand
Highly Cited
1991
Highly Cited
1991
Geometric Bounds for Eigenvalues of Markov Chains
P. Diaconis
,
D. Stroock
1991
Corpus ID: 9831432
We develop bounds for the second largest eigenvalue and spectral gap of a reversible Markov chain. The bounds depend on geometric…
Expand
Highly Cited
1970
Highly Cited
1970
Monte Carlo Sampling Methods Using Markov Chains and Their Applications
W. K. Hastings
1970
Corpus ID: 21204149
SUMMARY A generalization of the sampling method introduced by Metropolis et al. (1953) is presented along with an exposition of…
Expand
Review
1960
Review
1960
Finite Markov chains
J. Kemeny
,
J. Snell
1960
Corpus ID: 122876291
Markov chains are one of the most useful classes of stochastic processes, being • simple, flexible and supported by many elegant…
Expand
By clicking accept or continuing to use the site, you agree to the terms outlined in our
Privacy Policy
,
Terms of Service
, and
Dataset License
ACCEPT & CONTINUE