Skip to search formSkip to main contentSkip to account menu

Markov chain

Known as: Discrete time Markov chain, Discrete-time Markov process, Markoff Chain 
In probability theory and statistics, a Markov chain or Markoff chain, named after the Russian mathematician Andrey Markov, is a stochastic process… 
Wikipedia (opens in a new tab)

Related topics

Related topics

50 relations
A Mathematical Theory of CommunicationBioinformaticsChvátal–Sankoff constantsCoarse space (numerical analysis)

Broader (1)

Graph theory

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
Highly Cited
2017
Highly Cited
2017
An Optimal Energy Management System for Islanded Microgrids Based on Multiperiod Artificial Bee Colony Combined With Markov Chain
The optimal operation programming of electrical systems through the minimization of the production cost and the market clearing… 
Highly Cited
2012
Highly Cited
2012
ntegration of logistic regression , Markov chain and cellular automata odels to simulate urban expansion amal
This research analyses the suburban expansion in the metropolitan area of Tehran, Iran. A hybrid model consisting of logistic… 
Highly Cited
2008
Highly Cited
2008
Semi-Markov Chains and Hidden Semi-Markov Models toward Applications: Their Use in Reliability and DNA Analysis
This book is concerned with the estimation of discrete-time semi-Markov and hidden semi-Markov processes. Semi-Markov processes… 
Highly Cited
2006
Highly Cited
2006
Markov Chains: Models, Algorithms and Applications
This new edition of Markov Chains: Models, Algorithms and Applications has been completely reformatted as a text, complete with… 
Highly Cited
2005
Highly Cited
2005
NONLINEAR EXPECTATIONS AND NONLINEAR MARKOV CHAINS
This paper deals with nonlinear expectations. The author obtains a nonlinear generalization of the well-known Kolmogorov's… 
Highly Cited
2002
Highly Cited
2002
Markov chain decomposition for convergence rate analysis
In this paper we develop tools for analyzing the rate at which a reversible Markov chain converges to stationarity. Our… 
Highly Cited
2000
Highly Cited
2000
Modeling customer relationships as Markov chains
INTRODUCTION The lifetime value of a customer is an important and useful concept in interactive marketing. Courtheaux (1986… 
Highly Cited
1997
Highly Cited
1997
Markov chain models for threshold exceedances
In recent research on extreme value statistics, there has been an extensive development of threshold methods, first in the… 
Highly Cited
1995
Highly Cited
1995
Convergence Rates for Markov Chains
This is an expository paper that presents various ideas related to nonasymptotic rates of convergence for Markov chains. Such… 
Highly Cited
1989
Highly Cited
1989
Stochastic Complementation, Uncoupling Markov Chains, and the Theory of Nearly Reducible Systems
A concept called stochastic complementation is an idea which occurs naturally, although not always explicitly, in the theory and… 
By clicking accept or continuing to use the site, you agree to the terms outlined in our Privacy Policy (opens in a new tab), Terms of Service (opens in a new tab), and Dataset License (opens in a new tab)