Skip to search formSkip to main content
You are currently offline. Some features of the site may not work correctly.

Markov chain

Known as: Discrete time Markov chain, Discrete-time Markov process, Markoff Chain 
In probability theory and statistics, a Markov chain or Markoff chain, named after the Russian mathematician Andrey Markov, is a stochastic process… Expand
Wikipedia

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
Review
2019
Review
2019
Recently, multi-view representation learning has become a rapidly growing direction in machine learning and data mining areas… Expand
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Review
2019
Review
2019
  • D. Bertsekas
  • IEEE/CAA Journal of Automatica Sinica
  • 2019
  • Corpus ID: 4881243
In this paper we discuss policy iteration methods for approximate solution of a finite-state discounted Markov decision problem… Expand
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Review
2019
Review
2019
This paper provides a survey of prediction, and forecasting methods used in cyber security. Four main tasks are discussed first… Expand
  • table I
  • figure 1
  • figure 2
  • table II
  • figure 3
Review
2018
Review
2018
With the recent advances in the Internet of Things (IoT), the significance of information technologies to modern industry is… Expand
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Review
2018
Review
2018
Purpose The purpose of this paper is to review the extant literature on supply chain risk management (SCRM, including risk… Expand
  • table IV
  • table V
  • table VI
  • figure 1
Review
2018
Review
2018
Extreme events, such as drought, heat wave, cold wave, flood, and extreme rainfall, have received increasing attention in recent… Expand
  • figure 1
  • figure 2
  • table 1
  • figure 3
  • figure 4
Review
2018
Review
2018
Non-intrusive load monitoring (NILM) is the prevailing method used to monitor the energy profile of a domestic building and… Expand
  • figure 1
  • figure 2
  • table 3
Review
2018
Review
2018
In the era of the Internet of Things (IoT), an enormous amount of sensing devices collect and/or generate various sensory data… Expand
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • table I
Review
2018
Review
2018
The fifth generation (5G) mobile communication systems will be in use around 2020. The aim of 5G systems is to provide anywhere… Expand
  • figure 1
  • table I
  • figure 2
  • figure 3
  • table II
Review
2017
Review
2017
In an increasingly networked world in which information is becoming increasingly actual, how can a system know with certainty… Expand
  • figure 2.1
  • figure 2.2
  • figure 2.3
  • figure 3.1
  • figure 3.2