Skip to search formSkip to main contentSkip to account menu

Markov decision process

Known as: Value iteration, Policy iteration, Markov decision problems 
Markov decision processes (MDPs) provide a mathematical framework for modeling decision making in situations where outcomes are partly random and… 
Wikipedia (opens in a new tab)

Related topics

Related topics

49 relations
Apprenticeship learningArtificial neural networkAutomatic controlBackward induction

Broader (2)

Dynamic programmingStochastic control

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
Highly Cited
2011
Highly Cited
2011
Multigrid Methods for
We propose multigrid methods for solving Hamilton-Jacobi-Bellman (HJB) and HamiltonJacobi-Bellman-Isaacs (HJBI) equations. The… 
Highly Cited
2008
Highly Cited
2008
A quality of service negotiation-based vertical handoff decision scheme in heterogeneous wireless systems
Highly Cited
2007
Highly Cited
2007
On the Access Pricing and Network Scaling Issues of Wireless Mesh Networks
Distributed wireless mesh network technology is ready for public deployment in the near future. However, without an incentive… 
2006
2006
Existence of Optimal Policies for Semi-Markov Decision Processes Using Duality for Infinite Linear Programming
Semi-Markov decision processes on Borel spaces with deterministic kernels have many practical applications, particularly in… 
Highly Cited
1998
Highly Cited
1998
Structured Reachability Analysis for Markov Decision Processes
Recent research in decision theoretic planning has focussed on making the solution of Markov decision processes (MDPs) more… 
1992
1992
A Weighted Markov Decision Process
The two most commonly considered reward criteria for Markov decision processes are the discounted reward and the long-term… 
Highly Cited
1988
Highly Cited
1988
Hierarchic Markov processes and their applications in replacement models
Review
1978
Review
1978
Contracting Markov decision processes
• A submitted manuscript is the author's version of the article upon submission and before peer-review. There can be important… 
Review
1978
Review
1978
Contracting Markov Decision Processes
• A submitted manuscript is the author's version of the article upon submission and before peer-review. There can be important… 
1977
1977
Markov decision processes with unbounded rewards
Markov decision processes which allow for an unbounded reward structure are considered. Conditions are given which allow… 
By clicking accept or continuing to use the site, you agree to the terms outlined in our Privacy Policy (opens in a new tab), Terms of Service (opens in a new tab), and Dataset License (opens in a new tab)