Partially observable Markov decision process

Known as: POMDP, Partially observable Markov decision problem 
A partially observable Markov decision process (POMDP) is a generalization of a Markov decision process (MDP). A POMDP models an agent decision… (More)
Wikipedia

Related topics

Related topics

16 relations
Artificial intelligenceAutomated planning and schedulingBellman equationComputational complexity theory
(More)

Broader (2)

Dynamic programmingStochastic control

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
2018
2018
A Partially Observable Markov Decision Process Approach to Residential Home Energy Management
Real-time pricing (RTP) is a utility-offered dynamic pricing program to incentivize customers to make changes in their energy… (More)
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Is this relevant?
2012
2012
Adaptive Multiview Target Classification in Synthetic Aperture Sonar Images Using a Partially Observable Markov Decision Process
The problem of classifying targets in sonar images from multiple views is modeled as a partially observable Markov decision… (More)
  • figure 1
  • figure 2
  • figure 3
  • table I
  • figure 4
Is this relevant?
Highly Cited
2010
Highly Cited
2010
Decision Making Under Uncertainty: A Neural Model Based on Partially Observable Markov Decision Processes
A fundamental problem faced by animals is learning to select actions based on noisy sensory information and incomplete knowledge… (More)
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Is this relevant?
Highly Cited
2009
Highly Cited
2009
The Infinite Partially Observable Markov Decision Process
The Partially Observable Markov Decision Process (POMDP) framework has proven useful in planning domains where agents must… (More)
  • figure 2
  • figure 3
  • figure 4
  • figure 5
  • table 1
Is this relevant?
Highly Cited
2007
Highly Cited
2007
Partially observable Markov decision processes for spoken dialog systems
In a spoken dialog system, determining which action a machine should take in a given situation is a difficult problem because… (More)
  • table 1
  • figure 1
  • figure 2
  • table 2
  • table 3
Is this relevant?
Highly Cited
2005
Highly Cited
2005
Factored partially observable Markov decision processes for dialogue management
While numerous models of human/human conversation have been proposed and evaluated, human/computer conversation currently lacks a… (More)
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Is this relevant?
Highly Cited
2000
Highly Cited
2000
Planning treatment of ischemic heart disease with partially observable Markov decision processes
Diagnosis of a disease and its treatment are not separate, one-shot activities. Instead, they are very often dependent and… (More)
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Is this relevant?
Highly Cited
1998
Highly Cited
1998
Xavier : A Robot Navigation Architecture Based on Partially Observable Markov Decision Process Models
Autonomous mobile robots need very reliable navigation capabilities in order to operate unattended for long periods of time. We… (More)
  • figure 1
  • figure 2
  • table 1
  • figure 4
  • table 2
Is this relevant?
Highly Cited
1997
Highly Cited
1997
Incremental Pruning: A Simple, Fast, Exact Method for Partially Observable Markov Decision Processes
Most exact algorithms for general par­ tially observable Markov decision processes (POMDPs) use a form of dynamic program­ ming… (More)
Is this relevant?
Highly Cited
1994
Highly Cited
1994
Reinforcement Learning Algorithm for Partially Observable Markov Decision Problems
Increasing attention has been paid to reinforcement learning algo rithms in recent years partly due to successes in the… (More)
Is this relevant?