On essential information in sequential decision processes

  title={On essential information in sequential decision processes},
  author={Eugene A. Feinberg},
  journal={Math. Meth. of OR},
This paper provides sufficient conditions when certain information about the past of a stochastic decision processes can be ignored by a controller. We illustrate the results with particular applications to queueing control, control of semi-Markov decision processes with iid sojourn times, and uniformization of continuous-time Markov decision processes. 

From This Paper

Topics from this paper.


Publications citing this paper.


Publications referenced by this paper.
Showing 1-10 of 16 references

Optimality of D-policies for an M/G/1 queue. Queueing Systems 42:355-376

E. A. Feinberg, O. Kella
View 2 Excerpts

Optimality of Dpolicies for an M / G / 1 queue

E. A. Feinberg, M. I. Reiman
Queueing Systems • 2002

A Modern Approach to Probability Theory

B. Fristedt, L. Gray

Optimality of randomized trunk reservation. Probability in the Engineering and Informational Sciences 8:463489

E. A. Feinberg, M. I. Reiman
View 2 Excerpts

Semi-Markov and jump Markov controlled models: average cost criterion

Kitayev, M. Yu
SIAM Theory Probab. Appl • 1985
View 1 Excerpt

Stochastic optimal control: The discrete time case [Book reviews]

IEEE Transactions on Automatic Control • 1980
View 2 Excerpts

Similar Papers

Loading similar papers…