Flow control as stochastic optimal control problem with incomplete information

  title={Flow control as stochastic optimal control problem with incomplete information},
  author={Boris M. Miller and Konstantin Avrachenkov and Karen Stepanyan and Gregory B. Miller},
  journal={Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies.},
  pages={1328-1337 vol. 2}
The nonlinear stochastic control problem related with flow control is considered. The state of the link is described by controlled hidden Markov process while the loss flow is described by the counting process with the intensity depending on the current transmission rate and unobserved link state. The control is the transmission rate and have to be chosen as non-anticipating process depending on the observation of the loss process. The aim of the control is to achieve the maximum of some… CONTINUE READING
Highly Cited
This paper has 17 citations. REVIEW CITATIONS
12 Citations
29 References
Similar Papers


Publications citing this paper.


Publications referenced by this paper.
Showing 1-10 of 29 references

A Markovian analys is 10 of AIMD algorithms

  • V. Dumas, F. Guillemin, P. Robert
  • Advances in Applied Probability, 34(1),
  • 2002
3 Excerpts

Internet Congesti on Control

  • S. H. Low, F. Paganini, J. C. Doyle
  • IEEE Control Systems Magazine, 22(1),
  • 2002
1 Excerpt

Mathematical modelling of the Internet

  • F. P. Kelly
  • : Mathematics Unlimited - 2001 and Beyond, eds. B…
  • 2001
1 Excerpt

TCP/IP modeling and validation

  • C. Barakat
  • IEEE Network,
  • 2001
1 Excerpt

Similar Papers

Loading similar papers…