Optimal control for a class of stochastic hybrid systems

@article{Shi2004OptimalCF,
  title={Optimal control for a class of stochastic hybrid systems},
  author={Ling Shi and Alessandro Abate and S. V. S. SriHarsha Sastry},
  journal={2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601)},
  year={2004},
  volume={2},
  pages={1842-1847 Vol.2}
}
In this paper, an optimal control problem over a "hybrid Markov chain" (HMC) is studied. An HMC can be thought of as a traditional MC with continuous time dynamics pertaining to each node; from a different perspective, it can be regarded as a class of hybrid system with random discrete switches induced by an embedded MC. As a consequence of this setting, the index to be maximized, which depends on the dynamics, is the expected value of a nondeterministic cost function. After obtaining a closed… CONTINUE READING
Highly Cited
This paper has 25 citations. REVIEW CITATIONS

Citations

Publications citing this paper.
Showing 1-10 of 10 extracted citations

The LaSalle stability theorem of general stochastic hybrid systems

Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference • 2009
View 4 Excerpts
Highly Influenced

The asymptotic stability of general stochastic hybrid systems

2008 27th Chinese Control Conference • 2008
View 7 Excerpts
Method Support
Highly Influenced

Optimal control of a class of stochastic hybrid systems with probabilistic constraints

IEEE Conference on Decision and Control and European Control Conference • 2011
View 1 Excerpt

MLD-based modeling and MPC of discrete-time hybrid systems with stochastic mode transitions

2010 IEEE International Conference on Control Applications • 2010
View 1 Excerpt

Stochastic optimal control for hybrid systems with uncertain discrete dynamics

2008 IEEE International Conference on Automation Science and Engineering • 2008
View 1 Excerpt

Exponential Stability of General Stochastic Hybrid Systems and it's Application

2006 9th International Conference on Control, Automation, Robotics and Vision • 2006

References

Publications referenced by this paper.
Showing 1-9 of 9 references

Analysis of stochastic hybrid systems

A. Abate
Master’s thesis, University of California, at Berkeley; EECS Department, May 2004. • 2004
View 1 Excerpt

Application of level set methods to control and reachability problems in continuous and hybrid systems

I. Mitchell
Ph.D. dissertation, Stanford University, Aero/Astro Department, 2002, special Issue on Distributed Sensor Networks - 21. • 2002
View 1 Excerpt

Stochastic Processes : A Conceptual Approach

R. Gallager
UCB EE226A, Course Reader, • 2002
View 1 Excerpt

Towards a theory of stochastic hybrid systems

J. Lygeros, J. Hu, S. Sastry
HSCC 3rd International Workshop, 2000. • 2000
View 1 Excerpt

Dynamic Programming and Stochastic Control

IEEE Transactions on Systems, Man, and Cybernetics • 1977
View 1 Excerpt