Reachability analysis of uncertain systems using bounded-parameter Markov decision processes

@article{Wu2008ReachabilityAO,
  title={Reachability analysis of uncertain systems using bounded-parameter Markov decision processes},
  author={Di Wu and Xenofon D. Koutsoukos},
  journal={Artif. Intell.},
  year={2008},
  volume={172},
  pages={945-954}
}
Verification of reachability properties for probabilistic systems is usually based on variants of Markov processes. Current methods assume an exact model of the dynamic behavior and are not suitable for realistic systems that operate in the presence of uncertainty and variability. This research note extends existing methods for Bounded-parameter Markov Decision Processes (BMDPs) to solve the reachability problem. BMDPs are a generalization of MDPs that allows modeling uncertainty. Our results… CONTINUE READING
Highly Cited
This paper has 17 citations. REVIEW CITATIONS