Learn More
We consider a one dimensional stochastic control problem that arises from queueing network applications. The state process corresponding to the queue-length is given by a stochastic differential equation which reflects at the origin. The controller can choose the drift coefficient which represents the service rate and the buffer size b > 0. When the(More)
We consider critically loaded single class queueing networks with infinite buffers in which arrival and service rates are state (i.e., queue length) dependent and may be dynamically controlled. An optimal rate control problem for such networks with an ergodic cost criterion is studied. It is shown that the value function (i.e., optimum value of the cost) of(More)
We study the problem of statistical model checking of probabilistic systems for <b>PCTL</b> unbounded until property <b>P</b>Join<sub>p</sub>(&#198;<sub>1</sub><b>U</b>&#198;<sub>2</sub>) (where Join |X| {<, d, &#62;, e}) using the computation of <b>P</b> d <sub>0</sub>(&#198;<sub>1</sub><b>U</b>&#198;<sub>2</sub>). The approach is first proposed by Sen et(More)
We study the problem of applying statistical methods for approximate model checking of probabilistic systems against properties encoded as PCTL formulas. Such approximate methods have been proposed primarily to deal with state-space explosion that makes the exact model checking by numerical methods practically infeasible for large systems. However, the(More)
A central question in pairwise sequence comparison is assessing the statistical significance of the alignment. The alignment score distribution is known to follow an extreme value distribution with analytically calculable parameters K and λ for ungapped alignments with one substitution matrix. But no statistical theory is currently available for the gapped(More)
We have developed a new approximate probabilistic model-checking method for <i>untimed</i> properties in probabilistic systems, expressed in a probabilistic temporal logic (PCTL, CSL). This method, in contrast to the existing ones, does not require the untimed until properties to be <i>bounded</i> a priori, where the bound refers to the number of discrete(More)
In a number of applications, the underlying stochastic process is modeled as a finite-state discrete-time Markov chain that cannot be observed directly and is represented by an auxiliary process. The maximum a posteriori (MAP) estimator is widely used to estimate states of this hidden Markov model through available observations. The MAP path estimator based(More)
This paper studies a scheduling control problem for a single-server mul-ticlass queueing network in heavy traffic, operating in a changing environment. The changing environment is modeled as a finite-state Markov process that modulates the arrival and service rates in the system. Various cases are considered: fast changing environment, fixed environment,(More)
Modeling the available bandwidth of a path using a known stochastic process is one possible method for estimating future available bandwidth along the path without explicit support from network routers. Our two hypotheses for the stochastic process are as follows. First, an auto-regressive integrated moving-average process (ARIMA) is a suitable model for(More)
  • 1