Kalyanam Krishnamoorthy

Learn More
A reduced order Dynamic Programming (DP) method that efficiently computes the optimal policy and value function for a class of controlled Markov chains is developed. We assume that the Markov chains exhibit the property that a subset of the states have a single (default) control action associated with them. Furthermore, we assume that the transition(More)
— A method of stabilizing feedback control, known as adaptive-Q control is applied to a LQG disk drive control system to improve its disturbance rejection property. This approach follows the well known result that all stabilizing controllers for a plant can be synthesized by conveniently parametrized augmentations to a nominal controller. The augmentation(More)
The intruder isolation problem (IIP) involves using an unmanned aerial vehicle (UAV) to isolate an intruder traveling along a road network. The UAV has no visibility of the intruder and can only obtain information about the intruder's location based on several unattended ground sensors (UGSs) preinstalled on the road network. An UGS can detect the passing(More)
One often encounters the curse of dimensionality in the application of dynamic programming to determine optimal policies for controlled Markov chains. In this paper, we provide a method to construct sub-optimal policies along with a bound for the deviation of such a policy from the optimum via a linear programming approach. The state-space is partitioned(More)