S. N. Balakrishnan

Learn More
Even though dynamic programming offers an optimal control solution in a state feedback form, the method is overwhelmed by computational and storage requirements. Approximate dynamic programming implemented with an Adaptive Critic (AC) neural network structure has evolved as a powerful alternative technique that obviates the need for excessive computations(More)
In this paper, a new nonlinear control method is used to design a full-envelope, hybrid bank-to-turn (BTT)/skid-to-turn (STT) autopilot for an air-breathing air-to-air missile. Through this new approach, called the D θ − method, we find approximate solutions to the Hamilton-Jacobi-Bellman (HJB) equation. As a result, the resulting nonlinear feedback law can(More)
—In this study, we develop an adaptive-critic-based controller to steer an agile missile that has a constraint on the minimum flight Mach number from various initial Mach numbers to a given final Mach number in minimum time while completely reversing its flightpath angle. This class of bounded state space, free final time problems is very difficult to solve(More)
The concept of approximate dynamic programming and adaptive critic neural network based optimal controller is extended in this study to include systems governed by partial differential equations. An optimal controller is synthesized for a dispersion type tubular chemical reactor, which is governed by two coupled nonlinear partial differential equations. It(More)
Beavers are often found to be in conflict with human interests by creating nuisances like building dams on flowing water (leading to flooding), blocking irrigation canals, cutting down timbers etc. At the same time they contribute to raising water tables, increased vegetation etc. Consequently, maintaining an optimal beaver population is beneficial. Because(More)
Formation control of network of multi-agent systems with heterogeneous nonlinear dynamics is formulated as an optimal tracking problem and a decentralized controller is developed using the framework of 'adaptive critics' to solve the optimal control problem. The reference signal is assumed available only in online implementation so its dynamics is(More)
Adaptive critic (AC) neural network solutions to optimal control designs using dynamic programming has reduced the need of complex computations and storage requirements that typical dynamic programming requires. In this paper, a " single network adaptive critic " (SNAC) is presented. This approach is applicable to a class of nonlinear systems where the(More)