Learn More
Even though dynamic programming offers an optimal control solution in a state feedback form, the method is overwhelmed by computational and storage requirements. Approximate dynamic programming implemented with an Adaptive Critic (AC) neural network structure has evolved as a powerful alternative technique that obviates the need for excessive computations(More)
In this paper, a new nonlinear control method is used to design a full-envelope, hybrid bank-to-turn (BTT)/skid-to-turn (STT) autopilot for an air-breathing air-to-air missile. Through this new approach, called the D θ − method, we find approximate solutions to the Hamilton-Jacobi-Bellman (HJB) equation. As a result, the resulting nonlinear feedback law can(More)
This paper investigates the optimal control problem for linear impulsive systems with impulsive moments fixed. Based on adaptive dynamic programming(ADP), a numerical method is proposed to iteratively solve for this optimal impulsive control. The temporal difference of the value functions is used to determine whether the optimality has been achieved. A(More)
—In this study, we develop an adaptive-critic-based controller to steer an agile missile that has a constraint on the minimum flight Mach number from various initial Mach numbers to a given final Mach number in minimum time while completely reversing its flightpath angle. This class of bounded state space, free final time problems is very difficult to solve(More)
An approximate dynamic programming (ADP) based neurocontroller is developed for a heat transfer application. Heat transfer problem for a fin in a car's electronic module is modeled as a nonlinear distributed parameter (infinite-dimensional) system by taking into account heat loss and generation due to conduction, convection and radiation. A low-order,(More)
The concept of approximate dynamic programming and adaptive critic neural network based optimal controller is extended in this study to include systems governed by partial differential equations. An optimal controller is synthesized for a dispersion type tubular chemical reactor, which is governed by two coupled nonlinear partial differential equations. It(More)
A novel sliding mode based impact time and angle guidance law for engaging a modern warfare ship is presented in this paper. While the impact angle problem has received a considerable amount of attention in the literature, the inclusion of an impact time constraint is a relatively new concept. In order to satisfy the impact time and angle constraints, a(More)
Approximate dynamic programming implemented with an Adaptive Critic (AC) neural network (NN) structure has evolved as a powerful alternative technique that eliminates the need for excessive computations and storage requirements in solving optimal control problems. A typical AC structure consists of two interacting NNs. In this paper, a new architecture,(More)