A Penalty Method for the Numerical Solution of Hamilton-Jacobi-Bellman (HJB) Equations in Finance

  title={A Penalty Method for the Numerical Solution of Hamilton-Jacobi-Bellman (HJB) Equations in Finance},
  author={J. Witte and C. Reisinger},
  journal={SIAM J. Numer. Anal.},
We present a simple and easy-to-implement method for the numerical solution of a rather general class of Hamilton-Jacobi-Bellman (HJB) equations. In many cases, classical finite difference discretizations can be shown to converge to the unique viscosity solutions of the considered problems. However, especially when using fully implicit time stepping schemes with their desirable stability properties, one is still faced with the considerable task of solving the resulting nonlinear discrete system… Expand
Power penalty method for solving HJB equations arising from finance
This work establishes a sharp convergence rate of the power penalty method, which is of an exponential order with respect to the power of the penalty term, and develops a damped Newton algorithm to iteratively solve the lower order penalized equation. Expand
Numerical solution of discretised HJB equations with applications in finance
This work considers the numerical solution of discretised Hamilton-Jacobi-Bellman (HJB) equations with applications in finance, and designs Newton-type methods for the solution of the penalised equations. Expand
Inexact arithmetic considerations for direct control and penalty methods: American options under jump diffusion
Abstract Solutions of Hamilton–Jacobi–Bellman (HJB) Partial Integro-Differential Equations (PIDEs) arising in financial option problems are not necessarily unique. In order to ensure convergence of aExpand
A penalty scheme and policy iteration for nonlocal HJB variational inequalities with monotone nonlinearities
This work presents a novel analysis technique for the well-posedness of the discrete equation, and demonstrates the convergence of the scheme, which subsequently gives a constructive proof for the existence of a solution to the penalized equation and variational inequality. Expand
A penalty scheme and policy iteration for nonlocal HJB variational inequalities with monotone drivers
We propose a class of numerical schemes for nonlocal HJB variational inequalities (HJBVIs) with monotone drivers. The solution and free boundary of the HJBVI are constructed from a sequence ofExpand
Penalty Methods for the Solution of Discrete HJB Equations - Continuous Control and Obstacle Problems
The results include estimates of the penalization error for a class of penalty terms, and it is shown that variations of Newton's method can be used to obtain globally convergent iterative solvers for the penalized equations. Expand
Approximation schemes for mixed optimal stopping and control problems with nonlinear expectations and jumps
We propose a class of numerical schemes for mixed optimal stopping and control of processes with infinite activity jumps and where the objective is evaluated by a nonlinear expectation. Exploiting anExpand
A Penalty Scheme for Monotone Systems with Interconnected Obstacles: Convergence and Error Estimates
It is demonstrated that as the switching cost tends to zero, the QVI degenerates into an equation of HJB type, which is approximated by the penalized equation at the same order (up to a log factor) as that for positive switching cost. Expand
A power penalty method for discrete HJB equations
It is proved that the solution to this penalized equation converges to that of the HJB equation at an exponential rate with respect to the penalty parameter when the control set is finite and the coefficient matrices are M -matrices. Expand
Hamilton-Jacobi-Bellman Quasi-Variational Inequality arising in an environmental problem and its numerical discretization
A finite difference scheme with a penalization technique is established for solving the HJBQVI, which is free from any iterative solvers and is unconditionally stable and convergent in the viscosity sense under certain conditions. Expand


Numerical methods for controlled Hamilton-Jacobi-Bellman PDEs in finance
Many nonlinear option pricing problems can be formulated as optimal control problems, leading to Hamilton-Jacobi-Bellman (HJB) or Hamilton-Jacobi-Bellman-Isaacs (HJBI) equations. We show that suchExpand
Penalty Methods for the Numerical Solution of HJB Equations -- Continuous Control and Obstacle Problems
In this paper, we present a novel penalty approach for the numerical solution of continuously controlled HJB equations and HJB obstacle problems. Our results include estimates of the penalisationExpand
On the convergence rate of approximation schemes for Hamilton-Jacobi-Bellman equations
Using systematically a tricky idea of N.V. Krylov, we obtain general results on the rate of convergence of a certain class of monotone approximation schemes for stationary Hamilton-Jacobi- BellmanExpand
Error bounds for monotone approximation schemes for parabolic Hamilton-Jacobi-Bellman equations
. We obtain nonsymmetric upper and lower bounds on the rate of convergence of general monotone approximation/numerical schemes for parabolic Hamilton-Jacobi-Bellman equations by introducing a newExpand
Numerical Methods for Nonlinear PDEs in Finance
Several examples of nonlinear Hamilton Jacobi Bellman (HJB) partial differential equations are given which arise in financial applications. The concept of a visocisity solution is introduced.Expand
Maximal Use of Central Differencing for Hamilton-Jacobi-Bellman PDEs in Finance
A monotone method which uses central weighting as much as possible to solve the discretized algebraic equations and shows higher rates of convergence compared to the use of forward/backward differencing only. Expand
Numerical Methods for Stochastic Control Problems in Continuous Time
A powerful and usable class of methods for numerically approximating the solutions to optimal stochastic control problems for diffusion, reflected diffusion, or jump-diffusion models is discussed.Expand
Semi–Smooth Newton Methods for Variational Inequalities of the First Kind
Semi–smooth Newton methods are analyzed for a class of variational inequalities in infinite dimensions. It is shown that they are equivalent to certain active set strategies. Global and localExpand
Convergence Properties of Policy Iteration
Under certain regularity conditions, it is proved that for piecewise linear interpolation, policy iteration converges quadratically and under more general conditions it is established that convergence is superlinear. Expand
Quadratic Convergence for Valuing American Options Using a Penalty Method
The convergence of a penalty method for solving the discrete regularized American option valuation problem is studied and it is observed that an implicit treatment of the American constraint does not converge quadratically if constant timesteps are used. Expand