# Deep Optimal Stopping

@article{Becker2019DeepOS, title={Deep Optimal Stopping}, author={Sebastian Becker and Patrick Cheridito and Arnulf Jentzen}, journal={J. Mach. Learn. Res.}, year={2019}, volume={20}, pages={74:1-74:25} }

In this paper we develop a deep learning method for optimal stopping problems which directly learns the optimal stopping rule from Monte Carlo samples. As such, it is broadly applicable in situations where the underlying randomness can efficiently be simulated. We test the approach on three problems: the pricing of a Bermudan max-call option, the pricing of a callable multi barrier reverse convertible and the problem of optimally stopping a fractional Brownian motion. In all three cases it… Expand

#### 100 Citations

Optimal stopping with signatures

- Mathematics, Economics
- 2020

We propose a new method for solving optimal stopping problems (such as American option pricing in finance) under minimal assumptions on the underlying stochastic process X. We consider classic and… Expand

Solving high-dimensional optimal stopping problems using deep learning

- Computer Science, Mathematics
- European Journal of Applied Mathematics
- 2021

An algorithm is proposed for solving high-dimensional optimal stopping problems, which is based on deep learning and computes, in the context of early exercise option pricing, both approximations of an optimal exercise strategy and the price of the considered option. Expand

A nonparametric algorithm for optimal stopping based on robust optimization

- Mathematics, Economics
- 2021

Optimal stopping is a class of stochastic dynamic optimization problems with applications in finance and operations management. In this paper, we introduce a new method for solving stochastic optimal… Expand

Derivatives Pricing via Machine Learning

- 2019

In this paper, we combine the theory of stochastic process and techniques of machine learning with the regression analysis, first proposed by Longstaff and Schwartz 2001 and apply the new… Expand

Beating the curse of dimensionality in options pricing and optimal stopping

- Computer Science, Mathematics
- ArXiv
- 2018

This work develops a novel pure-dual algorithm that allows one to elegantly trade-off between accuracy and runtime through a parameter epsilon controlling the associated performance guarantee, with computational and sample complexity both polynomial in T and effectively independent of the dimension, in contrast to past methods typically requiring a complexity scaling exponentially in these parameters. Expand

Deep Reinforcement Learning for Optimal Stopping with Application in Financial Engineering

- Computer Science
- ArXiv
- 2021

This paper presents for the first time a comprehensive empirical evaluation of the quality of optimal stopping policies identified by three state of the art deep RL algorithms: double deep Q-learning (DDQN), categorical distributional RL (C51), and Implicit Quantile Networks (IQN). Expand

Optimal Stopping with Adapted Neural Networks

- 2019

We use temporally adapted neural networks to solve a generalization of the optimal exercise problem for a discrete set of possible exercise times. Versions based on convolutional and attention layers… Expand

Optimal Stopping via Randomized Neural Networks

- Computer Science, Mathematics
- ArXiv
- 2021

These approaches are applicable for high dimensional problems where the existing approaches become increasingly impractical and can be optimized using a simple linear regression, they are very easy to implement and theoretical guarantees can be provided. Expand

Deep combinatorial optimisation for optimal stopping time problems and stochastic impulse control. Application to swing options pricing and fixed transaction costs options hedging

- Economics, Mathematics
- 2020

A new method for stochastic control based on neural networks and using randomisation of discrete random variables is proposed and applied to optimal stopping time problems and seems to be competitive with the best existing algorithms both in terms of Precision and computation time. Expand

Machine Learning With Kernels for Portfolio Valuation and Risk Management

- Computer Science, Economics
- 2019

We introduce a simulation method for dynamic portfolio valuation and risk management building on machine learning with kernels. We learn the dynamic value process of a portfolio from a finite sample… Expand

#### References

SHOWING 1-10 OF 59 REFERENCES

SOLVING OPTIMAL STOPPING PROBLEMS VIA EMPIRICAL DUAL OPTIMIZATION

- Mathematics
- 2013

In this paper we consider a method of solving optimal stopping problems in discrete and continuous time based on their dual representation. A novel and generic simulation-based optimization algorithm… Expand

Stopping Times for Fractional Brownian Motion

- Mathematics
- 2016

In this article we consider an optimal stopping problem for the process of fractional Brownian motion. We prove that this problem for fractional Brownian motion has non trivial solution. We will… Expand

Pricing American options using martingale bases

- Mathematics, Economics
- 2016

In this work, we propose an algorithm to price American options by directly solving thedual minimization problem introduced by Rogers. Our approach relies on approximating the set of uniformly square… Expand

A dynamic look-ahead Monte Carlo algorithm for pricing Bermudan options

- Mathematics
- 2007

Under the assumption of no-arbitrage, the pricing of American and Bermudan options can be casted into optimal stopping problems. We propose a new adaptive simulation based algorithm for the numerical… Expand

Pathwise Optimization for Optimal Stopping Problems

- Mathematics, Computer Science
- Manag. Sci.
- 2012

The pathwise optimization (PO) method is introduced, a new convex optimization procedure to produce upper and lower bounds on the optimal value (the “price”) of a high-dimensional optimal stopping problem and an approximation theory relevant to martingale duality approaches in general and the PO method in particular is developed. Expand

Optimal Stopping and Free-Boundary Problems

- Mathematics
- 2006

Optimal stopping: General facts.- Stochastic processes: A brief review.- Optimal stopping and free-boundary problems.- Methods of solution.- Optimal stopping in stochastic analysis.- Optimal stopping… Expand

An improved simulation method for pricing high-dimensional American derivatives

- Mathematics, Computer Science
- Math. Comput. Simul.
- 2003

An estimator for pricing high-dimensional American-style options is proposed and it is shown that asymptotically its upper bias converges to zero and when combined with low discrepancy sequences, it exhibits a superior rate of convergence. Expand

Optimal stopping via reinforced regression

- Mathematics, Economics
- 2018

In this note we propose a new approach towards solving numerically optimal stopping problems via reinforced regression based Monte Carlo algorithms. The main idea of the method is to reinforce… Expand

On the rates of convergence of simulation based optimization algorithms for optimal stopping problems

- Mathematics, Economics
- 2009

Using large deviation theory for the increments of empirical processes, optimal convergence rates are derived and it is shown that they can not be improved in general. Expand

Deep Learning Approximation for Stochastic Control Problems

- Computer Science, Mathematics
- ArXiv
- 2016

This work develops a deep learning approach that directly solves high-dimensional stochastic control problems based on Monte-Carlo sampling and approximate the time-dependent controls as feedforward neural networks and stack these networks together through model dynamics. Expand