Corpus ID: 235755195

Pseudo-Model-Free Hedging for Variable Annuities via Deep Reinforcement Learning

  title={Pseudo-Model-Free Hedging for Variable Annuities via Deep Reinforcement Learning},
  author={Wing Fung Chong and Haoen Cui and Yuxuan Li},
This paper applies a deep reinforcement learning approach to revisit the hedging problem of variable annuities. Instead of assuming actuarial and financial dualmarket model a priori, the reinforcement learning agent learns how to hedge by collecting anchor-hedging reward signals through interactions with the market. By the recently advanced proximal policy optimization, the pseudo-model-free reinforcement learning agent performs equally well as the correct Delta, while outperforms the… Expand
Deep equal risk pricing of financial derivatives with non-translation invariant risk measures
The use of non-translation invariant risk measures within the equal risk pricing (ERP) methodology for the valuation of financial derivatives is investigated. The ability to move beyond the class ofExpand


Dynamic Replication and Hedging: A Reinforcement Learning Approach
The authors propose a model that is flexible, accurate and very promising for real-world applications based on reinforcement learning, a well-established machine learning technique, that learns the minimum variance hedge subject to whatever transaction cost function one provides. Expand
Deep Hedging
We present a framework for hedging a portfolio of derivatives in the presence of market frictions such as transaction costs, market impact, liquidity constraints or risk limits using modern deepExpand
Deep hedging of long-term financial derivatives
This study presents a deep reinforcement learning approach for global hedging of long-term financial derivatives. A similar setup as in Coleman et al. (2007) is considered with the risk management ofExpand
Deep Hedging of Derivatives Using Reinforcement Learning
It is shown that a hybrid approach involving the use of an accounting P&L approach that incorporates a relatively simple valuation model works well and the valuation model does not have to correspond to the process assumed for the underlying asset price. Expand
Continuous-Time Mean-Variance Portfolio Selection: A Reinforcement Learning Framework
This work establishes connections between the entropy-regularized MV and the classical MV, including the solvability equivalence and the convergence as exploration weighting parameter decays to zero, and proves a policy improvement theorem, based on which an implementable RL algorithm is devised. Expand
Playing Atari with Deep Reinforcement Learning
This work presents the first deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning, which outperforms all previous approaches on six of the games and surpasses a human expert on three of them. Expand
An Effective Bias-Corrected Bagging Method For The Valuation Of Large Variable Annuity Portfolios
This article highlights the presence of prediction bias of bagging and uses the bias-corrected (BC) bagging approach to reduce the bias and thus improve the predictive performance and demonstrates the effectiveness of BC bagging as compared with bagging, boosting, and model points in terms of prediction accuracy. Expand
Moment matching machine learning methods for risk management of large variable annuity portfolios
Variable annuity (VA) with embedded guarantees have rapidly grown in popularity around the world in recent years. Valuation of VAs has been studied extensively in past decades. However, most of theExpand
Efficient Greek Calculation of Variable Annuity Portfolios for Dynamic Hedging: A Two-Level Metamodeling Approach
The financial risk associated with the guarantees embedded in variable annuities cannot be addressed adequately by traditional actuarial techniques. Dynamical hedging is used in practice to mitigateExpand
Regression Modeling for the Valuation of Large Variable Annuity Portfolios
Variable annuities are insurance products that contain complex guarantees. To manage the financial risks associated with these guarantees, insurance companies rely heavily on Monte Carlo simulation.Expand