# Approximate Optimal Controls via Instanton Expansion for Low Temperature Free Energy Computation

@article{Ferre2020ApproximateOC, title={Approximate Optimal Controls via Instanton Expansion for Low Temperature Free Energy Computation}, author={Gr'egoire Ferr'e and Tobias Grafke}, journal={arXiv: Statistical Mechanics}, year={2020} }

The computation of free energies is a common issue in statistical physics. A natural technique to compute such high dimensional integrals is to resort to Monte Carlo simulations. However these techniques generally suffer from a high variance in the low temperature regime, because the expectation is dominated by high values corresponding to rare system trajectories. A standard way to reduce the variance of the estimator is to modify the drift of the dynamics with a control enhancing the…

## 3 Citations

Stochastic viscosity approximations of Hamilton-Jacobi equations and variance reduction

- Computer Science, MathematicsArXiv
- 2021

The goal of this work is to provide a quantitative criterion for assessing whether a given bias reduces variance, and at which order, on a recently introduced notion of stochastic solution for Hamilton–Jacobi–Bellman equations.

Path integral derivation and numerical computation of large deviation prefactors for non-equilibrium dynamics through matrix Riccati equations

- Physics
- 2021

For many non-equilibrium dynamics driven by small noise, in physics, chemistry, biology, or economy, rare events do matter. Large deviation theory then explains that the leading order term of the…

Gel’fand–Yaglom type equations for calculating fluctuations around instantons in stochastic systems

- PhysicsJournal of Physics A: Mathematical and Theoretical
- 2021

In recent years, instanton calculus has successfully been employed to estimate tail probabilities of rare events in various stochastic dynamical systems. Without further corrections, however, these…

## References

SHOWING 1-10 OF 68 REFERENCES

Martingale-based gradient descent algorithm for estimating free energy values of diffusions

- Mathematics
- 2014

Thermodynamic free energies or cumulant generating functions play a significant role in the estimation of rare event statistics of equilibrated systems because of their interpretation as…

Instanton based importance sampling for rare events in stochastic PDEs.

- Mathematics, PhysicsChaos
- 2019

It will be shown that the instanton-based sampling method outperforms both approaches and allows for an accurate quantification of the whole probability density function of velocity gradients from the core to the very far tails.

Perturbative Calculation of Quasi-Potential in Non-equilibrium Diffusions: A Mean-Field Example

- Physics
- 2016

In stochastic systems with weak noise, the logarithm of the stationary distribution becomes proportional to a large deviation rate function called the quasi-potential. The quasi-potential, and its…

Model reduction algorithms for optimal control and importance sampling of diffusions

- Mathematics
- 2016

We propose numerical algorithms for solving complex, high- dimensional control and importance sampling problems based on reduced-order models. The algorithms approach the “curse of dimensionality” by…

Rare Event Simulation of Small Noise Diffusions

- Mathematics
- 2012

An important sampling method for certain rare event problems involving small noise diffusions is proposed. Standard Monte Carlo schemes for these problems behave exponentially poorly in the small…

Long Term Effects of Small Random Perturbations on Dynamical Systems: Theoretical and Computational Tools

- Computer Science, Mathematics
- 2017

The theoretical and computational aspects behind differential equations with multiplicative noise, Markov jump processes, and systems with fast and slow degrees of freedom are reviewed, and an algorithm that simplifies the geometric minimum action method to minimize the action in the space of arc-length parametrized curves is proposed.

Partial differential equations and stochastic methods in molecular dynamics*

- Mathematics, Computer ScienceActa Numerica
- 2016

This review describes how techniques from the analysis of partial differential equations can be used to devise good algorithms and to quantify their efficiency and accuracy.

Rare Event Simulation for Stochastic Dynamics in Continuous Time

- Physics, MathematicsJournal of Statistical Physics
- 2019

The tilted generator characterizing the large deviation rate function can be associated to non-linear processes which give rise to several representations of the dynamics and additional freedom for associated numerical approximations, which enables rigorous convergence bounds for cloning algorithms to be derived.

Efficient rare event simulation by optimal nonequilibrium forcing

- Mathematics
- 2012

Rare event simulation and estimation for systems in equilibrium are among the most challenging topics in molecular dynamics.
As was shown by Jarzynski and others, nonequilibrium forcing can…

Minimum Action Method for the Study of Rare Events

- Physics
- 2004

The least-action principle from the Wentzell-Freidlin theory of large deviations is exploited as a numerical tool for finding the optimal dynamical paths in spatially extended systems driven by a…