Structural analysis of high-dimensional basins of attraction.

@article{Martiniani2016StructuralAO,
  title={Structural analysis of high-dimensional basins of attraction.},
  author={Stefano Martiniani and K. Julian Schrenk and Jacob D. Stevenson and David J. Wales and Daan Frenkel},
  journal={Physical review. E},
  year={2016},
  volume={94 3-1},
  pages={
          031301
        }
}
We propose an efficient Monte Carlo method for the computation of the volumes of high-dimensional bodies with arbitrary shape. We start with a region of known volume within the interior of the manifold and then use the multistate Bennett acceptance-ratio method to compute the dimensionless free-energy difference between a series of equilibrium simulations performed within this object. The method produces results that are in excellent agreement with thermodynamic integration, as well as a direct… 

Figures from this paper

Monte Carlo on Manifolds: Sampling Densities and Integrating Functions
TLDR
An MCMC sampler is given for probability distributions defined by unnormalized densities on manifolds in euclidean space defined by equality and inequality constraints and used to develop a multistage algorithm to compute integrals over such manifolds.
Calculating the Symmetry Number of Flexible Sphere Clusters
TLDR
A numerical algorithm is introduced to compute the sticky symmetry group and symmetry number of a flexible sphere cluster using a definition of symmetry that arises naturally when calculating the equilibrium probability of a cluster of spheres in the sticky-sphere limit.
Basins with Tentacles.
TLDR
This work presents a simple geometrical reason why basins with tentacles should be common in high-dimensional systems and uncovers the geometry behind this size distribution, finding the basins are octopuslike, with nearly all their volume in the tentacles, not the head of the octopus.
Monte Carlo sampling for stochastic weight functions
TLDR
It is shown that it is possible to construct a rigorous Monte Carlo algorithm that visits points in state space with a probability proportional to their average weight, which may have applications for certain classes of high-throughput experiments and the analysis of noisy datasets.
Edwards Statistical Mechanics for Jammed Granular Matter
In 1989, Sir Sam Edwards made the visionary proposition to treat jammed granular materials using a volume ensemble of equiprobable jammed states in analogy to thermal equilibrium statistical
Numerical test of the Edwards conjecture shows that all packings are equally probable at jamming
TLDR
Numerical simulation now demonstrates that all distinct packings are equally probable in granular media — precisely at the jamming threshold — and presents evidence that at unjamming the configurational entropy of the system is maximal.
Energy–entropy competition and the effectiveness of stochastic gradient descent in machine learning
TLDR
A correspondence between parameter inference and free energy minimisation in statistical physics is derived and it is shown that the stochasticity in the SGD algorithm has a non-trivial correlation structure which systematically biases it towards wide minima.
Geometry of energy landscapes and the optimizability of deep neural networks
TLDR
This work analytically shows that the multilayered structure holds the key to optimizability: Fixing the number of parameters and increasing network depth, theNumber of stationary points in the loss function decreases, minima become more clustered in parameter space, and the trade-off between the depth and width of minima becomes less severe.
Structure prediction drives materials discovery
TLDR
This Review discusses structure prediction methods, examining their potential for the study of different materials systems, and presents examples of computationally driven discoveries of new materials — including superhard materials, superconductors and organic materials — that will enable new technologies.
Perspective: Energy Landscapes for Machine Learning
TLDR
This Perspective aims to describe analogies analogous to molecular structure, thermodynamics, and kinetics with examples from recent applications, and suggest avenues for new interdisciplinary research.

References

SHOWING 1-10 OF 37 REFERENCES
Turning intractable counting into sampling: Computing the configurational entropy of three-dimensional jammed packings.
TLDR
The methodology to compute the number of minima in the potential energy landscape should be applicable to a wide range of other enumeration problems in statistical physics, string theory, cosmology, and machine learning that aim to find the distribution of the extrema of a scalar cost function that depends on many degrees of freedom.
Role of Repulsive Forces in Determining the Equilibrium Structure of Simple Liquids
The different roles the attractive and repulsive forces play in forming the equilibrium structure of a Lennard‐Jones liquid are discussed. It is found that the effects of these forces are most easily
Statistically optimal analysis of samples from multiple equilibrium states.
TLDR
A new estimator for computing free energy differences and thermodynamic expectations as well as their uncertainties from samples obtained from multiple equilibrium states via either simulation or experiment is presented, which has significant advantages over multiple histogram reweighting methods for combining data from multiple states.
Journal of Chemical Physics
  • Physics
    Nature
The first number of the new American Journal of Chemical Physics, which is published by the American Institute of Physics and has an editorial board comprising the leading American chemists and
A New Conjugate Gradient Method with Guaranteed Descent and an Efficient Line Search
TLDR
A new nonlinear conjugate gradient method and an associated implementation, based on an inexact line search, are proposed and analyzed and an approximation that can be evaluated with greater precision in a neighborhood of a local minimum than the usual sufficient decrease criterion is obtained.
Algorithm 851: CG_DESCENT, a conjugate gradient method with guaranteed descent
TLDR
This article studies the convergence behavior of the algorithm; extensive numerical tests and comparisons with other methods for large-scale unconstrained optimization are given.
Computing and Combinatorics
Mathematical programming 97
  • 337
  • 2003
Understanding Molecular Simulation
...
...