# Mean-field approximation, convex hierarchies, and the optimality of correlation rounding: a unified perspective

@article{Jain2018MeanfieldAC,
title={Mean-field approximation, convex hierarchies, and the optimality of correlation rounding: a unified perspective},
author={Vishesh Jain and Frederic Koehler and Andrej Risteski},
journal={Proceedings of the 51st Annual ACM SIGACT Symposium on Theory of Computing},
year={2018}
}
• Published 22 August 2018
• Computer Science
• Proceedings of the 51st Annual ACM SIGACT Symposium on Theory of Computing
The free energy is a key quantity of interest in Ising models, but unfortunately, computing it in general is computationally intractable. Two popular (variational) approximation schemes for estimating the free energy of general Ising models (in particular, even in regimes where correlation decay does not hold) are: (i) the mean-field approximation with roots in statistical physics, which estimates the free energy from below, and (ii) hierarchies of convex relaxations with roots in theoretical…
24 Citations
• Computer Science
• 2022
A new approach to deriving quantitative mean field approximations for any probability measure P on R with density proportional to e, for f strongly concave is proposed, based primarily on functional inequalities and the notion of displacement convexity from optimal transport.
• Computer Science
COLT
• 2022
We consider Ising models on the hypercube with a general interaction matrix J , and give a polynomial time sampling algorithm when all but O(1) eigenvalues of J lie in an interval of length one, a
• F. Augeri
• Mathematics, Computer Science
Probability Theory and Related Fields
• 2021
These transportation-entropy inequalities which are saturated by measures such that their log-density with respect to the background measure is an affine function, in the setting of the uniform measure on the discrete hypercube and the exponential measure imply a strong integrability inequality for Bernoulli and exponential processes.
New techniques to find classical, additive error productstate approximations for these quantities on certain families of Quantum k-Local Hamiltonians, including those which are either dense, have low threshold rank, or are defined on a sparse graph that excludes a fixed minor are developed.
• Mathematics
• 2021
We show that the naive mean-field approximation correctly predicts the leading term of the logarithmic lower tail probabilities for the number of copies of a given subgraph in G ( n,p ) and of
BP converges quickly to the global optimum of the Bethe free energy for Ising models on arbitrary graphs, as long as the Ising model is \emph{ferromagnetic} (i.e. neighbors prefer to be aligned).
A general bound is derived for the mean-field approximation of Ising and Potts models, which is in a sense dimension free, in both continuous and discrete settings.
It is proved that general nonlinear large deviation estimates similar to Chatterjee-Dembo's original bounds except that they do not require any second order smoothness are valid for a broad class of distributions.
This work proves general nonlinear large deviation estimates similar to Chatterjee-Dembo’s original bounds except that they do not require any second order smoothness and are valid for a broad class of distributions.
• Mathematics, Computer Science
• 2021
This work derives a limiting infinite dimensional variational formula for the log normalizing constant of the posterior distribution of high-dimensional Bayesian linear regression with product priors and establishes that under an additional “separation" condition, the variational problem has a unique optimizer, and this optimizer governs the probabilistic properties ofThe posterior distribution.

## References

SHOWING 1-10 OF 45 REFERENCES

This work considers dense and low threshold rank graphs, and interestingly, the reason the approach works on these types of graphs is because local correlations propagate to global correlations – completely the opposite of algorithms based on correlation decay.
• Mathematics
2012 IEEE 53rd Annual Symposium on Foundations of Computer Science
• 2012
The proof establishes that the normalized log-partition function of any two-spin system on bipartite locally tree-like graphs converges to a limiting free energy density'' which coincides with the (non-rigorous) Be the prediction of statistical physics.
• Computer Science
Found. Trends Mach. Learn.
• 2008
The variational approach provides a complementary alternative to Markov chain Monte Carlo as a general source of approximation methods for inference in large-scale statistical models.
• Computer Science
Comb.
• 1999
The matrix approximation is generalized to multi-dimensional arrays and from that derive approximation algorithms for all dense Max-SNP problems and the Regularity Lemma is derived.
• Mathematics
• 2017
We show that under a low complexity condition on the gradient of a Hamiltonian, Gibbs distributions on the Boolean hypercube are approximate mixtures of product measures whose probability vectors are
• Mathematics
• 2015
We consider the Potts model with q colors on a sequence of weighted graphs with adjacency matrices $$A_n$$An, allowing for both positive and negative weights. Under a mild regularity condition on
• Computer Science
Communications in Mathematical Physics
• 2019
It is verified that the Gibbs measure can be decomposed into a moderate number of Bethe states, subsets of the state space in which both short and long range correlations of the measure take a simple form.
• Computer Science, Mathematics
2011 IEEE 52nd Annual Symposium on Foundations of Computer Science
• 2011
An approximation scheme for optimizing certain Quadratic Integer Programming problems with positive semi definite objective functions and global linear constraints is presented, and an algorithm for independent sets in graphs that performs well when the Laplacian does not have too many eigenvalues bigger than \$1+o(1).
• Mathematics
• 2010
We consider Ising models on graphs that converge locally to trees. Examples include random regular graphs with bounded degree and uniformly random graphs with bounded average degree. We prove that
• Mathematics
• 1978
LetSn denote the random total magnetization of ann-site Curie-Weiss model, a collection ofn (spin) random variables with an equal interaction of strength 1/n between each pair of spins. The