Approximate inference techniques with expectation constraints

  title={Approximate inference techniques with expectation constraints},
  author={Tom Heskes},
This article discusses inference problems in probabilistic graphical models that often occur in a machine learning setting. In particular it presents a unified view of several recently proposed approximation schemes. Expectation consistent approximations and expectation propagation are both shown to be related to Bethe free energies with weak consistency constraints, i.e. free energies where local approximations are only required to agree on certain statistics instead of full marginals. 
Highly Cited
This paper has 37 citations. REVIEW CITATIONS


Publications citing this paper.
Showing 1-10 of 28 extracted citations


Publications referenced by this paper.
Showing 1-10 of 29 references

Spin Glass Theory and Beyond, volume 9 of Lecture Notes in Physics

M. Mézard, G. Parisi, M. A. Virasoro
World Scientific, • 1987
View 4 Excerpts
Highly Influenced

The EP energy function and minimization schemes

T. Minka
Technical report, • 2001
View 5 Excerpts
Highly Influenced

Change Point Problems in Linear Dynamical Systems

Journal of Machine Learning Research • 2005

Graphical models, exponential families, and variational inference

M. J. Wainwright, M. I. Jordan
Technical report, UC Berkeley, Dept. of Statistics, • 2003
View 3 Excerpts

Similar Papers

Loading similar papers…