Distortion estimates for approximate Bayesian inference
@inproceedings{Xing2020DistortionEF, title={Distortion estimates for approximate Bayesian inference}, author={Hanwen Xing and Geoff Nicholls and Jeong Eun Lee}, booktitle={UAI}, year={2020} }
Current literature on posterior approximation for Bayesian inference offers many alternative methods. Does our chosen approximation scheme work well on the observed data? The best existing generic diagnostic tools treating this kind of question by looking at performance averaged over data space, or otherwise lack diagnostic detail. However, if the approximation is bad for most data, but good at the observed data, then we may discard a useful approximation. We give graphical diagnostics for…
Figures from this paper
3 Citations
Tree based credible set estimation
- MathematicsStat. Comput.
- 2021
This work shows how the true-posteriorcoverage of an approximate credible set estimated for an approximate target density may be estimated in doubly intractable cases where posterior samples are not available and finds that the estimator is competitive with existing methods.
Scalable Semi-Modular Inference with Variational Meta-Posteriors
- Computer ScienceArXiv
- 2022
Variational methods for approximating the Cut and SMI posteriors which are adapted to the inferential goals of evidence combination are given and it is shown that analysis of models with multiple cuts is feasible using a new Variational Meta-Posterior.
Discovering Inductive Bias with Gibbs Priors: A Diagnostic Tool for Approximate Bayesian Inference
- Computer ScienceArXiv
- 2022
A new approach to diagnosing approximate inference is investigated: the approximation mismatch is attributed to a change in the inductive bias by treating the approximations as exact and reverse-engineering the corresponding prior.
References
SHOWING 1-10 OF 39 REFERENCES
Approximate inference for the loss-calibrated Bayesian
- Computer ScienceAISTATS
- 2011
This work proposes an EM-like algorithm on the Bayesian posterior risk and shows how it can improve a standard approach to Gaussian process classication when losses are asymmetric.
Calibrated Approximate Bayesian Inference
- Computer Science, MathematicsICML
- 2019
It is shown that the original approximate inference had poor coverage for these data and should not be trusted, by exploiting the symmetry of the coverage error under permutation of low level group labels and smoothing with Bayesian Additive Regression Trees.
Calibration Procedures for Approximate Bayesian Credible Sets
- Mathematics, Computer Science
- 2018
Two calibration procedures for checking the coverage of approximate Bayesian credible sets including intervals estimated using Monte Carlo methods are developed and applied.
Fast ε-free Inference of Simulation Models with Bayesian Conditional Density Estimation
- Computer ScienceNIPS
- 2016
This work proposes a new approach to likelihood-free inference based on Bayesian conditional density estimation, which requires fewer model simulations than Monte Carlo ABC methods need to produce a single sample from an approximate posterior.
Diagnostic tools for approximate Bayesian computation using the coverage property
- Computer Science
- 2013
Diagnostic tools for the choice of the kernel scale parameter based on assessing the coverage property are proposed, which asserts that credible intervals have the correct coverage levels in appropriately designed simulation settings.
Automatic Posterior Transformation for Likelihood-Free Inference
- Computer ScienceICML
- 2019
Automatic posterior transformation (APT) is presented, a new sequential neural posterior estimation method for simulation-based inference that can modify the posterior estimate using arbitrary, dynamically updated proposals, and is compatible with powerful flow-based density estimators.
Efficient Bayesian inference for exponential random graph models by correcting the pseudo-posterior distribution
- Computer ScienceSoc. Networks
- 2017
Variational Bayesian Decision-making for Continuous Utilities
- Computer Science, EconomicsNeurIPS
- 2019
This work presents an automatic pipeline that co-opts continuous utilities into variational inference algorithms to account for decision-making and provides practical strategies for approximating and maximizing the gain.
Proper likelihoods for Bayesian analysis
- Mathematics
- 1992
SUMMARY The validity of posterior probability statements follows from probability calculus when the likelihood is the density of the observations. To investigate other cases, a second, more intuitive…