• Corpus ID: 218673560

Nonasymptotic Laplace approximation under model misspecification

@article{Bhattacharya2020NonasymptoticLA,
  title={Nonasymptotic Laplace approximation under model misspecification},
  author={Anirban Bhattacharya and Debdeep Pati},
  journal={arXiv: Statistics Theory},
  year={2020}
}
We present non-asymptotic two-sided bounds to the log-marginal likelihood in Bayesian inference. The classical Laplace approximation is recovered as the leading term. Our derivation permits model misspecification and allows the parameter dimension to grow with the sample size. We do not make any assumptions about the asymptotic shape of the posterior, and instead require certain regularity conditions on the likelihood ratio and that the posterior to be sufficiently concentrated. 

Statistical optimality and stability of tangent transform algorithms in logit models

TLDR
This work utilizes the theory of dynamical systems to provide convergence guarantees for such algorithms in logistic and multinomial logit regression models and establishes local asymptotic stability of the algorithm without any assumptions on the data-generating process.

References

SHOWING 1-10 OF 51 REFERENCES

Misspecification in infinite-dimensional Bayesian statistics

We consider the asymptotic behavior of posterior distributions if the model is misspecified. Given a prior distribution and a random sample from a distribution P 0 , which may not be in the support

The Bernstein-Von-Mises theorem under misspecification

We prove that the posterior distribution of a parameter in misspecified LAN parametric models can be approximated by a random normal distribution. We derive from this that Bayesian credible sets are

On Posterior Concentration in Misspecified Models

We investigate the asymptotic behavior of Bayesian posterior distributions under independent and identically distributed ($i.i.d.$) misspecified models. More specifically, we study the concentration

Bayesian asymptotics with misspecified models

In this paper, we study the asymptotic properties of a sequence of poste- rior distributions based on an independent and identically distributed sample and when the Bayesian model is misspecified. We

Posterior Consistency of Bayesian Quantile Regression Under a Mis-Specified Likelihood Based on Asymmetric Laplace Density

TLDR
This work provides a theoretical justification for the widely used and yet only empirically verified approach of using Asymmetric Laplace Density in Bayesian Quantile Regression and shows that posterior consistency holds even in the case of improper priors as long as the posterior is well defined.

BAYESIAN LINEAR REGRESSION WITH SPARSE PRIORS

TLDR
Under compatibility conditions on the design matrix, the posterior distribution is shown to contract at the optimal rate for recovery of the unknown sparse vector, and to give optimal prediction of the response vector.

Tractable Bayesian Variable Selection: Beyond Normality

TLDR
This work focuses on nonlocal priors to induce extra sparsity and ameliorate finite-sample effects caused by misspecification, and shows the importance of considering the likelihood rather than solely the prior, for Bayesian variable selection.

Posterior Consistency of Bayesian Quantile Regression Based on the Misspecified Asymmetric Laplace Density

TLDR
An asymptotic justication for the widely used and em- pirically veried approach of assuming an asymmetric Laplace distribution for the response in Bayesian Quantile Regression by establishing posterior consistency and deriving the rate of convergence under the ALD misspecication.

Convergence rates of posterior distributions

We consider the asymptotic behavior of posterior distributions and Bayes estimators for infinite-dimensional statistical models. We give general results on the rate of convergence of the posterior

Bayesian fractional posteriors

We consider the fractional posterior distribution that is obtained by updating a prior distribution via Bayes theorem with a fractional likelihood function, a usual likelihood function raised to a
...