# The Bernstein–von Mises theorem and nonregular models

@article{Bochkina2014TheBM, title={The Bernstein–von Mises theorem and nonregular models}, author={Natalia Bochkina and Peter J. Green}, journal={Annals of Statistics}, year={2014}, volume={42}, pages={1850-1878} }

We study the asymptotic behaviour of the posterior distribution in a broad class of statistical models where the “true” solution occurs on the boundary of the parameter space. We show that in this case the Bayesian inference is consistent, and that the posterior distribution has not only Gaussian components as in the case of regular models (the Bernstein–von Mises theorem) but also has Gamma distribution components that depend on the behaviour of the prior distribution on the boundary and have… Expand

#### Paper Mentions

#### 25 Citations

Critical dimension in the semiparametric Bernstein—von Mises theorem

- Mathematics
- 2013

The classical parametric and semiparametric Bernstein-von Mises (BvM) results are reconsidered in a nonclassical setup allowing finite samples and model misspecification. In the parametric case and… Expand

Bayesian Fixed-domain Asymptotics: Bernstein-von Mises Theorem for Covariance Parameters in a Gaussian Process Model.

- Mathematics
- 2020

Gaussian process models typically contain finite dimensional parameters in the covariance functions that need to be estimated from the data. We study the Bayesian fixed-domain asymptotic properties… Expand

Consistency of the posterior distribution in generalized linear inverse problems

- Mathematics
- 2012

For ill-posed inverse problems, a regularized solution can be interpreted as a mode of the posterior distribution in a Bayesian framework. This framework enriches the set of possible solutions, as… Expand

Posterior distribution of nondifferentiable functions

- Mathematics
- 2016

This paper examines the asymptotic behavior of the posterior distribution of a possibly nondifferentiable function g(theta), where theta is a finite dimensional parameter. The main assumption is that… Expand

Finite Sample Bernstein -- von Mises Theorem for Semiparametric Problems

- Mathematics
- 2013

The classical parametric and semiparametric Bernstein -- von Mises (BvM) results are reconsidered in a non-classical setup allowing finite samples and model misspecification. In the case of a finite… Expand

POSTERIOR ANALYSIS OF N IN THE BINOMIAL (N,P ) PROBLEM WITH BOTH PARAMETERS UNKNOWN-WITH APPLICATIONS TO QUANTITATIVE NANOSCOPY

- 2021

Estimation of the population size n from k i.i.d. binomial observations with unknown success probability p is relevant to a multitude of applications and has a long history. Without additional prior… Expand

Asymptotic normality, concentration, and coverage of generalized posteriors.

- Mathematics
- 2019

Generalized likelihoods are commonly used to obtain consistent estimators with attractive computational and robustness properties. Formally, any generalized likelihood can be used to define a… Expand

Posterior contraction rates for support boundary recovery

- Mathematics
- 2017

Given a sample of a Poisson point process with intensity $\lambda_f(x,y) = n \mathbf{1}(f(x) \leq y),$ we study recovery of the boundary function $f$ from a nonparametric Bayes perspective. Because… Expand

Maximum-a-Posteriori Estimation with Bayesian Confidence Regions

- Mathematics, Computer Science
- SIAM J. Imaging Sci.
- 2017

A new general methodology for approximating Bayesian high-posterior-density credibility regions in inverse problems that are convex and potentially very high-dimensional and which can be computed very efficiently, even in large-scale problems, by using standard convex optimisation techniques. Expand

Penalising Model Component Complexity: A Principled, Practical Approach to Constructing Priors

- Mathematics
- 2014

In this paper, we introduce a new concept for constructing prior
distributions. We exploit the natural nested structure inherent to many model
components, which defines the model component to be a… Expand

#### References

SHOWING 1-10 OF 35 REFERENCES

The Bernstein-Von-Mises theorem under misspecification

- Mathematics
- 2012

We prove that the posterior distribution of a parameter in misspecified LAN parametric models can be approximated by a random normal distribution. We derive from this that Bayesian credible sets are… Expand

Generalization of likelihood ratio tests under nonstandard conditions

- Mathematics
- 1997

In this paper, we analyze the statistic which is the difference in the values of an estimating function evaluated at its local maxima on two different subsets of the parameter space, assuming that… Expand

Stability and Convergence of the Posterior in Non-Regular Problems

- Mathematics
- 1994

It is shown that the posterior converges in a weak sense in a fairly general set up which includes the exponential, gamma and Weibull with a location parameter, and a reliability change point… Expand

Consistency of the posterior distribution in generalized linear inverse problems

- Mathematics
- 2012

For ill-posed inverse problems, a regularized solution can be interpreted as a mode of the posterior distribution in a Bayesian framework. This framework enriches the set of possible solutions, as… Expand

CONSISTENCY OF THE MAXIMUM LIKELIHOOD ESTIMATOR FOR GENERAL HIDDEN MARKOV MODELS

- Mathematics
- 2011

Consider a parametrized family of general hidden Markov models, where both the observed and unobserved components take values in a complete separable metric space. We prove that the maximum… Expand

On convergence of posterior distributions

- Mathematics
- 1995

A general (asymptotic) theory of estimation was developed by Ibragimov and Has'minskii under certain conditions on the normalized likelihood ratios. In an earlier work, the present authors studied… Expand

The consistency of posterior distributions in nonparametric problems

- Mathematics
- 1999

We give conditions that guarantee that the posterior probability of every Hellinger neighborhood of the true distribution tends to 1 almost surely. The conditions are (1) a requirement that the prior… Expand

Asymptotic Properties of Maximum Likelihood Estimators and Likelihood Ratio Tests under Nonstandard Conditions

- Mathematics
- 1987

Abstract Large sample properties of the likelihood function when the true parameter value may be on the boundary of the parameter space are described. Specifically, the asymptotic distribution of… Expand

Laplace Approximations for Posterior Expectations When the Mode Occurs at the Boundary of the Parameter Space

- Mathematics
- 1994

Abstract This article gives asymptotic expansions for posterior expectations when the mode is on the boundary of the parameter space. The idea, based on the divergence theorem, is to reduce the… Expand

Asymptotic Efficiency in Parametric Structural Models with Parameter-Dependent Support

- Mathematics
- 2003

In certain auction, search, and related models, the boundary of the support of the observed data depends on some of the parameters of interest. For such nonregular models, standard asymptotic… Expand