• Corpus ID: 243861204

Posterior Concentration Rates for Bayesian Penalized Splines

@inproceedings{Bach2021PosteriorCR,
  title={Posterior Concentration Rates for Bayesian Penalized Splines},
  author={Paul Bach and Nadja Klein},
  year={2021}
}
Despite their widespread use in practice, the asymptotic properties of Bayesian penalized splines have not been investigated so far. We close this gap and study posterior concentration rates for Bayesian penalized splines in a Gaussian nonparametric regression model. A key feature of the approach is the hyperprior on the smoothing variance, which allows for adaptive smoothing in practice but complicates the theoretical analysis considerably as it destroys conjugacy and precludes analytic… 

Figures from this paper

References

SHOWING 1-10 OF 79 REFERENCES

Some asymptotic results on generalized penalized spline smoothing

Summary.  The paper discusses asymptotic properties of penalized spline smoothing if the spline basis increases with the sample size. The proof is provided in a generalized smoothing model allowing

Bayesian P-Splines

P-splines are an attractive approach for modeling nonlinear smooth effects of covariates within the additive and varying coefficient models framework. In this article, we first develop a Bayesian

Asymptotic properties of penalized spline estimators in concave extended linear models: Rates of convergence

This paper develops a general theory on rates of convergence of penalized spline estimators for function estimation when the likelihood functional is concave in candidate functions, where the

Nearly optimal Bayesian Shrinkage for High Dimensional Regression

If the shrinkage prior has a heavy and flat tail, and allocates a sufficiently large probability mass in a very small neighborhood of zero, then its posterior properties are as good as those of the spike-and-slab prior.

Adaptive Bayesian Procedures Using Random Series Priors

We consider a general class of prior distributions for nonparametric Bayesian estimation which uses finite random series with a random number of terms. A prior is constructed through distributions on

Scale-Dependent Priors for Variance Parameters in Structured Additive Distributional Regression

. The selection of appropriate hyperpriors for variance parameters is an important and sensible topic in all kinds of Bayesian regression models involving the specification of (conditionally) Gaussian

Bayesian Smoothing and Regression Splines for Measurement Error Problems

Bayesian approaches to modeling a flexible regression function when the predictor variable is measured with error are described and the frequentist mean squared error properties of the fully Bayesian method are better than those of ICM and also of previously proposed frequentist methods, at least in the examples.

Variance Prior Forms for High-Dimensional Bayesian Variable Selection

This paper shows that conjugate priors for linear regression, which induce prior dependence, can lead to such underestimation in the Bayesian high-dimensional regression setting, and recommends as a remedy to treat regression coefficients and the error variance as independent a priori.

Bayesian regularisation in structured additive regression: a unifying perspective on shrinkage, smoothing and predictor selection

This paper surveys various shrinkage, smoothing and selection priors from a unifying perspective and shows how to combine them for Bayesian regularisation in the general class of structured additive
...