Corpus ID: 88522616

Bayes model selection

  title={Bayes model selection},
  author={Qiyang Han},
  journal={arXiv: Statistics Theory},
  • Qiyang Han
  • Published 25 April 2017
  • Mathematics
  • arXiv: Statistics Theory
We offer a general Bayes theoretic framework to tackle the model selection problem under a two-step prior design: the first-step prior serves to assess the model selection uncertainty, and the second-step prior quantifies the prior belief on the strength of the signals within the model chosen from the first step. We establish non-asymptotic oracle posterior contraction rates under (i) a new Bernstein-inequality condition on the log likelihood ratio of the statistical experiment, (ii) a local… Expand
General framework for projection structures
In the first part, we develop a general framework for projection structures and study several inference problems within this framework. We propose procedures based on data dependent measures (DDM)Expand
Robust inference for general framework of projection structures
We develop a general framework of projection structures and study the problem of inference on the unknown parameter within this framework by using empirical Bayes and penalization methods. The mainExpand
Convergence Rates of Empirical Bayes Posterior Distributions: A Variational Perspective
We study the convergence rates of empirical Bayes posterior distributions for nonparametric and high-dimensional inference. We show that as long as the hyperparameter set is discrete, the empiricalExpand
A Bayesian nonparametric approach to log-concave density estimation
The estimation of a log-concave density on $\mathbb{R}$ is a canonical problem in the area of shape-constrained nonparametric inference. We present a Bayesian nonparametric approach to this problemExpand
Complex sampling designs: Uniform limit theorems and applications
In this paper, we develop a general approach to proving global and local uniform limit theorems for the Horvitz-Thompson empirical process arising from complex sampling designs. Global theorems suchExpand


Bayesian model selection consistency and oracle inequality with intractable marginal likelihood
In this article, we investigate large sample properties of model selection procedures in a general Bayesian framework when a closed form expression of the marginal likelihood function is notExpand
A General Framework for Bayes Structured Linear Models
High dimensional statistics deals with the challenge of extracting structured information from complex model settings. Compared with the growing number of frequentist methodologies, there are ratherExpand
Nonparametric Bayesian model selection and averaging
We consider nonparametric Bayesian estimation of a probability density p based on a random sample of size n from this density using a hierarchical prior. The prior consists, for instance, of priorExpand
Posterior convergence rates for estimating large precision matrices using graphical models
We consider Bayesian estimation of a $p\times p$ precision matrix, when $p$ can be much larger than the available sample size $n$. It is well known that consistent estimation in such ultra-highExpand
Bayesian nonparametric multivariate convex regression
In many applications, such as economics, operations research and reinforcement learning, one often needs to estimate a multivariate regression function f subject to a convexity constraint. ForExpand
Risk bounds for model selection via penalization
Abstract Performance bounds for criteria for model selection are developed using recent theory for sieves. The model selection criteria are based on an empirical loss or contrast function with anExpand
Model selection via testing: an alternative to (penalized) maximum likelihood estimators
Abstract This paper is devoted to the definition and study of a family of model selection oriented estimators that we shall call T-estimators (“T” for tests). Their construction is based on formerExpand
Bayesian matrix completion: prior specification
Low-rank matrix estimation from incomplete measurements recently received increased attention due to the emergence of several challenging applications, such as recommender systems; see in particularExpand
Misspecification in infinite-dimensional Bayesian statistics
We consider the asymptotic behavior of posterior distributions if the model is misspecified. Given a prior distribution and a random sample from a distribution P 0 , which may not be in the supportExpand
Posterior convergence rates of Dirichlet mixtures at smooth densities
We study the rates of convergence of the posterior distribution for Bayesian density estimation with Dirichlet mixtures of normal distributions as the prior. The true density is assumed to be twiceExpand