# Cross-Validation and the Estimation of Conditional Probability Densities

```@article{Hall2004CrossValidationAT,
title={Cross-Validation and the Estimation of Conditional Probability Densities},
author={Peter Hall and Jeffrey S. Racine and Qi Li},
journal={Journal of the American Statistical Association},
year={2004},
volume={99},
pages={1015 - 1026}
}```
• Published 1 December 2004
• Computer Science
• Journal of the American Statistical Association
Many practical problems, especially some connected with forecasting, require nonparametric estimation of conditional densities from mixed data. For example, given an explanatory data vector X for a prospective customer, with components that could include the customer's salary, occupation, age, sex, marital status, and address, a company might wish to estimate the density of the expenditure, Y, that could be made by that person, basing the inference on observations of (X, Y) for previous clients…
496 Citations

### Adaptive Bayesian density regression for high-dimensional data

• Mathematics, Computer Science
• 2016
It is shown that the posterior distribution of the conditional density contracts adaptively at the truth nearly at the optimal oracle rate, determined by the unknown sparsity and smoothness levels, even in the ultra highdimensional settings where p increases exponentially with n.

### Non-Parametric Estimation of Conditional Densities: A New Method

• Mathematics
• 2016
Let X = (X1,...,Xp) be a stochastic vector having joint density function fX(x) with partitions X1 = (X1,...,Xk) and X2 = (Xk+1,...,Xp). A new method for estimating the conditional density function of

### CONDITIONAL DENSITY ESTIMATION IN A REGRESSION SETTING

Regression problems are traditionally analyzed via univariate characteristics like the regression function, scale function and marginal density of regression errors. These characteristics are useful

### Converting High-Dimensional Regression to High-Dimensional Conditional Density Estimation

• Computer Science
• 2017
FlexCode is proposed, a fully nonparametric approach to conditional density estimation that reformulates CDE as a non-parametric orthogonal series problem where the expansion coefficients are estimated by regression.

### Kernel Estimation of Multivariate Conditional Distributions

• Mathematics
• 2004
We consider the problem of estimating conditional probability distributions that are multivariate in both the conditioned and conditioning variable sets. This is an extension of Hall, Racine, and Li

### Approximation of conditional densities by smooth mixtures of regressions

This paper shows that large nonparametric classes of conditional multivariate densities can be approximated in the Kullback‐Leibler distance by dierent specifications of finite mixtures of normal

### ADAPTIVE BAYESIAN ESTIMATION OF CONDITIONAL DENSITIES

• Mathematics
Econometric Theory
• 2016
We consider a nonparametric Bayesian model for conditional densities. The model is a finite mixture of normal distributions with covariate dependent multinomial logit mixing probabilities. A prior

### Approximation of conditional densities by smooth mixtures of regressions ∗

This paper shows that large nonparametric classes of conditional multivariate densities can be approximated in the Kullback–Leibler distance by different specifications of finite mixtures of normal

### Bayesian Mixture Modeling for Multivariate Conditional Distributions

• Mathematics
Journal of Statistical Theory and Practice
• 2020
We present a Bayesian mixture model for estimating the joint distribution of mixed ordinal, nominal, and continuous data conditional on a set of fixed variables. The modeling strategy is motivated by

### Contribution to the Nonparametric Estimation of the Density of the Regression Errors (Doctoral Thesis)

This thesis deals with the nonparametric estimation of density f of the regression error term E of the model Y=m(X)+E, assuming its independence with the covariate X. The difficulty linked to this