# Dependence of variance on covariate design in nonparametric link regression

@inproceedings{Okuno2020DependenceOV, title={Dependence of variance on covariate design in nonparametric link regression}, author={Akifumi Okuno and Keisuke Yano}, year={2020} }

This note discusses a nonparametric approach to link regression aiming at predicting a mean outcome at a link, i.e., a pair of nodes, based on currently observed data comprising covariates at nodes and outcomes at links. The variance decay rates of nonparametric link regression estimates are demonstrated to depend on covariate designs; namely, whether the covariate design is random or fixed. This covariate design-dependent nature of variance is observed in nonparametric link regression but not…

## References

SHOWING 1-10 OF 32 REFERENCES

From Fixed-X to Random-X Regression: Bias-Variance Decompositions, Covariance Penalties, and Prediction Error Estimation

- MathematicsJournal of the American Statistical Association
- 2019

ABSTRACT In statistical prediction, classical approaches for model selection and model evaluation based on covariance penalties are still widely used. Most of the literature on this topic is based on…

Design-adaptive Nonparametric Regression

- Mathematics
- 1992

Abstract In this article we study the method of nonparametric regression based on a weighted local linear regression. This method has advantages over other popular kernel methods. Moreover, such a…

Random Design Analysis of Ridge Regression

- MathematicsCOLT
- 2012

This work gives a simultaneous analysis of both the ordinary least squares estimator and the ridge regression estimator in the random design setting under mild assumptions on the covariate/response…

Models as Approximations --- Part II: A General Theory of Model-Robust Regression

- Mathematics
- 2016

We discuss a model-robust theory for general types of regression in the simplest case of iid observations. The theory replaces the parameters of parametric models with statistical functionals, to be…

High-Dimensional Asymptotics of Prediction: Ridge Regression and Classification

- Computer Science, Mathematics
- 2015

A unified analysis of the predictive risk of ridge regression and regularized discriminant analysis in a dense random effects model in a high-dimensional asymptotic regime and finds that predictive accuracy has a nuanced dependence on the eigenvalue distribution of the covariance matrix.

Multivariate Locally Weighted Least Squares Regression

- Mathematics
- 1994

Nonparametric regression using locally weighted least squares was first discussed by Stone and by Cleveland. Recently, it was shown by Fan and by Fan and Gijbels that the local linear kernel-weighted…

Models as Approximations, Part I: A Conspiracy of Nonlinearity and Random Regressors in Linear Regression

- Mathematics
- 2014

More than thirty years ago Halbert White inaugurated a "model-robust" form of statistical inference based on the "sandwich estimator" of standard error. This estimator is known to be…

A Distribution-Free Theory of Nonparametric Regression

- MathematicsSpringer series in statistics
- 2002

Why is Nonparametric Regression Important? * How to Construct Nonparametric Regression Estimates * Lower Bounds * Partitioning Estimates * Kernel Estimates * k-NN Estimates * Splitting the Sample *…

Applied Nonparametric Regression

- Computer Science
- 1992

Applied Nonparametric Regression is the first book to bring together in one place the techniques for regression curve smoothing involving more than one variable and argues that all smoothing methods are based on a local averaging mechanism and can be seen as essentially equivalent to kernel smoothing.

Persistence in high-dimensional linear predictor selection and the virtue of overparametrization

- Computer Science
- 2004

Under various sparsity assumptions on the optimal predictor there is “asymptotically no harm” in introducing many more explanatory variables than observations, and such practice can be beneficial in comparison with a procedure that screens in advance a small subset of explanatory variables.