• Corpus ID: 229371293

Dependence of variance on covariate design in nonparametric link regression

@inproceedings{Okuno2020DependenceOV,
  title={Dependence of variance on covariate design in nonparametric link regression},
  author={Akifumi Okuno and Keisuke Yano},
  year={2020}
}
This note discusses a nonparametric approach to link regression aiming at predicting a mean outcome at a link, i.e., a pair of nodes, based on currently observed data comprising covariates at nodes and outcomes at links. The variance decay rates of nonparametric link regression estimates are demonstrated to depend on covariate designs; namely, whether the covariate design is random or fixed. This covariate design-dependent nature of variance is observed in nonparametric link regression but not… 
View PDF on arXiv

Figures and Tables from this paper

References

SHOWING 1-10 OF 32 REFERENCES
From Fixed-X to Random-X Regression: Bias-Variance Decompositions, Covariance Penalties, and Prediction Error Estimation
ABSTRACT In statistical prediction, classical approaches for model selection and model evaluation based on covariance penalties are still widely used. Most of the literature on this topic is based on…
Design-adaptive Nonparametric Regression
Abstract In this article we study the method of nonparametric regression based on a weighted local linear regression. This method has advantages over other popular kernel methods. Moreover, such a…
Random Design Analysis of Ridge Regression
This work gives a simultaneous analysis of both the ordinary least squares estimator and the ridge regression estimator in the random design setting under mild assumptions on the covariate/response…
Models as Approximations --- Part II: A General Theory of Model-Robust Regression
We discuss a model-robust theory for general types of regression in the simplest case of iid observations. The theory replaces the parameters of parametric models with statistical functionals, to be…
High-Dimensional Asymptotics of Prediction: Ridge Regression and Classification
TLDR
A unified analysis of the predictive risk of ridge regression and regularized discriminant analysis in a dense random effects model in a high-dimensional asymptotic regime and finds that predictive accuracy has a nuanced dependence on the eigenvalue distribution of the covariance matrix.
Multivariate Locally Weighted Least Squares Regression
Nonparametric regression using locally weighted least squares was first discussed by Stone and by Cleveland. Recently, it was shown by Fan and by Fan and Gijbels that the local linear kernel-weighted…
Models as Approximations, Part I: A Conspiracy of Nonlinearity and Random Regressors in Linear Regression
More than thirty years ago Halbert White inaugurated a "model-robust" form of statistical inference based on the "sandwich estimator" of standard error. This estimator is known to be…
A Distribution-Free Theory of Nonparametric Regression
Why is Nonparametric Regression Important? * How to Construct Nonparametric Regression Estimates * Lower Bounds * Partitioning Estimates * Kernel Estimates * k-NN Estimates * Splitting the Sample *…
Applied Nonparametric Regression
TLDR
Applied Nonparametric Regression is the first book to bring together in one place the techniques for regression curve smoothing involving more than one variable and argues that all smoothing methods are based on a local averaging mechanism and can be seen as essentially equivalent to kernel smoothing.
Persistence in high-dimensional linear predictor selection and the virtue of overparametrization
TLDR
Under various sparsity assumptions on the optimal predictor there is “asymptotically no harm” in introducing many more explanatory variables than observations, and such practice can be beneficial in comparison with a procedure that screens in advance a small subset of explanatory variables.
...
1
2
3
4
...