• Corpus ID: 10022564

Minimax Optimal Rates of Estimation in Functional ANOVA Models with Derivatives

@article{Dai2017MinimaxOR,
  title={Minimax Optimal Rates of Estimation in Functional ANOVA Models with Derivatives},
  author={Xiaowu Dai and Peter Chien},
  journal={arXiv: Statistics Theory},
  year={2017}
}
We establish minimax optimal rates of convergence for nonparametric estimation in functional ANOVA models when data from first-order partial derivatives are available. Our results reveal that partial derivatives can improve convergence rates for function estimation with deterministic or random designs. In particular, for full $d$-interaction models, the optimal rates with first-order partial derivatives on $p$ covariates are identical to those for $(d-p)$-interaction models without partial… 
Efficient estimation of smoothing spline with exact shape constraints
TLDR
The proposed method is able to establish a sufficient and necessary condition for transforming the exact shape constraints to a finite number of constraints, leading to efficient estimation of the shape constrained functions.

References

SHOWING 1-10 OF 44 REFERENCES
Nonparametric least squares estimation in derivative families
Nonparametric estimation when data on derivatives are available
We consider settings where data are available on a nonparametric function and various partial derivatives. Such circumstances arise in practice, for example in the joint estimation of cost and input
Tensor product space ANOVA models
  • Yi Lin
  • Mathematics, Computer Science
  • 2000
TLDR
The quick optimal rate of the TPS-ANOVA model makes it very preferable in high-dimensional function estimation, and many properties of the tensor product space of Sobolev-Hilbert spaces are given.
Optimum Designs in Regression Problems
0. Summary. Extending the results of Kiefer and Wolfowitz [10], [11], methods are obtained for characterizing and computing optimum regression designs in various settings, and examples are given
Derivative Observations in Gaussian Process Models of Dynamic Systems
TLDR
This paper improves dramatically the computational efficiency of Gaussian process models for dynamic system identification, by summarising large quantities of near-equilibrium data by a handful of linearisations, reducing the training set size.
Minimax Risk Over Hyperrectangles, and Implications
Consider estimating the mean of a standard Gaussian shift when that mean is known to lie in an orthosymmetric quadratically convex set in l 2 . The minimax risk among linear estimates is within 25%
Tensor product space ANOVA models in multivariate function estimation
  • Yi Lin
  • Mathematics, Computer Science
  • 1998
TLDR
The main result is that, in a variety of general nonparametric problems, under general conditions, the rate of convergence for the penalized likelihood estimator in the TPS-ANOVA model is O([n(logn)1 r] 2m 2m+1 ) when the smoothing parameter is appropriately chosen, which means that curse of dimensionality is overcome by the tensor product space ANOVA models.
A Reproducing Kernel Hilbert Space Approach to Functional Linear Regression
We study in this paper a smoothness regularization method for functional linear regression and provide a unified treatment for both the prediction and estimation problems. By developing a tool on
Asymptotic Analysis of Penalized Likelihood and Related Estimators
A general approach to the first order asymptotic analysis ofpenalized likelihood and related estimators is described. The method gives expansions for the systematic and random error. Asymptotic
...
...