Using recursive algorithms for the efficient identification of smoothing spline ANOVA models

  title={Using recursive algorithms for the efficient identification of smoothing spline ANOVA models},
  author={Marco Ratto and Andrea Pagano},
  journal={AStA Advances in Statistical Analysis},
  • M. Ratto, A. Pagano
  • Published 1 December 2010
  • Mathematics
  • AStA Advances in Statistical Analysis
In this paper we present a unified discussion of different approaches to the identification of smoothing spline analysis of variance (ANOVA) models: (i) the “classical” approach (in the line of Wahba in Spline Models for Observational Data, 1990; Gu in Smoothing Spline ANOVA Models, 2002; Storlie et al. in Stat. Sin., 2011) and (ii) the State-Dependent Regression (SDR) approach of Young in Nonlinear Dynamics and Statistics (2001). The latter is a nonparametric approach which is very similar to… Expand

Figures and Tables from this paper

Non-parametric estimation of the first-order Sobol indices with bootstrap bandwidth
  • Maikol Sol'is
  • Mathematics, Computer Science
  • Commun. Stat. Simul. Comput.
  • 2021
A bootstrap procedure is proposed which reconstruct the model residuals and re-estimate the non-parametric regression curve with a new set of curves that corrects the bias in the Sobol index. Expand
State Dependent Regressions: From Sensitivity Analysis to Meta-modeling
State Dependent Parameter (SDP) modelling has been developed by Professor Peter Young in the 1990s to identify non-linearities in the context of dynamic transfer function models. SDP is a veryExpand
Sensitivity analysis techniques applied to a system of hyperbolic conservation laws
This study considers a variety of sensitivity analysis methods, including different sampling strategies, different meta-models, and different ways of evaluating variance-based sensitivity indices, and considers the 1-D Riemann problem. Expand
Global sensitivity analysis: a generalized, unbiased and optimal estimator of total-effect variance
Variance-based sensitivity analysis and multivariate sensitivity analysis aim to apportion the variability of the model output(s) into input factors and their interactions. Sobol’s total index, whichExpand
Computer experiments: a review
In this paper we provide a broad introduction to the topic of computer experiments. We begin by briefly presenting a number of applications with different types of output or different goals. We thenExpand
A surrogate method for density-based global sensitivity analysis
  • S. Rahman
  • Mathematics, Computer Science
  • Reliab. Eng. Syst. Saf.
  • 2016
An accurate and computationally efficient surrogate method, known as the polynomial dimensional decomposition (PDD) method, for estimating a general class of density-based f-sensitivity indices, capable of calculating a wide variety of sensitivity or importance measures. Expand
Simple approach to emulating complex computer models for global sensitivity analysis
Two emulator-based sensitivity index estimators that require minimal set-up and are computationally inexpensive to compute are proposed that are more accurate than existing Monte Carlo methods with the same number of model runs. Expand
Conceptual implementation of the variance-based sensitivity analysis for the calculation of the first-order effects
Studies focused on models and their associated parameters are of crucial importance to engineers since models are the essential tools for engineering analysis and design. Uncertainty and successivelyExpand
The paper discusses the idea and concept of dynamic models of a variable structure, peculiarities of their research in the framework of a “new econometrics” paradigm. During econometric modeling ofExpand
Uncertainty quantification: a minimum variance unbiased (joint) estimator of the non-normalized Sobol’ indices
Often, uncertainty quantification is followed by the computation of sensitivity indices of input factors. Variance-based sensitivity analysis and multivariate sensitivity analysis (MSA) aim toExpand


Component selection and smoothing in multivariate nonparametric regression
We propose a new method for model selection and model fitting in multivariate nonparametric regression models, in the framework of smoothing spline ANOVA. The "COSSO" is a method of regularizationExpand
Component selection and smoothing in smoothing spline analysis of variance models -- COSSO
We propose a new method for model selection and model fitting in nonparametric regression models, in the framework of smoothing spline ANOVA. The “COSSO” is a method of regularization with theExpand
The Signal Extraction Approach to Nonlinear Regression and Spline Smoothing
Abstract This article shows how to fit a smooth curve (polynomial spline) to pairs of data values (yi, xi ). Prior specification of a parametric functional form for the curve is not required. TheExpand
A stochastic framework for recursive computation of spline functions: Part II, smoothing splines
Many of the optimal curve-fitting problems arising in approximation theory have the same structure as certain estimation problems involving random processes. We develop this structural correspondenceExpand
Recursive and en-bloc approaches to signal extraction
In the literature on unobservable component models , three main statistical instruments have been used for signal extraction: fixed interval smoothing (FIS), which derives from Kalman's seminal workExpand
State Dependent Parameter metamodelling and sensitivity analysis
A unified procedure which exploits sampling, screening and model approximation techniques in order to optimally fulfill basic requirements in terms of general applicability and flexibility, efficiency of estimation and simplicity of implementation is presented. Expand
Surface Estimation, Variable Selection, and the Nonparametric Oracle Property.
This paper proposes a model selection procedure for nonparametric models, and explores the conditions under which the new method enjoys the aforementioned properties, and demonstrates that the new approach substantially outperforms other existing methods in the finite sample setting. Expand
Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models
An improvement on existing methods for SA of complex computer models is described for use when the model is too computationally expensive for a standard Monte-Carlo analysis, and a new approach to sensitivity index estimation using meta-models and bootstrap confidence intervals is described. Expand
Regression Shrinkage and Selection via the Lasso
SUMMARY We propose a new method for estimation in linear models. The 'lasso' minimizes the residual sum of squares subject to the sum of the absolute value of the coefficients being less than aExpand
Stochastic, Dynamic Modelling and Signal Processing: Time Variable and State Dependent Parameter Estimation
Previous publications (e.g. Young, 1978, 1983, 1993a,b, 1998a,b, 1999a,b; Young and Runkle, 1989; Young and Minchin, 1991; Young et al., 1991; Young and Lees, 1993; Young and Beven, 1994; Young andExpand