Corpus ID: 2740546

A Review of Cross Validation and Adaptive Model Selection

  title={A Review of Cross Validation and Adaptive Model Selection},
  author={A. Syed},
  • A. Syed
  • Published 2011
  • Computer Science
We perform a review of model selection procedures, in particular various cross validation procedures and adaptive model selection. We cover important results for these procedures and explore the connections between different procedures and information criteria. INDEX WORDS: Model selection, Adaptive model selection, Cross validation, Information Criteria A REVIEW OF CROSS VALIDATION AND ADAPTIVE MODEL SELECTION 
V-Splines and Bayes Estimate
Smoothing splines can be thought of as the posterior mean of a Gaussian process regression in a certain limit. By constructing a reproducing kernel Hilbert space with an appropriate inner product,Expand
A rainfall forecasting method using machine learning models and its application to the Fukuoka city case
An attempt is made to derive optimal data-driven machine learning methods for forecasting an average daily and monthly rainfall of the Fukuoka city in Japan concentrating on three aspects: modelling inputs, modelling methods and pre-processing techniques. Expand
ST ] 2 4 Ju l 2 01 8 V-Spline and Bayes Estimate
It is known that a smoothing spline can be thought of as the posterior mean of a Gaussian process regression in a certain limit. By constructing a reproducing kernel Hilbert space with an appropriateExpand
A satellite-based model for estimating PM2.5 concentration in a sparsely populated environment using soft computing techniques
The results suggested that soft computing methods like ANFIS, in combination with spatiotemporal data from satellites, meteorological data and geographical information improve the estimate of PM2.5 concentration in sparsely populated areas. Expand
Malaria early warning tool: linking inter-annual climate and malaria variability in northern Guadalcanal, Solomon Islands
This study demonstrated that rainfall provides the best predictor of malaria transmission in North Guadalcanal, thought to be underpinned by the unique hydrological conditions in northern Guadal canal which allow sandbars to form across the mouths of estuaries which act to develop or increase stagnant brackish marshes in low rainfall periods. Expand
Adaptive Smoothing V-Spline for Trajectory Reconstruction
A new method named the V-spline is proposed, which incorporates both location and velocity information but penalizes excessive accelerations and includes a parameter that controls the degree to which the velocity information is used in the reconstruction. Expand
Adaptive Smoothing for Trajectory Reconstruction
Trajectory reconstruction is the process of inferring the path of a moving object between successive observations. In this paper, we propose a smoothing spline -- which we name the V-spline -- thatExpand
Inference and Characterization of Planar Trajectories
A new method named the V-spline is proposed, which incorporates both location and velocity information but penalizes excessive accelerations, and is applied to the joint state and parameters estimation in the case of irregularly sampled GPS time series data. Expand
Optimisation of 700 bar type IV hydrogen pressure vessel considering composite damage and dome multi-sequencing
Abstract This study investigated with the optimisation of the composite stacking sequence of hydrogen pressure vessels manufactured by filament winding. It is a response to the need to developExpand
Optimisation du dimensionnement d'un réservoir composite type IV pour stockage très haute pression d'hydrogène
Ce travail a pour but de proposer une nouvelle approche du dimensionnement optimise des reservoirs de stockage d’hydrogene de type IV visant a mieux repondre aux enjeux industriels. Les objectifsExpand


A survey of cross-validation procedures for model selection
This survey intends to relate the model selection performances of cross-validation procedures to the most recent advances of model selection theory, with a particular emphasis on distinguishing empirical statements from rigorous theoretical results. Expand
On Cross Validation for Model Selection
It is shown here that cross validation has very poor performances for the selection of linear models as compared to classic statistical tests, and it is concluded that the statistical tests are preferable to cross validation for linear as well as for nonlinear model selection. Expand
Optimal Model Assessment, Selection, and Combination
Central to statistical theory and application is statistical modeling, which typically involves choosing a single model or combining a number of models of different sizes and from different sources.Expand
Adaptive Model Selection
Most model selection procedures use a fixed penalty penalizing an increase in the size of a model. These nonadaptive selection procedures perform well only in one type of situation. For instance,Expand
Linear Model Selection by Cross-validation
Abstract We consider the problem of selecting a model having the best predictive ability among a class of linear models. The popular leave-one-out cross-validation method, which is asymptoticallyExpand
On Measuring and Correcting the Effects of Data Mining and Model Selection
Abstract In the theory of linear models, the concept of degrees of freedom plays an important role. This concept is often used for measurement of model complexity, for obtaining an unbiased estimateExpand
The Predictive Sample Reuse Method with Applications
A recently devised method of prediction based on sample reuse techniques that is most useful in low structure data paradigms that involve minimal assumptions is presented. Expand
Adaptive model selection in linear mixed models
This dissertation aims to demonstrate the power of data-driven decision-making and the role that individual actions, rather than large-scale decisions, can have in determining the shape of a person's life. Expand
The Elements of Statistical Learning
  • E. Ziegel
  • Computer Science, Mathematics
  • Technometrics
  • 2003
Chapter 11 includes more case studies in other areas, ranging from manufacturing to marketing research, and a detailed comparison with other diagnostic tools, such as logistic regression and tree-based methods. Expand
Principles and Theory for Data Mining and Machine Learning
This book is a thorough introduction to the most important topics in data mining and machine learning. It begins with a detailed review of classical function estimation and proceeds with chapters onExpand