# A Review of Cross Validation and Adaptive Model Selection

@inproceedings{Syed2011ARO, title={A Review of Cross Validation and Adaptive Model Selection}, author={A. Syed}, year={2011} }

We perform a review of model selection procedures, in particular various cross validation procedures and adaptive model selection. We cover important results for these procedures and explore the connections between different procedures and information criteria. INDEX WORDS: Model selection, Adaptive model selection, Cross validation, Information Criteria A REVIEW OF CROSS VALIDATION AND ADAPTIVE MODEL SELECTION

#### Figures and Topics from this paper

#### 11 Citations

V-Splines and Bayes Estimate

- Mathematics
- 2018

Smoothing splines can be thought of as the posterior mean of a Gaussian process regression in a certain limit. By constructing a reproducing kernel Hilbert space with an appropriate inner product,… Expand

A rainfall forecasting method using machine learning models and its application to the Fukuoka city case

- Computer Science
- Int. J. Appl. Math. Comput. Sci.
- 2012

An attempt is made to derive optimal data-driven machine learning methods for forecasting an average daily and monthly rainfall of the Fukuoka city in Japan concentrating on three aspects: modelling inputs, modelling methods and pre-processing techniques. Expand

ST ] 2 4 Ju l 2 01 8 V-Spline and Bayes Estimate

- 2018

It is known that a smoothing spline can be thought of as the posterior mean of a Gaussian process regression in a certain limit. By constructing a reproducing kernel Hilbert space with an appropriate… Expand

A satellite-based model for estimating PM2.5 concentration in a sparsely populated environment using soft computing techniques

- Computer Science
- Environ. Model. Softw.
- 2017

The results suggested that soft computing methods like ANFIS, in combination with spatiotemporal data from satellites, meteorological data and geographical information improve the estimate of PM2.5 concentration in sparsely populated areas. Expand

Malaria early warning tool: linking inter-annual climate and malaria variability in northern Guadalcanal, Solomon Islands

- Biology, Medicine
- Malaria Journal
- 2017

This study demonstrated that rainfall provides the best predictor of malaria transmission in North Guadalcanal, thought to be underpinned by the unique hydrological conditions in northern Guadal canal which allow sandbars to form across the mouths of estuaries which act to develop or increase stagnant brackish marshes in low rainfall periods. Expand

Adaptive Smoothing V-Spline for Trajectory Reconstruction

- Computer Science
- 2018

A new method named the V-spline is proposed, which incorporates both location and velocity information but penalizes excessive accelerations and includes a parameter that controls the degree to which the velocity information is used in the reconstruction. Expand

Adaptive Smoothing for Trajectory Reconstruction

- Mathematics
- 2018

Trajectory reconstruction is the process of inferring the path of a moving object between successive observations. In this paper, we propose a smoothing spline -- which we name the V-spline -- that… Expand

Inference and Characterization of Planar Trajectories

- Computer Science
- 2018

A new method named the V-spline is proposed, which incorporates both location and velocity information but penalizes excessive accelerations, and is applied to the joint state and parameters estimation in the case of irregularly sampled GPS time series data. Expand

Optimisation of 700 bar type IV hydrogen pressure vessel considering composite damage and dome multi-sequencing

- Materials Science
- 2015

Abstract This study investigated with the optimisation of the composite stacking sequence of hydrogen pressure vessels manufactured by filament winding. It is a response to the need to develop… Expand

Optimisation du dimensionnement d'un réservoir composite type IV pour stockage très haute pression d'hydrogène

- Physics
- 2013

Ce travail a pour but de proposer une nouvelle approche du dimensionnement optimise des reservoirs de stockage d’hydrogene de type IV visant a mieux repondre aux enjeux industriels. Les objectifs… Expand

#### References

SHOWING 1-10 OF 34 REFERENCES

A survey of cross-validation procedures for model selection

- Computer Science, Mathematics
- 2010

This survey intends to relate the model selection performances of cross-validation procedures to the most recent advances of model selection theory, with a particular emphasis on distinguishing empirical statements from rigorous theoretical results. Expand

On Cross Validation for Model Selection

- Mathematics, Medicine
- Neural Computation
- 1999

It is shown here that cross validation has very poor performances for the selection of linear models as compared to classic statistical tests, and it is concluded that the statistical tests are preferable to cross validation for linear as well as for nonlinear model selection. Expand

Optimal Model Assessment, Selection, and Combination

- Mathematics
- 2006

Central to statistical theory and application is statistical modeling, which typically involves choosing a single model or combining a number of models of different sizes and from different sources.… Expand

Adaptive Model Selection

- Mathematics
- 2002

Most model selection procedures use a fixed penalty penalizing an increase in the size of a model. These nonadaptive selection procedures perform well only in one type of situation. For instance,… Expand

Linear Model Selection by Cross-validation

- Mathematics
- 1993

Abstract We consider the problem of selecting a model having the best predictive ability among a class of linear models. The popular leave-one-out cross-validation method, which is asymptotically… Expand

On Measuring and Correcting the Effects of Data Mining and Model Selection

- Mathematics
- 1998

Abstract In the theory of linear models, the concept of degrees of freedom plays an important role. This concept is often used for measurement of model complexity, for obtaining an unbiased estimate… Expand

The Predictive Sample Reuse Method with Applications

- Computer Science
- 1975

A recently devised method of prediction based on sample reuse techniques that is most useful in low structure data paradigms that involve minimal assumptions is presented. Expand

Adaptive model selection in linear mixed models

- Computer Science
- 2009

This dissertation aims to demonstrate the power of data-driven decision-making and the role that individual actions, rather than large-scale decisions, can have in determining the shape of a person's life. Expand

The Elements of Statistical Learning

- Computer Science, Mathematics
- Technometrics
- 2003

Chapter 11 includes more case studies in other areas, ranging from manufacturing to marketing research, and a detailed comparison with other diagnostic tools, such as logistic regression and tree-based methods. Expand

Principles and Theory for Data Mining and Machine Learning

- Computer Science
- 2009

This book is a thorough introduction to the most important topics in data mining and machine learning. It begins with a detailed review of classical function estimation and proceeds with chapters on… Expand