A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection

@inproceedings{Kohavi1995ASO,
  title={A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection},
  author={Ron Kohavi},
  booktitle={IJCAI},
  year={1995}
}
We review accuracy estimation methods and compare the two most common methods crossvalidation and bootstrap. Recent experimental results on artificial data and theoretical re cults in restricted settings have shown that for selecting a good classifier from a set of classifiers (model selection), ten-fold cross-validation may be better than the more expensive leaveone-out cross-validation. We report on a largescale experiment--over half a million runs of C4.5 and a Naive-Bayes algorithm--to… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 5,087 CITATIONS

Semantic Indoor Scene Recognition of Time-Series Arial Images from a Micro Air Vehicle Mounted Monocular Camera

  • 2018 18th International Conference on Control, Automation and Systems (ICCAS)
  • 2018
VIEW 4 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

Geochemical Mapping for Mineral Exploration

  • 2017
VIEW 7 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Grassland Height Assessment by Satellite Images

VIEW 4 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

FILTER CITATIONS BY YEAR

1993
2019

CITATION STATISTICS

  • 296 Highly Influenced Citations

  • Averaged 506 Citations per year from 2017 through 2019

References

Publications referenced by this paper.
SHOWING 1-9 OF 9 REFERENCES

1994a), O -training set error and a pri

D. H. Wolpert
  • 1994
VIEW 3 EXCERPTS

1994b), The relationship between PAC

D. H. Wolpert
  • 1994
VIEW 3 EXCERPTS

MLC++: A machine

K. P eger
  • 1994
VIEW 1 EXCERPT

On the distributional properties

P. Zhang
  • 1992
VIEW 1 EXCERPT

\ Submodel selectionand evaluation in regression . the x - random case "

P. Spector
  • International Statistical Review
  • 1992
VIEW 1 EXCERPT

Small Sample Error Rate Estimation for k-NN Classifiers

  • IEEE Trans. Pattern Anal. Mach. Intell.
  • 1991
VIEW 1 EXCERPT