# The Lack of A Priori Distinctions Between Learning Algorithms

@article{Wolpert1996TheLO, title={The Lack of A Priori Distinctions Between Learning Algorithms}, author={D. Wolpert}, journal={Neural Computation}, year={1996}, volume={8}, pages={1341-1390} }

This is the first of two papers that use off-training set (OTS) error to investigate the assumption-free relationship between learning algorithms. This first paper discusses the senses in which there are no a priori distinctions between learning algorithms. (The second paper discusses the senses in which there are such distinctions.) In this first paper it is shown, loosely speaking, that for any two algorithms A and B, there are as many targets (or priors over targets) for which A has lower… Expand

#### Topics from this paper

#### 693 Citations

Domains of competence of the semi-naive Bayesian network classifiers

- Mathematics, Computer Science
- Inf. Sci.
- 2014

19- PDF

Bias-free hypothesis evaluation in multirelational domains

- Mathematics, Computer Science
- MRDM '05
- 2005

6 Highly Influenced- PDF

When is the Naive Bayes approximation not so naive?

- Computer Science, Mathematics
- Machine Learning
- 2017

7- PDF

An automatic extraction method of the domains of competence for learning classifiers using data complexity measures

- Computer Science
- Knowledge and Information Systems
- 2013

30- PDF

Active Learning Approaches for Labeling Text: Review and Assessment of the Performance of Active Learning Approaches

- Computer Science
- Political Analysis
- 2020

6- PDF

#### References

SHOWING 1-10 OF 47 REFERENCES

On the Connection between In-sample Testing and Generalization Error

- Mathematics, Computer Science
- Complex Syst.
- 1992

111- PDF

On the monotonicity of the performance of Bayesian classifiers (Corresp.)

- Mathematics, Computer Science
- IEEE Trans. Inf. Theory
- 1978

35

Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition

- Computer Science
- NATO Neurocomputing
- 1989

997

Exploring the Decision Forest: An Empirical Investigation of Occam's Razor in Decision Tree Induction

- Computer Science
- J. Artif. Intell. Res.
- 1994

88- PDF

The Relationship Between PAC, the Statistical Physics Framework, the Bayesian Framework, and the VC Framework

- Computer Science
- 1995

116

Local Algorithms for Pattern Recognition and Dependencies Estimation

- Mathematics, Computer Science
- Neural Computation
- 1993

102