PMLB: a large benchmark suite for machine learning evaluation and comparison

@article{Olson2017PMLBAL,
  title={PMLB: a large benchmark suite for machine learning evaluation and comparison},
  author={R. S. Olson and W. L. Cava and P. Orzechowski and R. Urbanowicz and J. Moore},
  journal={BioData Mining},
  year={2017},
  volume={10}
}
  • R. S. Olson, W. L. Cava, +2 authors J. Moore
  • Published 2017
  • Computer Science, Medicine
  • BioData Mining
    • BackgroundThe selection, development, or comparison of machine learning methods in data mining can be a difficult task based on the target problem and goals of a particular study. Numerous publicly available real-world and simulated benchmark datasets have emerged from different sources, but their organization and adoption as standards have been inconsistent. As such, selecting and curating specific benchmarks remains an unnecessary burden on machine learning practitioners and data scientists… CONTINUE READING
    View on Springer
    biodatamining.biomedcentral.com
    133 Citations
    Highly Influential Citations
    12
    Background Citations
    25
    Methods Citations
    63

    Supplemental Code

    Github Repo
    Via Papers with Code
    EpistasisLab/pmlb
    PMLB: A large, curated repository of benchmark datasets for evaluating supervised machine learning algorithms.
    530 Stars • 89 Forks
    Explore Further
    Discover more papers related to the topics discussed in this paper

    Figures and Topics from this paper

    Figures

    Explore Further: Topics Discussed in This Paper

    133 Citations
    Citation Type

    Citation Type

    Benchmark AFLOW Data Sets for Machine Learning
    • 3
    ShinyLearner: A containerized benchmarking tool for machine-learning classification of tabular data
    • 1
    • PDF
    ShinyLearner: A containerized benchmarking tool for machine-learning classification of tabular data
    • PDF
    OpenML Benchmarking Suites
    • 21
    TPOT: A Tree-based Pipeline Optimization Tool for Automating Machine Learning
    • 175
    • PDF
    Scaling tree-based automated machine learning to biomedical big data with a dataset selector
    • 1
    • PDF
    Efficient and Robust Model Benchmarks with Item Response Theory and Adaptive Testing
    • PDF
    Where are we now?: a large benchmark study of recent symbolic regression methods
    • 39
    • PDF
    Evolutionary dataset optimisation: learning algorithm quality through evolution
    • 3
    • PDF
    OpenML Benchmarking Suites and the OpenML100
    • 34
    • PDF

    References

    SHOWING 1-10 OF 33 REFERENCES
    A Comprehensive Dataset for Evaluating Approaches of Various Meta-learning Tasks
    • 19
    • PDF
    ExSTraCS 2.0: description and evaluation of a scalable learning classifier system
    • 58
    Machine Learning Benchmarks and Random Forest Regression
    • 327
    Towards UCI+: A mindful repository design
    • 32
    • Highly Influential
    Instance spaces for machine learning classification
    • 46
    • PDF
    An empirical comparison of supervised learning algorithms
    • 1,810
    • PDF
    A balanced accuracy function for epistasis modeling in imbalanced datasets using multifactor dimensionality reduction
    • 315
    Genetic programming needs better benchmarks
    • 200
    • PDF
    Scikit-learn: Machine Learning in Python
    • 29,733
    • PDF
    OpenML: networked science in machine learning
    • 524
    • PDF