Corpus ID: 220525868

Importance of Tuning Hyperparameters of Machine Learning Algorithms

@article{Weerts2020ImportanceOT,
  title={Importance of Tuning Hyperparameters of Machine Learning Algorithms},
  author={Hilde J. P. Weerts and A. M{\"u}ller and J. Vanschoren},
  journal={ArXiv},
  year={2020},
  volume={abs/2007.07588}
}
The performance of many machine learning algorithms depends on their hyperparameter settings. The goal of this study is to determine whether it is important to tune a hyperparameter or whether it can be safely set to a default value. We present a methodology to determine the importance of tuning a hyperparameter based on a non-inferiority test and tuning risk: the performance loss that is incurred when a hyperparameter is not tuned, but set to a default value. Because our methods require the… Expand
7 Citations
Meta learning for defaults: symbolic defaults
  • 6
  • PDF
Meta-Learning: A Survey
  • 178
  • PDF
TopicOcean: An Ever-Increasing Topic Model With Meta-learning
  • PDF
Sentiment Analysis Implementing BERT-based Pre-trained Language Model for Vietnamese
Exploring Opportunistic Meta-knowledge to Reduce Search Spaces for Automated Machine Learning
  • Highly Influenced
  • PDF

References

SHOWING 1-10 OF 19 REFERENCES
Tunability: Importance of Hyperparameters of Machine Learning Algorithms
  • 106
  • Highly Influential
  • PDF
Hyperparameter Importance Across Datasets
  • 55
  • PDF
To tune or not to tune: Recommending when to adjust SVM hyper-parameters via meta-learning
  • 32
  • PDF
Efficient and Robust Automated Machine Learning
  • 869
  • PDF
Random Search for Hyper-Parameter Optimization
  • 4,303
  • PDF
Scikit-learn: Machine Learning in Python
  • 31,770
  • PDF
Quantifying the Impact of Learning Algorithm Parameter Tuning
  • 43
  • PDF
On the histogram as a density estimator:L2 theory
  • 1,018
  • PDF
Equivalence Tests
  • D. Lakens
  • Psychology, Medicine
  • Social psychological and personality science
  • 2017
  • 404
  • PDF
Guide to NumPy
  • 1,169
  • PDF
...
1
2
...