Corpus ID: 202775014

Learning search spaces for Bayesian optimization: Another view of hyperparameter transfer learning

@inproceedings{Perrone2019LearningSS,
  title={Learning search spaces for Bayesian optimization: Another view of hyperparameter transfer learning},
  author={Valerio Perrone and Huibin Shen and M. Seeger and C. Archambeau and Rodolphe Jenatton},
  booktitle={NeurIPS},
  year={2019}
}
Bayesian optimization (BO) is a successful methodology to optimize black-box functions that are expensive to evaluate. While traditional methods optimize each black-box function in isolation, there has been recent interest in speeding up BO by transferring knowledge across multiple related black-box functions. In this work, we introduce a method to automatically design the BO search space by relying on evaluations of previous black-box functions. We depart from the common practice of defining a… Expand
Warm Starting CMA-ES for Hyperparameter Optimization
ZERO-SHOT TRANSFER LEARNING FOR GRAY-BOX HYPER-PARAMETER OPTIMIZATION
  • 2020
Practical and sample efficient zero-shot HPO
Amortized Auto-Tuning: Cost-Efficient Transfer Optimization for Hyperparameter Recommendation
...
1
2
3
...

References

SHOWING 1-10 OF 49 REFERENCES
Filtering Bayesian optimization approach in weakly specified search space
Scalable Hyperparameter Transfer Learning
Initializing Bayesian Hyperparameter Optimization via Meta-Learning
Learning hyperparameter optimization initializations
Multi-Task Bayesian Optimization
Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly
Scalable Hyperparameter Optimization with Products of Gaussian Process Experts
Scalable Bayesian Optimization Using Deep Neural Networks
Unbounded Bayesian Optimization via Regularization
...
1
2
3
4
5
...