Corpus ID: 80628408

Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly

  title={Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly},
  author={Kirthevasan Kandasamy and Karun Raju Vysyaraju and W. Neiswanger and Biswajit Paria and C. Collins and Jeff Schneider and B. P{\'o}czos and E. Xing},
  • Kirthevasan Kandasamy, Karun Raju Vysyaraju, +5 authors E. Xing
  • Published 2019
  • Computer Science, Mathematics
  • ArXiv
  • Bayesian Optimisation (BO), refers to a suite of techniques for global optimisation of expensive black box functions, which use introspective Bayesian models of the function to efficiently find the optimum. While BO has been applied successfully in many applications, modern optimisation tasks usher in new challenges where conventional methods fail spectacularly. In this work, we present Dragonfly, an open source Python library for scalable and robust BO. Dragonfly incorporates multiple recently… CONTINUE READING
    BoTorch: Programmable Bayesian Optimization in PyTorch
    • 32
    • Highly Influenced
    • PDF
    A Flexible Framework for Multi-Objective Bayesian Optimization using Random Scalarizations
    • 14
    • PDF
    ChemBO: Bayesian Optimization of Small Organic Molecules with Synthesizable Recommendations
    • 16
    • PDF
    Sherpa: Robust Hyperparameter Optimization for Machine Learning
    • 4
    • PDF


    Publications referenced by this paper.
    Efficient Global Optimization of Expensive Black-Box Functions
    • 4,673
    • PDF
    Deep Residual Learning for Image Recognition
    • 50,533
    • PDF
    Practical Bayesian Optimization of Machine Learning Algorithms
    • 3,287
    • Highly Influential
    • PDF
    Gaussian Processes for Machine Learning
    • 7,389
    • PDF
    Scalable Bayesian Optimization Using Deep Neural Networks
    • 470
    • PDF
    Densely Connected Convolutional Networks
    • 9,761
    • PDF
    Sequential Model-Based Optimization for General Algorithm Configuration
    • 1,384
    • Highly Influential
    • PDF
    Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures
    • 669
    • Highly Influential
    • PDF
    Neural Architecture Search with Reinforcement Learning
    • 1,930
    • PDF
    Neural Architecture Search with Bayesian Optimisation and Optimal Transport
    • 178
    • PDF