Bayesian optimization for conditional hyperparameter spaces

@article{Levesque2017BayesianOF,
  title={Bayesian optimization for conditional hyperparameter spaces},
  author={Julien-Charles Levesque and Audrey Durand and Christian Gagn{\'e} and Robert Sabourin},
  journal={2017 International Joint Conference on Neural Networks (IJCNN)},
  year={2017},
  pages={286-293}
}
  • Julien-Charles Levesque, Audrey Durand, +1 author Robert Sabourin
  • Published in
    International Joint…
    2017
  • Computer Science
  • Hyperparameter optimization is now widely applied to tune the hyperparameters of learning algorithms. The hyperparameters can have structure, resulting in hyperparameters depending on conditions, or on the values of other hyperparameters. We target the problem of combined algorithm selection and hyperparameter optimization, which includes at least one conditional hyperparameter: the choice of the learning algorithm. In this work, we show that Bayesian optimization with Gaussian processes can be… CONTINUE READING

    Create an AI-powered research feed to stay up to date with new papers like this posted to ArXiv

    Citations

    Publications citing this paper.
    SHOWING 1-10 OF 11 CITATIONS

    A New Approach Towards the Combined Algorithm Selection and Hyper-parameter Optimization Problem

    • Xin Guo
    • Computer Science
    • 2019 IEEE Symposium Series on Computational Intelligence (SSCI)
    • 2019
    VIEW 5 EXCERPTS
    CITES METHODS
    HIGHLY INFLUENCED

    Interpretability With Accurate Small Models

    VIEW 2 EXCERPTS
    CITES BACKGROUND

    Locus: A System and a Language for Program Optimization

    VIEW 1 EXCERPT
    CITES BACKGROUND

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 15 REFERENCES

    Slice sampling covariance hyperparameters of latent Gaussian models

    VIEW 8 EXCERPTS
    HIGHLY INFLUENTIAL

    Practical Bayesian Optimization of Machine Learning Algorithms

    VIEW 4 EXCERPTS
    HIGHLY INFLUENTIAL

    The CMA Evolution Strategy: A Tutorial

    VIEW 1 EXCERPT