Corpus ID: 204915923

BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search

@inproceedings{White2021BANANASBO,
  title={BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search},
  author={C. White and W. Neiswanger and Yash Savani},
  booktitle={AAAI},
  year={2021}
}
Neural Architecture Search (NAS) has seen an explosion of research in the past few years, with techniques spanning reinforcement learning, evolutionary search, Gaussian process (GP) Bayesian optimization (BO), and gradient descent. While BO with GPs has seen great success in hyperparameter optimization, there are many challenges applying BO to NAS, such as the requirement of a distance function between neural networks. In this work, we develop a suite of techniques for high-performance BO… Expand
Efficient Sampling for Predictor-Based Neural Architecture Search
Hyperparameter optimization with REINFORCE and Transformers
Hyper-parameter optimization with REINFORCE and Masked Attention Auto-regressive Density Estimators
Optimal Transport Kernels for Sequential and Parallel Neural Architecture Search
How Powerful are Performance Predictors in Neural Architecture Search?
Automated Design of Deep Neural Networks
  • E. Talbi
  • Computer Science
  • ACM Comput. Surv.
  • 2021
Empirical Evaluation of Random Wired Neural Networks
Self-supervised Representation Learning for Evolutionary Neural Architecture Search
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 90 REFERENCES
Neural Architecture Search with Bayesian Optimisation and Optimal Transport
SNAS: Stochastic Neural Architecture Search
BayesNAS: A Bayesian Approach for Neural Architecture Search
Accelerating Neural Architecture Search using Performance Prediction
Scalable Bayesian Optimization Using Deep Neural Networks
Neural Architecture Search with Reinforcement Learning
TAPAS: Train-less Accuracy Predictor for Architecture Search
...
1
2
3
4
5
...