NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search
@article{Zela2020NASBench1Shot1BA, title={NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search}, author={Arber Zela and Julien N. Siems and F. Hutter}, journal={ArXiv}, year={2020}, volume={abs/2001.10422} }
One-shot neural architecture search (NAS) has played a crucial role in making NAS methods computationally feasible in practice. Nevertheless, there is still a lack of understanding on how these weight-sharing algorithms exactly work due to the many factors controlling the dynamics of the process. In order to allow a scientific study of these components, we introduce a general framework for one-shot NAS that can be instantiated to many recently-introduced variants and introduce a general… Expand
Supplemental Code
Figures, Tables, and Topics from this paper
Paper Mentions
Blog Post
Blog Post
Blog Post
Blog Post
42 Citations
One-Shot Neural Architecture Search: Maximising Diversity to Overcome Catastrophic Forgetting.
- Computer Science, Medicine
- IEEE transactions on pattern analysis and machine intelligence
- 2020
- 1
- PDF
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search
- Computer Science
- ICLR
- 2020
- 88
- Highly Influenced
- PDF
NAS-Bench-301 and the Case for Surrogate Benchmarks for Neural Architecture Search
- Computer Science
- ArXiv
- 2020
- 11
- PDF
Auto-PyTorch Tabular: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL
- Computer Science, Mathematics
- ArXiv
- 2020
- 6
- PDF
NASTransfer: Analyzing Architecture Transferability in Large Scale Neural Architecture Search
- Computer Science
- ArXiv
- 2020
- 1
- PDF
NATS-Bench: Benchmarking NAS algorithms for Architecture Topology and Size
- Medicine, Computer Science
- IEEE transactions on pattern analysis and machine intelligence
- 2021
- 9
- Highly Influenced
- PDF
References
SHOWING 1-10 OF 34 REFERENCES
SMASH: One-Shot Model Architecture Search through HyperNetworks
- Computer Science, Mathematics
- ICLR
- 2018
- 387
- Highly Influential
- PDF
Evaluating the Search Phase of Neural Architecture Search
- Computer Science, Mathematics
- ICLR
- 2020
- 161
- PDF
Random Search and Reproducibility for Neural Architecture Search
- Computer Science, Mathematics
- UAI
- 2019
- 267
- Highly Influential
- PDF
Understanding and Simplifying One-Shot Architecture Search
- Computer Science
- ICML
- 2018
- 313
- Highly Influential
- PDF
SNAS: Stochastic Neural Architecture Search
- Computer Science, Mathematics
- ICLR
- 2019
- 385
- Highly Influential
- PDF
DARTS: Differentiable Architecture Search
- Computer Science, Mathematics
- ICLR
- 2019
- 1,253
- Highly Influential
- PDF
Neural Architecture Search with Reinforcement Learning
- Computer Science, Mathematics
- ICLR
- 2017
- 2,384
- Highly Influential
- PDF