Corpus ID: 210932183

NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search

@article{Zela2020NASBench1Shot1BA,
  title={NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search},
  author={Arber Zela and Julien N. Siems and F. Hutter},
  journal={ArXiv},
  year={2020},
  volume={abs/2001.10422}
}
One-shot neural architecture search (NAS) has played a crucial role in making NAS methods computationally feasible in practice. Nevertheless, there is still a lack of understanding on how these weight-sharing algorithms exactly work due to the many factors controlling the dynamics of the process. In order to allow a scientific study of these components, we introduce a general framework for one-shot NAS that can be instantiated to many recently-introduced variants and introduce a general… Expand
42 Citations
Few-shot Neural Architecture Search
  • 5
  • PDF
One-Shot Neural Architecture Search: Maximising Diversity to Overcome Catastrophic Forgetting.
  • 1
  • PDF
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search
  • 88
  • Highly Influenced
  • PDF
NAS-Bench-301 and the Case for Surrogate Benchmarks for Neural Architecture Search
  • 11
  • PDF
PRODUCIBLE NEURAL ARCHITECTURE SEARCH
  • Highly Influenced
Auto-PyTorch Tabular: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL
  • 6
  • PDF
NASTransfer: Analyzing Architecture Transferability in Large Scale Neural Architecture Search
  • 1
  • PDF
Differential Evolution for Neural Architecture Search
  • 5
  • Highly Influenced
  • PDF
NATS-Bench: Benchmarking NAS algorithms for Architecture Topology and Size
  • 9
  • Highly Influenced
  • PDF
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 34 REFERENCES
NAS evaluation is frustratingly hard
  • 62
  • PDF
SMASH: One-Shot Model Architecture Search through HyperNetworks
  • 387
  • Highly Influential
  • PDF
Evaluating the Search Phase of Neural Architecture Search
  • 161
  • PDF
Probabilistic Neural Architecture Search
  • 35
  • PDF
Random Search and Reproducibility for Neural Architecture Search
  • 267
  • Highly Influential
  • PDF
Understanding and Simplifying One-Shot Architecture Search
  • 313
  • Highly Influential
  • PDF
SNAS: Stochastic Neural Architecture Search
  • 385
  • Highly Influential
  • PDF
DARTS: Differentiable Architecture Search
  • 1,253
  • Highly Influential
  • PDF
Neural Architecture Search with Reinforcement Learning
  • 2,384
  • Highly Influential
  • PDF
...
1
2
3
4
...