Highly Influenced

@inproceedings{Bello2017NeuralOS, title={Neural Optimizer Search with Reinforcement Learning}, author={Irwan Bello and Barret Zoph and Vijay Vasudevan and Quoc V. Le}, booktitle={ICML}, year={2017} }

- Published 2017 in ICML

We present an approach to automate the process of discovering optimization methods, with a focus on deep learning architectures. We train a Recurrent Neural Network controller to generate a string in a specific domain language that describes a mathematical update equation based on a list of primitive functions, such as the gradient, running average of the gradient, etc. The controller is trained with Reinforcement Learning to maximize the performance of a model after a few epochs. On CIFAR-10… CONTINUE READING

Highly Cited

This paper has 26 citations. REVIEW CITATIONS

Citations per Year

Averaging **17 citations** per year over the last 2 years.

### GitHub repos referencing this paper

- GradientDescent_OptimizationAlgorithms
Save my Stochastic Gradient optimization algorithm code

### Presentations referencing similar topics