Two Approaches to Optimal Annealing

@inproceedings{Leen1997TwoAT,
  title={Two Approaches to Optimal Annealing},
  author={Todd K. Leen and Bernhard Schottky and David Saad},
  booktitle={NIPS},
  year={1997}
}
We employ both master equation and order parameter approaches to analyze the asymptotic dynamics of on-line learning with different learning rate annealing schedules. We examine the relations between the results obtained by the two approaches and obtain new results on the optimal decay coefficients and their dependence on the number of hidden nodes in a two layer architecture. 

From This Paper

Figures, tables, and topics from this paper.
3 Citations
6 References
Similar Papers

Citations

Publications citing this paper.

References

Publications referenced by this paper.
Showing 1-6 of 6 references

Dynamics and Algorithms for Stochastic Search

  • G. B. Orr
  • PhD thesis, Oregon Graduate Institute,
  • 1996
1 Excerpt

A 28

  • M. Biehl, H. Schwarze, J. Phys
  • 643
  • 1995
2 Excerpts

In Giles

  • T. K. Leen, J. E. Moody
  • Hanson, and Cowan, editors, Advances in Neural In…
  • 1993
1 Excerpt

Phys

  • T. M. Heskes, B. Kappen
  • Rev. A 44, 2718
  • 1991
2 Excerpts

Technical Report DRB-306

  • L. Goldstein
  • Dept. of Mathematics, University of Southern…
  • 1987
1 Excerpt

Similar Papers

Loading similar papers…