• DOI:10.1016/S0893-6080(98)00116-6
Corpus ID: 2783597

On the momentum term in gradient descent learning algorithms

@article{Qian1999OnTM,
  title={On the momentum term in gradient descent learning algorithms},
  author={N. Qian},
  journal={Neural networks : the official journal of the International Neural Network Society},
  year={1999},
  volume={12 1},
  pages={
          145-151
        }
}

N. Qian

Published 1999

Computer Science, Mathematics, Medicine

Neural networks : the official journal of the International Neural Network Society

A momentum term is usually included in the simulations of connectionist learning algorithms. Although it is well known that such a term greatly improves the speed of learning, there have been few rigorous studies of its mechanisms. In this paper, I show that in the limit of continuous time, the momentum parameter is analogous to the mass of Newtonian particles that move through a viscous medium in a conservative force field. The behavior of the system near a local minimum is equivalent to a set… CONTINUE READING

View on PubMed

brahms.cpmc.columbia.edu

Save to Library

Create Alert

Cite

Launch Research Feed