Relaxed Steepest Descent and Cauchy-Barzilai-Borwein Method

@article{Raydan2002RelaxedSD,
  title={Relaxed Steepest Descent and Cauchy-Barzilai-Borwein Method},
  author={Marcos Raydan and Benar Fux Svaiter},
  journal={Comp. Opt. and Appl.},
  year={2002},
  volume={21},
  pages={155-167}
}
The negative gradient direction to find local minimizers has been associated with the classical steepest descent method which behaves poorly except for very well conditioned problems. We stress out that the poor behavior of the steepest descent methods is due to the optimal Cauchy choice of steplength and not to the choice of the search direction. We discuss over and under relaxation of the optimal steplength. In fact, we study and extend recent nonmonotone choices of steplength that… CONTINUE READING
57 Citations
9 References
Similar Papers

References

Publications referenced by this paper.
Showing 1-9 of 9 references

Two point step size gradient methods

  • J. BARZILAI, J. M. BORWEIN
  • IMA J. Numer. Anal., 8:141–148,
  • 1988
Highly Influential
5 Excerpts

R-linear convergence of the Barzilai and Borwein gradient method

  • Y. H. DAI, L. Z. LIAO
  • IMA J. Numer. Anal., 22:1–10,
  • 2002
2 Excerpts

On the Barzilai and Borwein choice of steplength for the gradient method

  • M. RAYDAN
  • IMA J. Numer. Anal., 13:321–326,
  • 1993
2 Excerpts

Padé–Type Approximation and General Orthogonal Polynomials

  • C. BREZINSKI
  • Birkhauser–Verlag, Basel,
  • 1980
1 Excerpt

On a successive transformation of probability distribution and its application to the analysis of the optimum gradient method

  • H. AKAIKE
  • Ann. Inst. Statist. Math. Tokyo, 11:1–16,
  • 1959
1 Excerpt

Méthodes générales pour la résolution des systèmes d’équations simultanées

  • A. CAUCHY
  • C. R. Acad. Sci. Par., 25:536–538,
  • 1847
1 Excerpt

Similar Papers

Loading similar papers…