#### Filter Results:

- Full text PDF available (66)

#### Publication Year

1975

2016

- This year (0)
- Last five years (12)

#### Publication Type

#### Co-author

#### Publication Venue

#### Data Set Used

#### Key Phrases

Learn More

- Richard H. Byrd, Peihuang Lu, Jorge Nocedal, Ciyou Zhu
- SIAM J. Scientific Computing
- 1995

An algorithm for solving large nonlinear optimization problems with simple bounds is described. It is based on the gradient projection method and uses a limited-memory BFGS matrix to approximate the Hessian of the objective function. We show how to take advantage of the form of the limited-memory approximation to implement the algorithm eeciently. Theâ€¦ (More)

L-BFGS-B is a limited memory algorithm for solving large nonlinear optimization problems subject to simple bounds on the variables. It is intended for problems in which information on the Hessian matrix is diicult to obtain, or for large dense problems. L-BFGS-B can also be used for unconstrained problems, and in this case performs similarly to itsâ€¦ (More)

- Richard H. Byrd, Mary E. Hribar, Jorge Nocedal
- SIAM Journal on Optimization
- 1999

The design and implementation of a new algorithm for solving large nonlinear programming problems is described. It follows a barrier approach that employs sequential quadratic programming and trust regions to solve the subproblems occurring in the iteration. Both primal and primal-dual versions of the algorithm are developed, and their performance isâ€¦ (More)

- Richard H. Byrd, Jorge Nocedal, Bobby Schnabel
- Math. Program.
- 1994

We derive compact representations of BFGS and symmetric rank-one matrices for optimization. These representations allow us to eeciently implement limited memory methods for large constrained optimization problems. In particular, we discuss how to compute projections of limited memory matrices onto subspaces. We also present a compact representation of theâ€¦ (More)

This paper describes Knitro 5.0, a C-package for nonlinear optimization that combines complementary approaches to nonlinear optimization to achieve robust performance over a wide range of application requirements. The package is designed for solving large-scale, smooth nonlinear programming problems, and it is also effective for the following special cases:â€¦ (More)

- Richard H. Byrd, Jean Charles Gilbert, Jorge Nocedal
- Math. Program.
- 2000

An algorithm for minimizing a nonlinear function subject to nonlinear inequality constraints is described. It applies sequential quadratic programming techniques to a sequence of barrier problems, and uses trust regions to ensure the robustness of the iteration and to allow the direct use of second order derivatives. This framework permits primal andâ€¦ (More)

- Richard H. Byrd, S. L. Hansen, Jorge Nocedal, Yoram Singer
- SIAM Journal on Optimization
- 2016

The question of how to incorporate curvature information in stochastic approximation methods is challenging. The direct application of classical quasi-Newton updating techniques for deterministic optimization leads to noisy curvature estimates that have harmful effects on the robustness of the iteration. In this paper, we propose a stochastic quasi-Newtonâ€¦ (More)

- Richard H. Byrd, Gillian M. Chin, Will Neveitt, Jorge Nocedal
- SIAM Journal on Optimization
- 2011

This paper describes how to incorporate sampled curvature information in a Newton-CG method and in a limited memory quasi-Newton method for statistical learning. The motivation for this work stems from supervised machine learning applications involving a very large number of training points. We follow a batch approach, also known in the stochasticâ€¦ (More)

- Richard H. Byrd, Bobby Schnabel, Gerald A. Shultz
- Math. Program.
- 1988

- Paul T. Boggs, Janet R. Donaldson, Richard H. Byrd, Bobby Schnabel
- ACM Trans. Math. Softw.
- 1989

In this paper, we describe ODRPACK, a software package for the weighted orthogonal distance regression problem. This software is an implementation of the algorithm described in [2] for finding the parameters that minimize the sum of the squared weighted orthogonal distances from a set of observations to a curve or surface determined by the parameters. Itâ€¦ (More)