Duality relationships for entropy-like minimization problems

  title={Duality relationships for entropy-like minimization problems},
  author={Jonathan Michael Borwein and Adrian S. Lewis},
  journal={Siam Journal on Control and Optimization},
  • J. Borwein, A. Lewis
  • Published 1 February 1991
  • Mathematics
  • Siam Journal on Control and Optimization
This paper considers the minimization of a convex integral functional over the positive cone of an $L_p $ space, subject to a finite number of linear equality constraints. Such problems arise in spectral estimation, where the bjective function is often entropy-like, and in constrained approximation. The Lagrangian dual problem is finite-dimensional and unconstrained. Under a quasi-interior constraint qualification, the primal and dual values are equal, with dual attainment. Examples show the… 
Minimization of entropy functionals revisited
  • I. Csiszár, F. Matús
  • Mathematics
    2012 IEEE International Symposium on Information Theory Proceedings
  • 2012
Integral functionals based on convex normal integrands are minimized subject to finitely many moment constraints and a generalized Pythagorean identity is presented using Bregman distance and a correction term.
Minimizers of energy functionals
We consider a general class of problems of minimization of convex integralfunctionals (maximization of entropy) subject to linear constraints. Undergeneral assumptions, the minimizing solutions are
Generalized Minimizers of Convex Integral Functionals and Pythagorean Identities
The minimization is viewed as a primal problem and studied together with a dual one in the framework of convex duality and explicitly described whenever the primal value is finite.
Convex minimization problems with weak constraint qualifications
This article revisits the standard saddle-point method based on conjugate duality for solving convex minimization problems and works with intrinsic topologies which reflect some geometry of the objective function.
Minimization of entropy functionals
The approach covers, in particular, optimal control problems with trajectory governed by a system of linear differential equations, where the additional constraints can for example force the trajectory to visit some convex sets at certain moments of time.
Duality and the Computation of Approximate Invariant Densities for Nonsingular Transformations
The method of the paper circumvents technical obstructions in the derivation of optimality conditions and yields an unexpected benefit: each finite moment approximation leads to rigorous bounds on the support of all invariant densities for $T$.
Double Smoothing Technique for Large-Scale Linearly Constrained Convex Optimization
This paper dualizes the linear constraints, solves the resulting dual problem with a purely dual gradient-type method and shows how to reconstruct an approximate primal solution.
A Note on Cores and Quasi Relative Interiors in Partially Finite Convex Programming
The problem of minimizing an entropy functional subject to linear constraints is a useful example of partially finite convex programming. In the 1990s, Borwein and Lewis provided broad and
Generalized minimizers of convex integral functionals and Pythagorean identities
Integral functionals based on convex normal integrands are minimized subject to nitely many moment constraints. The eective domain of the value function is described by a modication of the concept of


Partially finite convex programming, Part II: Explicit lattice models
This work derived a duality theorem for partially finite convex programs, problems for which the standard Slater condition fails almost invariably, and shall apply its results to a number of more concrete problems, including variants of semi-infinite linear programming, L1 approximation, constrained approximation and interpolation, spectral estimation, semi-Infinite transportation problems and the generalized market area problem of Lowe and Hurter (1976).
A dual approach to multidimensional L p spectral estimation problems
A complete duality theory is presented for the multidimensional $L_p$ spectral estimation problem. The authors use a new constraint qualification (BWCQ) for infinite-dimensional convex programs with
Integrals which are convex functionals. II
Formulas are derived in this paper for the conjugates of convex integral functionals on Banach spaces of measurable or continuous vector-valued functions. These formulas imply the weak compactness of
Constrained interpolation and smoothing
Numerical and theoretical questions related to constrained interpolation and smoothing are treated. The prototype problem is that of finding the smoothest convex interpolant to given univariate data.
Conjugate Duality and Optimization
Kuhn-Tucker condition (0, 0) e dK(x, y) into a more explicit and familiar form. Writing where -k(y) = /0(x) + ylfl(x] + • • • + ymfm(x) and P is the nonnegative orthant in R, we see from the example
A Lagrange multiplier theorem and a sandwich theorem for convex relations
We formulate and prove various separation principles for convex relations taking values in an order complete vector space. These principles subsume the standard ones.
$L_2 $ Spectral Estimation
The problem of estimating the power spectrum given a finite number of correlations is considered. A new spectral estimation is developed that minimizes the $L_p $ norm where $1 < p < \infty $. This
Real and complex analysis
Preface Prologue: The Exponential Function Chapter 1: Abstract Integration Set-theoretic notations and terminology The concept of measurability Simple functions Elementary properties of measures
ConstrainedLp approximation
In this paper, we solve a class of constrained optimization problems that lead to algorithms for the construction of convex interpolants to convex data.
Which is the better entropy expression for speech processing: -S log S or log S?
Although both estimates lead to intelligible speech, speech based on the MESA estimate is qualitatively superior, and the empirical investigation is based on speech synthesized using the different spectral estimates.