Monotone operator theory in convex optimization

  title={Monotone operator theory in convex optimization},
  author={Patrick L. Combettes},
  journal={Mathematical Programming},
  • P. L. Combettes
  • Published 8 February 2018
  • Mathematics
  • Mathematical Programming
Several aspects of the interplay between monotone operator theory and convex optimization are presented. The crucial role played by monotone operators in the analysis and the numerical solution of convex minimization problems is emphasized. We review the properties of subdifferentials as maximally monotone operators and, in tandem, investigate those of proximity operators as resolvents. In particular, we study new transformations which map proximity operators to proximity operators, and… 

Multivariate Monotone Inclusions in Saddle Form

A novel approach to monotone operator splitting based on the notion of a saddle operator, which achieves full splitting, exploits the specific attributes of each operator, is asynchronous, and requires to activate only blocks of operators at each iteration, as opposed to activating all of them.

Proximal Splitting Algorithms for Convex Optimization: A Tour of Recent Advances, with New Twists

This overview of recent proximal splitting algorithms presents them within a unified framework, which consists in applying splitting methods for monotone inclusions in primal-dual product spaces, with well-chosen metrics, and emphasizes that when the smooth term in the objective function is quadratic, convergence is guaranteed with larger values of the relaxation parameter than previously known.

Bregman Forward-Backward Operator Splitting

We propose an iterative method for finding a zero of the sum of two maximally monotone operators in reflexive Banach spaces. One of the operators is single-valued, and the method alternates an

Proximal Splitting Algorithms: A Tour of Recent Advances, with New Twists.

This overview of recent proximal splitting algorithms within a unified framework, which consists in applying splitting methods for monotone inclusions in primal-dual product spaces, with well-chosen metric, is presented.

Resolvent and Proximal Compositions

. We introduce the resolvent composition, a monotonicity-preserving operation between a linear operator and a set-valued operator, as well as the proximal composition, a convexity-preserving

Warped proximal iterations for monotone inclusions

Douglas-Rachford Splitting for Pathological Convex Optimization

It is established that DRS only requires strong duality to work, in the sense that asymptotically iterates are approximately feasible and approximately optimal.

Fast convergence of generalized forward-backward algorithms for structured monotone inclusions

In this paper, we develop rapidly convergent forward-backward algorithms for computing zeroes of the sum of finitely many maximally monotone operators. A modification of the classical

Proximal splitting algorithms: Relax them all!

This work presents several existing proximal splitting algorithms and derives new ones, within a unified framework, which consists in applying splitting methods for monotone inclusions, like the forward-backward algorithm, in primal-dual product spaces with well-chosen metric, to derive new convergence theorems with larger parameter ranges.

Fixing and extending some recent results on the ADMM algorithm

A variant of the ADMM algorithm is formulated that is able to handle convex optimization problems involving an additional smooth function in its objective, and which is evaluated through its gradient.



Convex Analysis and Monotone Operator Theory in Hilbert Spaces

This book provides a largely self-contained account of the main results of convex analysis and optimization in Hilbert space. A concise exposition of related constructive fixed point theory is

A survey on operator splitting and decomposition of convex programs

This work focuses on the numerical sensitivity of these algorithms with respect to the scaling parameters that drive the regularizing terms, in order to accelerate convergence rates for different classes of models.

Convex Functions, Monotone Operators and Differentiability

These notes start with an introduction to the differentiability of convex functions on Banach spaces, leading to the study of Asplund spaces and their intriguing relationship to monotone operators

On Douglas–Rachford operators that fail to be proximal mappings

This work considers the class of symmetric linear relations that are maximally monotone and proves the striking result that the Douglas–Rachford operator is generically not a proximal mapping.

Solving monotone inclusions via compositions of nonexpansive averaged operators

A unified fixed point theoretic framework is proposed to investigate the asymptotic behavior of algorithms for finding solutions to monotone inclusion problems. The basic iterative scheme under

Asplund Decomposition of Monotone Operators

It is established that representations of a monotone mapping are established as the sum of a maximal subdifferential mapping and a “remainder” monot one mapping, where the remainder is “acyclic” in the sense that it contains no nontrivial sub differential component.

A Monotone+Skew Splitting Model for Composite Monotone Inclusions in Duality

The principle underlying this paper is the basic observation that the problem of simultaneously solving a large class of composite monotone inclusions and their duals can be reduced to that of

A Dykstra-like algorithm for two monotone operators

Dykstra’s algorithm employs the projectors onto two closed convex sets in a Hilbert space to construct iteratively the projector onto their intersection. In this paper, we use a duality argument to

On Borwein--Wiersma Decompositions of Monotone Linear Relations

This paper presents a detailed study of the Borwein-Wiersma decomposition of a maximal monotone linear relation, and gives sufficient conditions and characterizations for a maximalmonotonelinear relation to be BorweIn-Wiresma decomposable and shows that Borwe in-Wierscher decomposition implies Asplund decomposability.

A splitting algorithm for dual monotone inclusions involving cocoercive operators

  • B. Vu
  • Mathematics
    Adv. Comput. Math.
  • 2013
This work considers the problem of solving dual monotone inclusions involving sums of composite parallel-sum type operators and exploits explicitly the properties of the cocoercive operators appearing in the model.