BZPEER
More

Discover

About BZPEERSearchGraph

Research tools

HomeCollectionsResearchCollaborationPublish

Network

ExpertsCommunities

Opportunities

Listings

Account

Log inCreate account
Log inCreate account

Source author record

Walaa M. Moursi

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record
math.OCmath.FAmath.NA

Catalog footprint

Research overview

19works
3topics
4close collaborators

Actions

Is this your work?

Log in to claim
Open graphBrowse papers

Published work

19 publications

preprint2022arXiv

How to project onto the intersection of a closed affine subspace and a hyperplane

Let AA be a closed affine subspace and let BB be a hyperplane in a Hilbert space. Suppose we are given their associated nearest point mappings PAP_A and PBP_B, respectively. We present a formula for the projection onto their intersection A∩BA\cap B. As a special case, we derive a formula for the projection onto the intersection of two hyperplanes. These formulas provides useful information even if A∩BA\cap B is empty. Examples and numerical experiments are also provided.

Open access
preprint2022arXiv

Strongly nonexpansive mappings revisited: uniform monotonicity and operator splitting

The correspondence between the class of nonexpansive mappings and the class of maximally monotone operators via the reflected resolvents of the latter has played an instrumental role in the convergence analysis of the splitting methods. Indeed, the performance of some of these methods, e.g., Douglas-Rachford and Peaceman-Rachford methods hinges on iterating the so-called splitting operator associated with the individual operators. This splitting operator is a function of the composition of the reflected resolvents of the underlying operators. In this paper, we provide a comprehensive study of the class of uniformly monotone operators and their corresponding reflected resolvents. We show that the latter is closely related to the class of the strongly nonexpansive operators introduced by Bruck and Reich. Connections to duality via inverse operators are systematically studied. We provide applications to Douglas-Rachford and Peaceman-Rachford methods. Examples that illustrate and tighten our results are presented.

Open access
preprint2022arXiv

The range of the Douglas-Rachford operator in infinite-dimensional Hilbert spaces

The Douglas-Rachford algorithm is one of the most prominent splitting algorithms for solving convex optimization problems. Recently, the method has been successful in finding a generalized solution (provided that one exists) for optimization problems in the inconsistent case, i.e., when a solution does not exist. The convergence analysis of the inconsistent case hinges on the study of the range of the displacement operator associated with the Douglas-Rachford splitting operator and the corresponding minimal displacement vector. In this paper, we provide a formula for the range of the Douglas-Rachford splitting operator in (possibly) infinite-dimensional Hilbert space under mild assumptions on the underlying operators. Our new results complement known results in finite-dimensional Hilbert spaces. Several examples illustrate and tighten our conclusions.

Open access
preprint2020arXiv

Differentiating Through a Cone Program

We consider the problem of efficiently computing the derivative of the solution map of a convex cone program, when it exists. We do this by implicitly differentiating the residual map for its homogeneous self-dual embedding, and solving the linear systems of equations required using an iterative method. This allows us to efficiently compute the derivative operator, and its adjoint, evaluated at a vector. These correspond to computing an approximate new solution, given a perturbation to the cone program coefficients (i.e., perturbation analysis), and to computing the gradient of a function of the solution with respect to the coefficients. Our method scales to large problems, with numbers of coefficients in the millions. We present an open-source Python implementation of our method that solves a cone program and returns the derivative and its adjoint as abstract linear maps; our implementation can be easily integrated into software systems for automatic differentiation.

Open access
preprint2020arXiv

On the behaviour of the Douglas-Rachford algorithm for minimizing a convex function subject to a linear constraint

The Douglas-Rachford algorithm (DRA) is a powerful optimization method for minimizing the sum of two convex (not necessarily smooth) functions. The vast majority of previous research dealt with the case when the sum has at least one minimizer. In the absence of minimizers, it was recently shown that for the case of two indicator functions, the DRA converges to a best approximation solution. In this paper, we present a new convergence result on the the DRA applied to the problem of minimizing a convex function subject to a linear constraint. Indeed, a normal solution may be found even when the domain of the objective function and the linear subspace constraint have no point in common. As an important application, a new parallel splitting result is provided. We also illustrate our results through various examples.

Open access
preprint2019arXiv

On compositions of special cases of Lipschitz continuous operators

Many iterative optimization algorithms involve compositions of special cases of Lipschitz continuous operators, namely firmly nonexpansive, averaged and nonexpansive operators. The structure and properties of the compositions are of particular importance in the proofs of convergence of such algorithms. In this paper, we systematically study the compositions of further special cases of Lipschitz continuous operators. Applications of our results include compositions of scaled conically nonexpansive mappings, as well as the Douglas--Rachford and forward-backward operators, when applied to solve certain structured monotone inclusion and optimization problems. Several examples illustrate and tighten our conclusions.

Open access
preprint2016arXiv

Affine nonexpansive operators, Attouch-Théra duality and the Douglas-Rachford algorithm

The Douglas-Rachford splitting algorithm was originally proposed in 1956 to solve a system of linear equations arising from the discretization of a partial differential equation. In 1979, Lions and Mercier brought forward a very powerful extension of this method suitable to solve optimization problems. In this paper, we revisit the original affine setting. We provide a powerful convergence result for finding a zero of the sum of two maximally monotone affine relations. As a by product of our analysis, we obtain results concerning the convergence of iterates of affine nonexpansive mappings as well as Attouch-Théra duality. Numerous examples are presented.

Open access
preprint2016arXiv

On the Douglas-Rachford algorithm

The Douglas-Rachford algorithm is a very popular splitting technique for finding a zero of the sum of two maximally monotone operators. However, the behaviour of the algorithm remains mysterious in the general inconsistent case, i.e., when the sum problem has no zeros. More than a decade ago, however, it was shown that in the (possibly inconsistent) convex feasibility setting, the shadow sequence remains bounded and it is weak cluster points solve a best approximation problem. In this paper, we advance the understanding of the inconsistent case significantly by providing a complete proof of the full weak convergence in the convex feasibility setting. In fact, a more general sufficient condition for the weak convergence in the general case is presented. Several examples illustrate the results.

Open access
preprint2016arXiv

The forward-backward algorithm and the normal problem

The forward-backward splitting technique is a popular method for solving monotone inclusions that has applications in optimization. In this paper we explore the behaviour of the algorithm when the inclusion problem has no solution. We present a new formula to define the normal solutions using the forward-backward operator. We also provide a formula for the range of the displacement map of the forward-backward operator. Several examples illustrate our theory.

Open access
preprint2015arXiv

On the order of the operators in the Douglas-Rachford algorithm

The Douglas-Rachford algorithm is a popular method for finding zeros of sums of monotone operators. By its definition, the Douglas-Rachford operator is not symmetric with respect to the order of the two operators. In this paper we provide a systematic study of the two possible Douglas-Rachford operators. We show that the reflectors of the underlying operators act as bijections between the fixed points sets of the two Douglas-Rachford operators. Some elegant formulae arise under additional assumptions. Various examples illustrate our results.

Open access
preprint2015arXiv

The Douglas-Rachford algorithm for two (not necessarily intersecting) affine subspaces

The Douglas--Rachford algorithm is a classical and very successful splitting method for finding the zeros of the sums of monotone operators. When the underlying operators are normal cone operators, the algorithm solves a convex feasibility problem. In this paper, we provide a detailed study of the Douglas--Rachford iterates and the corresponding {shadow sequence} when the sets are affine subspaces that do not necessarily intersect. We prove strong convergence of the shadows to the nearest generalized solution. Our results extend recent work from the consistent to the inconsistent case. Various examples are provided to illustrates the results.

Open access
preprint2014arXiv

On the range of the Douglas-Rachford operator

The problem of finding a minimizer of the sum of two convex functions - or, more generally, that of finding a zero of the sum of two maximally monotone operators - is of central importance in variational analysis. Perhaps the most popular method of solving this problem is the Douglas-Rachford splitting method. Surprisingly, little is known about the range of the Douglas-Rachford operator. In this paper, we set out to study this range systematically. We prove that for 3* monotone operators a very pleasing formula can be found that reveals the range to be nearly equal to a simple set involving the domains and ranges of the underlying operators. A similar formula holds for the range of the corresponding displacement mapping. We discuss applications to subdifferential operators, to the infimal displacement vector, and to firmly nonexpansive mappings. Various examples and counter-examples are presented, including some concerning the celebrated Brezis-Haraux theorem.

Open access
preprint2013arXiv

Generalized solutions for the sum of two maximally monotone operators

A common theme in mathematics is to define generalized solutions to deal with problems that potentially do not have solutions. A classical example is the introduction of least squares solutions via the normal equations associated with a possibly infeasible system of linear equations. In this paper, we introduce a "normal problem" associated with finding a zero of the sum of two maximally monotone operators. If the original problem admits solutions, then the normal problem returns this same set of solutions. The normal problem may yield solutions when the original problem does not admit any; furthermore, it has attractive variational and duality properties. Several examples illustrate our theory.

Open access
preprint2012arXiv

A Derivative-Free CoMirror Algorithm

We consider min⁡{f(x):g(x)≤0, x∈X},\min\{f(x):g(x) \le 0, ~x\in X\}, where XX is a compact convex subset of $\RR^m$, and ff and gg are continuous convex functions defined on an open neighbourhood of XX. We work in the setting of derivative-free optimization, assuming that ff and gg are available through a black-box that provides only function values for a lower-C2\mathcal{C}^2 representation of the functions. We present a derivative-free optimization variant of the $\eps$-comirror algorithm \cite{BBTGBT2010}. Algorithmic convergence hinges on the ability to accurately approximate subgradients of lower-C2\mathcal{C}^2 functions, which we prove is possible through linear interpolation. We provide convergence analysis that quantifies the difference between the function values of the iterates and the optimal function value. We find that the DFO algorithm we develop has the same convergence result as the original gradient-based algorithm. We present some numerical testing that demonstrate the practical feasibility of the algorithm, and conclude with some directions for further research.

Open access
preprint2011arXiv

Attouch-Théra duality revisited: paramonotonicity and operator splitting

The problem of finding the zeros of the sum of two maximally monotone operators is of fundamental importance in optimization and variational analysis. In this paper, we systematically study Attouch-Théra duality for this problem. We provide new results related to Passty's parallel sum, to Eckstein and Svaiter's extended solution set, and to Combettes' fixed point description of the set of primal solutions. Furthermore, paramonotonicity is revealed to be a key property because it allows for the recovery of all primal solutions given just one arbitrary dual solution. As an application, we generalize the best approximation results by Bauschke, Combettes and Luke [J. Approx. Theory 141 (2006), 63-69] from normal cone operators to paramonotone operators. Our results are illustrated through numerous examples.

Open access

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.