Source author record

Xianfu Wang

Xianfu Wang appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

41works
6topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

41 published item(s)

preprint2022arXiv

A Bregman inertial forward-reflected-backward method for nonconvex minimization

We propose a Bregman inertial forward-reflected-backward (BiFRB) method for nonconvex composite problems. Our analysis relies on a novel approach that imposes general conditions on implicit merit function parameters, which yields a stepsize condition that is independent of inertial parameters. In turn, a question of Malitsky and Tam regarding whether FRB can be equipped with a Nesterov-type acceleration is resolved. Assuming the generalized concave Kurdyka-Łojasiewicz property of a quadratic regularization of the objective, we obtain sequential convergence of BiFRB, as well as convergence rates on both the function value and actual sequence. We also present formulae for the Bregman subproblem, supplementing not only BiFRB but also the work of Boţ-Csetnek-László and Boţ-Csetnek. Numerical simulations are conducted to evaluate the performance of our proposed algorithm.

preprint2022arXiv

Roots of the identity operator and proximal mappings: (classical and phantom) cycles and gap vectors

Recently, Simons provided a lemma for a support function of a closed convex set in a general Hilbert space and used it to prove the geometry conjecture on cycles of projections. In this paper, we extend Simons's lemma to closed convex functions, show its connections to Attouch-Thera duality, and use it to characterize (classical and phantom) cycles and gap vectors of proximal mappings.

preprint2022arXiv

The Bregman proximal average

We provide a proximal average with repect to a $1$-coercive Legendre function. In the sense of Bregman distance, the Bregman envelope of the proximal average is a convex combination of Bregman envelopes of individual functions. The Bregman proximal mapping of the average is a convex combination of convexified proximal mappings of individual functions. Techniques from variational analysis provide the keys for the Bregman proximal average.

preprint2022arXiv

The projection onto the cross

We consider the set of pairs of orthogonal vectors in Hilbert space, which is also called the cross because it is the union of the horizontal and vertical axes in the Euclidean plane when the underlying space is the real line. Crosses, which are nonconvex sets, play a significant role in various branches of nonsmooth analysis such as feasibility problems and optimization problems. In this work, we study crosses and show that in infinite-dimensional settings, they are never weakly (sequentially) closed. Nonetheless, crosses do turn out to be proximinal (i.e., they always admit projections) and we provide explicit formulas for the projection onto the cross in all cases.

preprint2020arXiv

Best approximation mappings in Hilbert spaces

The notion of best approximation mapping (BAM) with respect to a closed affine subspace in finite-dimensional space was introduced by Behling, Bello Cruz and Santos to show the linear convergence of the block-wise circumcentered-reflection method. The best approximation mapping possesses two critical properties of the circumcenter mapping for linear convergence. Because the iteration sequence of BAM linearly converges, the BAM is interesting in its own right. In this paper, we naturally extend the definition of BAM from closed affine subspace to nonempty closed convex set and from $\mathbb{R}^{n}$ to general Hilbert space. We discover that the convex set associated with the BAM must be the fixed point set of the BAM. Hence, the iteration sequence generated by a BAM linearly converges to the nearest fixed point of the BAM. Connections between BAMs and other mappings generating convergent iteration sequences are considered. Behling et al.\ proved that the finite composition of BAMs associated with closed affine subspaces is still a BAM in $\mathbb{R}^{n}$. We generalize their result from $\mathbb{R}^{n}$ to general Hilbert space and also construct a new constant associated with the composition of BAMs. This provides a new proof of the linear convergence of the method of alternating projections. Moreover, compositions of BAMs associated with general convex sets are investigated. In addition, we show that convex combinations of BAMs associated with affine subspaces are BAMs. Last but not least, we connect BAM with circumcenter mapping in Hilbert spaces.

preprint2020arXiv

Circumcentered methods induced by isometries

Motivated by the circumcentered Douglas--Rachford method recently introduced by Behling, Bello Cruz and Santos to accelerate the Douglas--Rachford method, we study the properness of the circumcenter mapping and the circumcenter method induced by isometries. Applying the demiclosedness principle for circumcenter mappings, we present weak convergence results for circumcentered isometry methods, which include the Douglas--Rachford method (DRM) and circumcentered reflection methods as special instances. We provide sufficient conditions for the linear convergence of circumcentered isometry/reflection methods. We explore the convergence rate of circumcentered reflection methods by considering the required number of iterations and as well as run time as our performance measures. Performance profiles on circumcentered reflection methods, DRM and method of alternating projections for finding the best approximation to the intersection of linear subspaces are presented.

preprint2020arXiv

Fixed points of compositions of nonexpansive mappings: finitely many linear reflectors

Nonexpansive mappings play a central role in modern optimization and monotone operator theory because their fixed points can describe solutions to optimization or critical point problems. It is known that when the mappings are sufficiently "nice", then the fixed point set of the composition coincides with the intersection of the individual fixed point sets. In this paper, we explore the situation for compositions of linear reflectors. We provide positive results, upper bounds, and limiting examples. We also discuss classical reflectors in the Euclidean plane.

preprint2020arXiv

On the linear convergence of circumcentered isometry methods

The circumcentered Douglas--Rachford method (C--DRM), introduced by Behling, Bello Cruz and Santos, is an acceleration of the well-known Douglas-Rachford method (DRM) for finding the best approximation onto the intersection of finitely many affine subspaces. Inspired by the C--DRM, we introduced the more flexible circumcentered reflection method (CRM) and circumcentered isometry method (CIM). The CIM essentially chooses the closest point to the solution among all of the points in an associated affine hull as its iterate and is a generalization of the CRM. The circumcentered--reflection method introduced by Behling et al. to generalize the C--DRM is a special class of our CRM. We consider the CIM induced by a set of finitely many isometries for finding the best approximation onto the intersection of fixed point sets of the isometries which turns out to be an intersection of finitely many affine subspaces. We extend our previous linear convergence results on CRMs in finite-dimensional spaces from reflections to isometries. In order to better accelerate the symmetric method of alternating projections (MAP), the accelerated symmetric MAP first applies another operator to the initial point. (Similarly, to accelerate the DRM, the C--DRM first applies another operator to the initial point as well.) Motivated by these facts, we show results on the linear convergence of CIMs in Hilbert spaces with first applying another operator to the initial point. In particular, under some restrictions, our results imply that some CRMs attain the known linear convergence rate of the accelerated symmetric MAP in Hilbert spaces. We also exhibit a class of CRMs converging to the best approximation in Hilbert spaces with a convergence rate no worse than the sharp convergence rate of MAP. The fact that some CRMs attain the linear convergence rate of MAP or accelerated symmetric MAP is entirely new.

preprint2016arXiv

On Douglas-Rachford operators that fail to be proximal mappings

The problem of finding a zero of the sum of two maximally monotone operators is of central importance in optimization. One successful method to find such a zero is the Douglas-Rachford algorithm which iterates a firmly nonexpansive operator constructed from the resolvents of the given monotone operators. In the context of finding minimizers of convex functions, the resolvents are actually proximal mappings. Interestingly, as pointed out by Eckstein in 1989, the Douglas-Rachford operator itself may fail to be a proximal mapping. We consider the class of symmetric linear relations that are maximally monotone and prove the striking result that the Douglas-Rachford operator is generically not a proximal mapping.

preprint2016arXiv

The resolvent order: a unification of the orders by Zarantonello, by Loewner, and by Moreau

We introduce and investigate the resolvent order, which is a binary relation on the set of firmly nonexpansive mappings. It unifies well-known orders introduced by Loewner (for positive semidefinite matrices) and by Zarantonello (for projectors onto convex cones). A connection with Moreau's order of convex functions is also presented. We also construct partial orders on (quotient sets of) proximal mappings and convex functions. Various examples illustrate our results.

preprint2015arXiv

Strongly convex functions, Moreau envelopes and the generic nature of convex functions with strong minimizers

In this work, using Moreau envelopes, we define a complete metric for the set of proper lower semicontinuous convex functions. Under this metric, the convergence of each sequence of convex functions is epi-convergence. We show that the set of strongly convex functions is dense but it is only of the first category. On the other hand, it is shown that the set of convex functions with strong minima is of the second category.

preprint2015arXiv

The resolvent average of monotone operators: dominant and recessive properties

Within convex analysis, a rich theory with various applications has been evolving since the proximal average of convex functions was first introduced over a decade ago. When one considers the subdifferential of the proximal average, a natural averaging operation of the subdifferentials of the averaged functions emerges. In the present paper we extend the reach of this averaging operation to the framework of monotone operator theory in Hilbert spaces, transforming it into the resolvent average. The theory of resolvent averages contains many desirable properties. In particular, we study a detailed list of properties of monotone operators and classify them as dominant or recessive with respect to the resolvent average. As a consequence, we recover a significant part of the theory of proximal averages. Furthermore, we shed new light on the proximal average and present novel results and desirable properties the proximal average possesses which have not been previously available.

preprint2015arXiv

Weak subdifferentials, $r_L$-density and maximal monotonicity

In this paper, we first investigate an abstract subdifferential for which (using Ekeland's variational principle) we can prove an analog of the Brøndsted-Rockafellar property. We introduce the "$r_L$-density" of a subset of the product of a Banach space with its dual. A closed $r_L$-dense monotone set is maximally monotone, but we will also consider the case of nonmonotone closed $r_L$-dense sets. As a special case of our results, we can prove Rockafellar's result that the subdifferential of a proper convex lower semicontinuous function is maximally monotone.

preprint2014arXiv

On subgradient projectors

The subgradient projector is of considerable importance in convex optimization because it plays the key role in Polyak's seminal work - and the many papers it spawned - on subgradient projection algorithms for solving convex feasibility problems. In this paper, we offer a systematic study of the subgradient projector. Fundamental properties such as continuity, nonexpansiveness, and monotonicity are investigated. We also discuss the Yamagishi-Yamada operator. Numerous examples illustrate our results.

preprint2014arXiv

On the finite convergence of a projected cutter method

The subgradient projection iteration is a classical method for solving a convex inequality. Motivated by works of Polyak and of Crombez, we present and analyze a more general method for finding a fixed point of a cutter, provided that the fixed point set has nonempty interior. Our assumptions on the parameters are more general than existing ones. Various limiting examples and comparisons are provided.

preprint2014arXiv

Optimal rates of convergence of matrices with applications

We present a systematic study on the linear convergence rates of the powers of (real or complex) matrices. We derive a characterization when the optimal convergence rate is attained. This characterization is given in terms of semi-simpleness of all eigenvalues having the second-largest modulus after 1. We also provide applications of our general results to analyze the optimal convergence rates for several relaxed alternating projection methods and the generalized Douglas-Rachford splitting methods for finding the projection on the intersection of two subspaces. Numerical experiments confirm our convergence analysis.

preprint2013arXiv

A Bregman projection method for approximating fixed points of quasi-Bregman nonexpansive mappings

We introduce an abstract algorithm that aims to find the Bregman projection onto a closed convex set. As an application, the asymptotic behaviour of an iterative method for finding a fixed point of a quasi Bregman nonexpansive mapping with the fixed-point closedness property is analyzed. We also show that our result is applicable to Bregman subgradient projectors.

preprint2013arXiv

Most Maximally Monotone Operators Have a Unique Zero and a Super-regular Resolvent

Maximally monotone operators play important roles in optimization, variational analysis and differential equations. Finding zeros of maximally monotone operators has been a central topic. In a Hilbert space, we show that most resolvents are super-regular, that most maximally monotone operators have a unique zero and that the set of strongly monotone mapping is of first category although each strongly monotone operator has a unique zero. The results are established by applying the Baire Category Theorem to the space of nonexpansive mappings.

preprint2013arXiv

The Method of Alternating Relaxed Projections for two nonconvex sets

The Method of Alternating Projections (MAP), a classical algorithm for solving feasibility prob- lems, has recently been intensely studied for nonconvex sets. However, intrinsically available are only local convergence results: convergence occurs if the starting point is not too far away from solutions to avoid getting trapped in certain regions. Instead of taking full projection steps, it can be advantageous to underrelax, i.e., to move only part way towards the constraint set, in order to enlarge the regions of convergence. In this paper, we thus systematically study the Method of Alternating Relaxed Projections (MARP) for two (possibly nonconvex) sets. Complementing our recent work on MAP, we es- tablish local linear convergence results for the MARP. Several examples illustrate our analysis.

preprint2013arXiv

The rate of linear convergence of the Douglas-Rachford algorithm for subspaces is the cosine of the Friedrichs angle

The Douglas-Rachford splitting algorithm is a classical optimization method that has found many applications. When specialized to two normal cone operators, it yields an algorithm for finding a point in the intersection of two convex sets. This method for solving feasibility problems has attracted a lot of attention due to its good performance even in nonconvex settings. In this paper, we consider the Douglas-Rachford algorithm for finding a point in the intersection of two subspaces. We prove that the method converges strongly to the projection of the starting point onto the intersection. Moreover, if the sum of the two subspaces is closed, then the convergence is linear with the rate being the cosine of the Friedrichs angle between the subspaces. Our results improve upon existing results in three ways: First, we identify the location of the limit and thus reveal the method as a best approximation algorithm; second, we quantify the rate of convergence, and third, we carry out our analysis in general (possibly infinite-dimensional) Hilbert space. We also provide various examples as well as a comparison with the classical method of alternating projections.

preprint2012arXiv

A projection method for approximating fixed points of quasi nonexpansive mappings without the usual demiclosedness condition

We introduce and analyze an abstract algorithm that aims to find the projection onto a closed convex subset of a Hilbert space. When specialized to the fixed point set of a quasi nonexpansive mapping, the required sufficient condition (termed "fixed-point closed") is less restrictive than the usual conditions based on the demiclosedness principle. A concrete example of a subgradient projector is presented which illustrates the applicability of this generalization.

preprint2012arXiv

On moving averages

We show that the moving arithmetic average is closely connected to a Gauss-Seidel type fixed point method studied by Bauschke, Wang and Wylie, and which was observed to converge only numerically. Our analysis establishes a rigorous proof of convergence of their algorithm in a special case; moreover, limit is explicitly identified. Moving averages in Banach spaces and Kolmogorov means are also studied. Furthermore, we consider moving proximal averages and epi-averages of convex functions.

preprint2012arXiv

Rectangularity and paramonotonicity of maximally monotone operators

Maximally monotone operators play a key role in modern optimization and variational analysis. Two useful subclasses are rectangular (also known as star monotone) and paramonotone operators, which were introduced by Brezis and Haraux, and by Censor, Iusem and Zenios, respectively. The former class has useful range properties while the latter class is of importance for interior point methods and duality theory. Both notions are automatic for subdifferential operators and known to coincide for certain matrices; however, more precise relationships between rectangularity and paramonotonicity were not known. Our aim is to provide new results and examples concerning these notions. It is shown that rectangularity and paramonotonicity are actually independent. Moreover, for linear relations, rectangularity implies paramonotonicity but the converse implication requires additional assumptions. We also consider continuous linear monotone operators, and we point out that in Hilbert space both notions are automatic for certain displacement mappings.

preprint2012arXiv

Restricted normal cones and sparsity optimization with affine constraints

The problem of finding a vector with the fewest nonzero elements that satisfies an underdetermined system of linear equations is an NP-complete problem that is typically solved numerically via convex heuristics or nicely-behaved non convex relaxations. In this paper we consider the elementary method of alternating projections (MAP) for solving the sparsity optimization problem without employing convex heuristics. In a parallel paper we recently introduced the restricted normal cone which generalizes the classical Mordukhovich normal cone and reconciles some fundamental gaps in the theory of sufficient conditions for local linear convergence of the MAP algorithm. We use the restricted normal cone together with the notion of superregularity, which is naturally satisfied for the affine sparse optimization problem, to obtain local linear convergence results with estimates for the radius of convergence of the MAP algorithm applied to sparsity optimization with an affine constraint.

preprint2012arXiv

Restricted normal cones and the method of alternating projections

The method of alternating projections (MAP) is a common method for solving feasibility problems. While employed traditionally to subspaces or to convex sets, little was known about the behavior of the MAP in the nonconvex case until 2009, when Lewis, Luke, and Malick derived local linear convergence results provided that a condition involving normal cones holds and at least one of the sets is superregular (a property less restrictive than convexity). However, their results failed to capture very simple classical convex instances such as two lines in three-dimensional space. In this paper, we extend and develop the Lewis-Luke-Malick framework so that not only any two linear subspaces but also any two closed convex sets whose relative interiors meet are covered. We also allow for sets that are more structured such as unions of convex sets. The key tool required is the restricted normal cone, which is a generalization of the classical Mordukhovich normal cone. We thoroughly study restricted normal cones from the viewpoint of constraint qualifications and regularity. Numerous examples are provided to illustrate the theory.

preprint2011arXiv

Compositions and convex combinations of asymptotically regular firmly nonexpansive mappings are also asymptotically regular

Because of Minty's classical correspondence between firmly nonexpansive mappings and maximally monotone operators, the notion of a firmly nonexpansive mapping has proven to be of basic importance in fixed point theory, monotone operator theory, and convex optimization. In this note, we show that if finitely many firmly nonexpansive mappings defined on a real Hilbert space are given and each of these mappings is asymptotically regular, which is equivalent to saying that they have or "almost have" fixed points, then the same is true for their composition. This significantly generalizes the result by Bauschke from 2003 for the case of projectors (nearest point mappings). The proof resides in a Hilbert product space and it relies upon the Brezis-Haraux range approximation result. By working in a suitably scaled Hilbert product space, we also establish the asymptotic regularity of convex combinations.

preprint2011arXiv

Construction of pathological maximally monotone operators on non-reflexive Banach spaces

In this paper, we construct maximally monotone operators that are not of Gossez's dense-type (D) in many nonreflexive spaces. Many of these operators also fail to possess the Brønsted-Rockafellar (BR) property. Using these operators, we show that the partial inf-convolution of two BC--functions will not always be a BC--function. This provides a negative answer to a challenging question posed by Stephen Simons. Among other consequences, we deduce that every Banach space which contains an isomorphic copy of the James space $\mathbf{J}$ or its dual $\mathbf{J}^*$, or $c_0$ or its dual $\ell^1$, admits a non type (D) operator.

preprint2011arXiv

Firmly nonexpansive mappings and maximally monotone operators: correspondence and duality

The notion of a firmly nonexpansive mapping is central in fixed point theory because of attractive convergence properties for iterates and the correspondence with maximal monotone operators due to Minty. In this paper, we systematically analyze the relationship between properties of firmly nonexpansive mappings and associated maximal monotone operators. Dual and self-dual properties are also identified. The results are illustrated through several examples.

preprint2011arXiv

Fixed Points of Averages of Resolvents: Geometry and Algorithms

To provide generalized solutions if a given problem admits no actual solution is an important task in mathematics and the natural sciences. It has a rich history dating back to the early 19th century when Carl Friedrich Gauss developed the method of least squares of a system of linear equations - its solutions can be viewed as fixed points of averaged projections onto hyperplanes. A powerful generalization of this problem is to find fixed points of averaged resolvents (i.e., firmly nonexpansive mappings). This paper concerns the relationship between the set of fixed points of averaged resolvents and certain fixed point sets of compositions of resolvents. It partially extends recent work for two mappings on a question of C. Byrne. The analysis suggests a reformulation in a product space. Furthermore, two new algorithms are presented. A complete convergence proof that is based on averaged mappings is provided for the first algorithm. The second algorithm, which currently has no convergence proof, iterates a mapping that is not even nonexpansive. Numerical experiments indicate the potential of these algorithms when compared to iterating the average of the resolvents.

preprint2011arXiv

For maximally monotone linear relations, dense type, negative-infimum type, and Fitzpatrick-Phelps type all coincide with monotonicity of the adjoint

It is shown that, for maximally monotone linear relations defined on a general Banach space, the monotonicities of dense type, of negative-infimum type, and of Fitzpatrick-Phelps type are the same and equivalent to monotonicity of the adjoint. This result also provides affirmative answers to two problems: one posed by Phelps and Simons, and the other by Simons.

preprint2011arXiv

Maximally Monotone Linear Subspace Extensions of Monotone Subspaces: Explicit Constructions and Characterizations

Monotone linear relations play important roles in variational inequality problems and quadratic optimizations. In this paper, we give explicit maximally monotone linear subspace extensions of a monotone linear relation in finite dimensional spaces. Examples are provided to illustrate our extensions. Our results generalize a recent result by Crouzeix and Anaya.

preprint2011arXiv

Monotone operators and "bigger conjugate" functions

We study a question posed by Stephen Simons in his 2008 monograph involving "bigger conjugate" (BC) functions and the partial infimal convolution. As Simons demonstrated in his monograph, these function have been crucial to the understanding and advancement of the state-of-the-art of harder problems in monotone operator theory, especially the sum problem. In this paper, we provide some tools for further analysis of BC--functions which allow us to answer Simons' problem in the negative. We are also able to refute a similar but much harder conjecture which would have generalized a classical result of Brézis, Crandall and Pazy. Our work also reinforces the importance of understanding unbounded skew linear relations to construct monotone operators with unexpected properties.

preprint2011arXiv

Near equality, near convexity, sums of maximally monotone operators, and averages of firmly nonexpansive mappings

We study nearly equal and nearly convex sets, ranges of maximally monotone operators, and ranges and fixed points of convex combinations of firmly nonexpansive mappings. The main result states that the range of an average of firmly nonexpansive mappings is nearly equal to the average of the ranges of the mappings. A striking application of this result yields that the average of asymptotically regular firmly nonexpansive mappings is also asymptotically regular. Throughout, examples are provided to illustrate the theory. We also obtain detailed information on the domain and range of the resolvent average.

preprint2010arXiv

Chebyshev Sets, Klee Sets, and Chebyshev Centers with respect to Bregman Distances: Recent Results and Open Problems

In Euclidean spaces, the geometric notions of nearest-points map, farthest-points map, Chebyshev set, Klee set, and Chebyshev center are well known and well understood. Since early works going back to the 1930s, tremendous theoretical progress has been made, mostly by extending classical results from Euclidean space to Banach space settings. In all these results, the distance between points is induced by some underlying norm. Recently, these notions have been revisited from a different viewpoint in which the discrepancy between points is measured by Bregman distances induced by Legendre functions. The associated framework covers the well known Kullback-Leibler divergence and the Itakura-Saito distance. In this survey, we review known results and we present new results on Klee sets and Chebyshev centers with respect to Bregman distances. Examples are provided and connections to recent work on Chebyshev functions are made. We also identify several intriguing open problems.

preprint2010arXiv

Compositions and Averages of Two Resolvents: Relative Geometry of Fixed Points Sets and a Partial Answer to a Question by C. Byrne

We show that the set of fixed points of the average of two resolvents can be found from the set of fixed points for compositions of two resolvents associated with scaled monotone operators. Recently, the proximal average has attracted considerable attention in convex analysis. Our results imply that the minimizers of proximal-average functions can be found from the set of fixed points for compositions of two proximal mappings associated with scaled convex functions. When both convex functions in the proximal average are indicator functions of convex sets, least squares solutions can be completely recovered from the limiting cycles given by compositions of two projection mappings. This provides a partial answer to a question posed by C. Byrne. A novelty of our approach is to use the notion of resolvent average and proximal average.

preprint2010arXiv

On the maximal monotonicity of the sum of a maximal monotone linear relation and the subdifferential operator of a sublinear function

The most important open problem in Monotone Operator Theory concerns the maximal monotonicity of the sum of two maximal monotone operators provided that Rockafellar's constraint qualification holds. In this note, we provide a new maximal monotonicity result for the sum of a maximal monotone relation and the subdifferential operator of a proper, lower semicontinuous, sublinear function. The proof relies on Rockafellar's formula for the Fenchel conjugate of the sum as well as some results on the Fitzpatrick function.

preprint2009arXiv

Complex Acquisition of the Fourier Transform Imaging of an Arbitrary Object

A scheme to a complex-valued acquisition of the Fourier transform imaging was proposed. The main idea is to project the real and the imaginary parts of a diffraction field to intensity distributions respectively. The whole procedure was algorithm independent and needs no a priori knowledge of an arbitrary objet. An example was demonstrated with a numerical modeling and its results.