BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

François-Xavier Vialard

François-Xavier Vialard appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.OCMachine Learningmath.APmath.DGmath.NAmath.PRmath.FAmath.STNumerical AnalysisQuantitative MethodsStatistics Theory

Catalog footprint

What is connected

15works
11topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

15 published item(s)

preprint2023arXiv

Sinkhorn Divergences for Unbalanced Optimal Transport

Optimal transport induces the Earth Mover's (Wasserstein) distance between probability distributions, a geometric divergence that is relevant to a wide range of problems. Over the last decade, two relaxations of optimal transport have been studied in depth: unbalanced transport, which is robust to the presence of outliers and can be used when distributions don't have the same total mass; entropy-regularized transport, which is robust to sampling noise and lends itself to fast computations using the Sinkhorn algorithm. This paper combines both lines of work to put robust optimal transport on solid ground. Our main contribution is a generalization of the Sinkhorn algorithm to unbalanced transport: our method alternates between the standard Sinkhorn updates and the pointwise application of a contractive function. This implies that entropic transport solvers on grid images, point clouds and sampled distributions can all be modified easily to support unbalanced transport, with a proof of linear convergence that holds in all settings. We then show how to use this method to define pseudo-distances on the full space of positive measures that satisfy key geometric axioms: (unbalanced) Sinkhorn divergences are differentiable, positive, definite, convex, statistically robust and avoid any "entropic bias" towards a shrinkage of the measures' supports.

0 citations0 reviewsNo code linkedOpen access
preprint2023arXiv

The Unbalanced Gromov Wasserstein Distance: Conic Formulation and Relaxation

Comparing metric measure spaces (i.e. a metric space endowed with aprobability distribution) is at the heart of many machine learning problems. The most popular distance between such metric measure spaces is theGromov-Wasserstein (GW) distance, which is the solution of a quadratic assignment problem. The GW distance is however limited to the comparison of metric measure spaces endowed with a probability distribution. To alleviate this issue, we introduce two Unbalanced Gromov-Wasserstein formulations: a distance and a more tractable upper-bounding relaxation.They both allow the comparison of metric spaces equipped with arbitrary positive measures up to isometries. The first formulation is a positive and definite divergence based on a relaxation of the mass conservation constraint using a novel type of quadratically-homogeneous divergence. This divergence works hand in hand with the entropic regularization approach which is popular to solve large scale optimal transport problems. We show that the underlying non-convex optimization problem can be efficiently tackled using a highly parallelizable and GPU-friendly iterative scheme. The second formulation is a distance between mm-spaces up to isometries based on a conic lifting. Lastly, we provide numerical experiments onsynthetic examples and domain adaptation data with a Positive-Unlabeled learning task to highlight the salient features of the unbalanced divergence and its potential applications in ML.

0 citations0 reviewsNo code linkedOpen access
preprint2023arXiv

Unbalanced Optimal Transport, from Theory to Numerics

Optimal Transport (OT) has recently emerged as a central tool in data sciences to compare in a geometrically faithful way point clouds and more generally probability distributions. The wide adoption of OT into existing data analysis and machine learning pipelines is however plagued by several shortcomings. This includes its lack of robustness to outliers, its high computational costs, the need for a large number of samples in high dimension and the difficulty to handle data in distinct spaces. In this review, we detail several recently proposed approaches to mitigate these issues. We insist in particular on unbalanced OT, which compares arbitrary positive measures, not restricted to probability distributions (i.e. their total mass can vary). This generalization of OT makes it robust to outliers and missing data. The second workhorse of modern computational OT is entropic regularization, which leads to scalable algorithms while lowering the sample complexity in high dimension. The last point presented in this review is the Gromov-Wasserstein (GW) distance, which extends OT to cope with distributions belonging to different metric spaces. The main motivation for this review is to explain how unbalanced OT, entropic regularization and GW can work hand-in-hand to turn OT into efficient geometric loss functions for data sciences.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Faster Unbalanced Optimal Transport: Translation invariant Sinkhorn and 1-D Frank-Wolfe

Unbalanced optimal transport (UOT) extends optimal transport (OT) to take into account mass variations to compare distributions. This is crucial to make OT successful in ML applications, making it robust to data normalization and outliers. The baseline algorithm is Sinkhorn, but its convergence speed might be significantly slower for UOT than for OT. In this work, we identify the cause for this deficiency, namely the lack of a global normalization of the iterates, which equivalently corresponds to a translation of the dual OT potentials. Our first contribution leverages this idea to develop a provably accelerated Sinkhorn algorithm (coined 'translation invariant Sinkhorn') for UOT, bridging the computational gap with OT. Our second contribution focusses on 1-D UOT and proposes a Frank-Wolfe solver applied to this translation invariant formulation. The linear oracle of each steps amounts to solving a 1-D OT problems, resulting in a linear time complexity per iteration. Our last contribution extends this method to the computation of UOT barycenter of 1-D measures. Numerical simulations showcase the convergence speed improvement brought by these three approaches.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Stability and upper bounds for statistical estimation of unbalanced transport potentials

In this note, we derive upper-bounds on the statistical estimation rates of unbalanced optimal transport (UOT) maps for the quadratic cost. Our work relies on the stability of the semi-dual formulation of optimal transport (OT) extended to the unbalanced case. Depending on the considered variant of UOT, our stability result interpolates between the OT (balanced) case where the semi-dual is only locally strongly convex with respect the Sobolev semi-norm H1 dot and the case where it is locally strongly convex with respect to the H 1 norm. When the optimal potential belongs to a certain class C with sufficiently low metric-entropy, local strong convexity enables us to recover super-parametric rates, faster than 1 / root n.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Generalized compressible flows and solutions of the H(div) geodesic problem

We study the geodesic problem on the group of diffeomorphism of a domain M$\subset$Rd, equipped with the H(div) metric. The geodesic equations coincide with the Camassa-Holm equation when d=1, and represent one of its possible multi-dimensional generalizations when d>1. We propose a relaxation {à} la Brenier of this problem, in which solutions are represented as probability measures on the space of continuous paths on the cone over M. We use this relaxation to prove that smooth H(div) geodesics are globally length minimizing for short times. We also prove that there exists a unique pressure field associated to solutions of our relaxation. Finally, we propose a numerical scheme to construct generalized solutions on the cone and present some numerical results illustrating the relation between the generalized Camassa-Holm and incompressible Euler solutions.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

On Completeness of Groups of Diffeomorphisms

We study completeness properties of the Sobolev diffeomorphism groups $\mathcal D^s(M)$ endowed with strong right-invariant Riemannian metrics when the underlying manifold $M$ is $\mathbb R^d$ or compact without boundary. The main result is that for $s > \dim M/2 + 1$, the group $\mathcal D^s(M)$ is geodesically and metrically complete with a surjective exponential map. We then present the connection between the Sobolev diffeomorphism group and the large deformation matching framework in order to apply our results to diffeomorphic image matching.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Riemannian cubics on the group of diffeomorphisms and the Fisher-Rao metric

We study a second-order variational problem on the group of diffeomorphisms of the interval [0, 1] endowed with a right-invariant Sobolev metric of order 2, which consists in the minimization of the acceleration. We compute the relaxation of the problem which involves the so-called Fisher-Rao functional a convex functional on the space of measures. This relaxation enables the derivation of several optimality conditions and, in particular, a sufficient condition which guarantees that a given path of the initial problem is also a minimizer of the relaxed one. This sufficient condition is related to the existence of a solution to a Riccati equation involving the path acceleration.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

An Interpolating Distance between Optimal Transport and Fisher-Rao

This paper defines a new transport metric over the space of non-negative measures. This metric interpolates between the quadratic Wasserstein and the Fisher-Rao metrics and generalizes optimal transport to measures with different masses. It is defined as a generalization of the dynamical formulation of optimal transport of Benamou and Brenier, by introducing a source term in the continuity equation. The influence of this source term is measured using the Fisher-Rao metric, and is averaged with the transportation term. This gives rise to a convex variational problem defining our metric. Our first contribution is a proof of the existence of geodesics (i.e. solutions to this variational problem). We then show that (generalized) optimal transport and Fisher-Rao metrics are obtained as limiting cases of our metric. Our last theoretical contribution is a proof that geodesics between mixtures of sufficiently close Diracs are made of translating mixtures of Diracs. Lastly, we propose a numerical scheme making use of first order proximal splitting methods and we show an application of this new distance to image interpolation.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Mixture of Kernels and Iterated Semidirect Product of Diffeomorphisms Groups

In the framework of large deformation diffeomorphic metric mapping (LDDMM), we develop a multi-scale theory for the diffeomorphism group based on previous works. The purpose of the paper is (1) to develop in details a variational approach for multi-scale analysis of diffeomorphisms, (2) to generalise to several scales the semidirect product representation and (3) to illustrate the resulting diffeomorphic decomposition on synthetic and real images. We also show that the approaches presented in other papers and the mixture of kernels are equivalent.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Piecewise rigid curve deformation via a Finsler steepest descent

This paper introduces a novel steepest descent flow in Banach spaces. This extends previous works on generalized gradient descent, notably the work of Charpiat et al., to the setting of Finsler metrics. Such a generalized gradient allows one to take into account a prior on deformations (e.g., piecewise rigid) in order to favor some specific evolutions. We define a Finsler gradient descent method to minimize a functional defined on a Banach space and we prove a convergence theorem for such a method. In particular, we show that the use of non-Hilbertian norms on Banach spaces is useful to study non-convex optimization problems where the geometry of the space might play a crucial role to avoid poor local minima. We show some applications to the curve matching problem. In particular, we characterize piecewise rigid deformations on the space of curves and we study several models to perform piecewise rigid evolution of curves.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Diffeomorphic image matching with left-invariant metrics

The geometric approach to diffeomorphic image registration known as "large deformation by diffeomorphic metric mapping" (LDDMM) is based on a left action of diffeomorphisms on images, and a right-invariant metric on a diffeomorphism group, usually defined using a reproducing kernel. We explore the use of left-invariant metrics on diffeomorphism groups, based on reproducing kernels defined in the body coordinates of a source image. This perspective, which we call Left-LDM, allows us to consider non-isotropic spatially-varying kernels, which can be interpreted as describing variable deformability of the source image. We also show a simple relationship between LDDMM and the new approach, implying that spatially-varying kernels are interpretable in the same way in LDDMM. We conclude with a discussion of a class of kernels that enforce a soft mirror-symmetry constraint, which we validate in numerical experiments on a model of a lesioned brain.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Invariant higher-order variational problems II

Motivated by applications in computational anatomy, we consider a second-order problem in the calculus of variations on object manifolds that are acted upon by Lie groups of smooth invertible transformations. This problem leads to solution curves known as Riemannian cubics on object manifolds that are endowed with normal metrics. The prime examples of such object manifolds are the symmetric spaces. We characterize the class of cubics on object manifolds that can be lifted horizontally to cubics on the group of transformations. Conversely, we show that certain types of non-horizontal geodesics on the group of transformations project to cubics. Finally, we apply second-order Lagrange--Poincaré reduction to the problem of Riemannian cubics on the group of transformations. This leads to a reduced form of the equations that reveals the obstruction for the projection of a cubic on a transformation group to again be a cubic on its object manifold.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Extension to Infinite Dimensions of a Stochastic Second-Order Model associated with the Shape Splines

We introduce a second-order stochastic model to explore the variability in growth of biological shapes with applications to medical imaging. Our model is a perturbation with a random force of the Hamiltonian formulation of the geodesics. Starting with the finite-dimensional case of landmarks, we prove that the random solutions do not blow up in finite time. We then prove the consistency of the model by demonstrating a strong convergence result from the finite-dimensional approximations to the infinite-dimensional setting of shapes. To this end we introduce a suitable Hilbert space close to a Besov space that leads to our result being valid in any dimension of the ambient space and for a wide range of shapes.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Shape Splines and Stochastic Shape Evolutions: A Second Order Point of View

This article presents a new mathematical framework to perform statistical analysis on time-indexed sequences of 2D or 3D shapes. At the core of this statistical analysis is the task of time interpolation of such data. Current models in use can be compared to linear interpolation for one dimensional data. We develop a spline interpolation method which is directly related to cubic splines on a Riemannian manifold. Our strategy consists of introducing a control variable on the Hamiltonian equations of the geodesics. Motivated by statistical modeling of spatiotemporal data, we also design a stochastic model to deal with random shape evolutions. This model is closely related to the spline model since the control variable previously introduced is set as a random force perturbing the evolution. Although we focus on the finite dimensional case of landmarks, our models can be extended to infinite dimensional shape spaces, and they provide a first step for a non parametric growth model for shapes taking advantage of the widely developed framework of large deformations by diffeomorphisms.

0 citations0 reviewsNo code linkedOpen access