Source author record

Michaël Fanuel

Michaël Fanuel appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Machine Learning hep-th gr-qc math-ph math.MP

Catalog footprint

What is connected

5works

5topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2021arXiv

Determinantal Point Processes Implicitly Regularize Semi-parametric Regression Problems

Semi-parametric regression models are used in several applications which require comprehensibility without sacrificing accuracy. Typical examples are spline interpolation in geophysics, or non-linear time series problems, where the system includes a linear and non-linear component. We discuss here the use of a finite Determinantal Point Process (DPP) for approximating semi-parametric models. Recently, Barthelmé, Tremblay, Usevich, and Amblard introduced a novel representation of some finite DPPs. These authors formulated extended L-ensembles that can conveniently represent partial-projection DPPs and suggest their use for optimal interpolation. With the help of this formalism, we derive a key identity illustrating the implicit regularization effect of determinantal sampling for semi-parametric regression and interpolation. Also, a novel projected Nyström approximation is defined and used to derive a bound on the expected risk for the corresponding approximation of semi-parametric regression. This work naturally extends similar results obtained for kernel ridge regression.

preprint2020arXiv

Diversity sampling is an implicit regularization for kernel methods

Kernel methods have achieved very good performance on large scale regression and classification problems, by using the Nyström method and preconditioning techniques. The Nyström approximation -- based on a subset of landmarks -- gives a low rank approximation of the kernel matrix, and is known to provide a form of implicit regularization. We further elaborate on the impact of sampling diverse landmarks for constructing the Nyström approximation in supervised as well as unsupervised kernel methods. By using Determinantal Point Processes for sampling, we obtain additional theoretical results concerning the interplay between diversity and regularization. Empirically, we demonstrate the advantages of training kernel methods based on subsets made of diverse points. In particular, if the dataset has a dense bulk and a sparser tail, we show that Nyström kernel regression with diverse landmarks increases the accuracy of the regression in sparser regions of the dataset, with respect to a uniform landmark sampling. A greedy heuristic is also proposed to select diverse samples of significant size within large datasets when exact DPP sampling is not practically feasible.

preprint2020arXiv

Wasserstein Exponential Kernels

In the context of kernel methods, the similarity between data points is encoded by the kernel function which is often defined thanks to the Euclidean distance, a common example being the squared exponential kernel. Recently, other distances relying on optimal transport theory - such as the Wasserstein distance between probability distributions - have shown their practical relevance for different machine learning techniques. In this paper, we study the use of exponential kernels defined thanks to the regularized Wasserstein distance and discuss their positive definiteness. More specifically, we define Wasserstein feature maps and illustrate their interest for supervised learning problems involving shapes and images. Empirically, Wasserstein squared exponential kernels are shown to yield smaller classification errors on small training sets of shapes, compared to analogous classifiers using Euclidean distances.

preprint2014arXiv

Affine Quantization and the Initial Cosmological Singularity

The Affine Coherent State Quantization procedure is applied to the case of a FRLW universe in the presence of a cosmological constant. The quantum corrections alter the dynamics of the system in the semiclassical regime, providing a potential barrier term which avoids all classical singularities, as already suggested in other models studied in the literature. Furthermore the quantum corrections are responsible for an accelerated cosmic expansion. This work intends to explore some of the implications of the recently proposed "Enhanced Quantization" procedure in a simplified model of cosmology.

preprint2011arXiv

Dressed Fermions, Modular Transformations and Bosonization in the Compactified Schwinger Model

The celebrated exactly solvable "Schwinger" model, namely massless two-dimensional QED, is revisited. The solution presented here emphasizes the non- perturbative relevance of the topological sector through large gauge transformations whose role is made manifest by compactifying space into a circle. Eventually the well-known non-perturbative features and solution of the model are recovered in the massless case. However the fermion mass term is shown to play a subtle role in order to achieve a physical quantization that accounts for gauge invariance under both small and large gauge symmetries. Quantization of the system follows Dirac's approach in an explicitly gauge invariant way that avoids any gauge fixing procedure.