Source author record

Xavier Gendre

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

math.ST Statistics Theory Computation Machine Learning math.PR

Catalog footprint

Research overview

3works

5topics

3close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2023arXiv

Stochastic Langevin Monte Carlo for (weakly) log-concave posterior distributions

In this paper, we investigate a continuous time version of the Stochastic Langevin Monte Carlo method, introduced in [WT11], that incorporates a stochastic sampling step inside the traditional over-damped Langevin diffusion. This method is popular in machine learning for sampling posterior distribution. We will pay specific attention in our work to the computational cost in terms of $n$ (the number of observations that produces the posterior distribution), and $d$ (the dimension of the ambient space where the parameter of interest is living). We derive our analysis in the weakly convex framework, which is parameterized with the help of the Kurdyka-Łojasiewicz (KL) inequality, that permits to handle a vanishing curvature settings, which is far less restrictive when compared to the simple strongly convex case. We establish that the final horizon of simulation to obtain an $\varepsilon$ approximation (in terms of entropy) is of the order $( d \log(n)^2 )^{(1+r)^2} [\log^2(\varepsilon^{-1}) + n^2 d^{2(1+r)} \log^{4(1+r)}(n) ]$ with a Poissonian subsampling of parameter $\left(n ( d \log^2(n))^{1+r}\right)^{-1}$ , where the parameter $r$ is involved in the KL inequality and varies between $0$ (strongly convex case) and $1$ (limiting Laplace situation).

preprint2013arXiv

Minimax properties of Fréchet means of discretely sampled curves

We study the problem of estimating a mean pattern from a set of similar curves in the setting where the variability in the data is due to random geometric deformations and additive noise. We propose an estimator based on the notion of Frechet mean that is a generalization of the standard notion of averaging to non-Euclidean spaces. We derive a minimax rate for this estimation problem, and we show that our estimator achieves this optimal rate under the asymptotics where both the number of curves and the number of sampling points go to infinity.

preprint2012arXiv

Model selection and estimation of a component in additive regression

Let $Y\in\R^n$ be a random vector with mean $s$ and covariance matrix $σ^2P_n\tra{P_n}$ where $P_n$ is some known $n\times n$ -matrix. We construct a statistical procedure to estimate $s$ as well as under moment condition on $Y$ or Gaussian hypothesis. Both cases are developed for known or unknown $σ^2$ . Our approach is free from any prior assumption on $s$ and is based on non-asymptotic model selection methods. Given some linear spaces collection $\{S_m,\ m\in\M\}$, we consider, for any $m\in\M$, the least-squares estimator $\hat{s}_m$ of $s$ in $S_m$ . Considering a penalty function that is not linear in the dimensions of the $S_m$ 's, we select some $\hat{m}\in\M$ in order to get an estimator $\hat{s}_{\hat{m}}$ with a quadratic risk as close as possible to the minimal one among the risks of the $\hat{s}_m$ 's. Non-asymptotic oracle-type inequalities and minimax convergence rates are proved for $\hat{s}_{\hat{m}}$ . A special attention is given to the estimation of a non-parametric component in additive models. Finally, we carry out a simulation study in order to illustrate the performances of our estimators in practice.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.