Source author record

Sébastien Loustau

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

math.ST Statistics Theory Machine Learning physics.soc-ph Social and Information Networks

Catalog footprint

Research overview

9works

5topics

4close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2016arXiv

MCMC Louvain for Online Community Detection

We introduce a novel algorithm of community detection that maintains dynamically a community structure of a large network that evolves with time. The algorithm maximizes the modularity index thanks to the construction of a randomized hierarchical clustering based on a Monte Carlo Markov Chain (MCMC) method. Interestingly, it could be seen as a dynamization of Louvain algorithm (see Blondel et Al, 2008) where the aggregation step is replaced by the hierarchical instrumental probability.

preprint2015arXiv

Bandwidth selection in kernel empirical risk minimization via the gradient

In this paper, we deal with the data-driven selection of multidimensional and possibly anisotropic bandwidths in the general framework of kernel empirical risk minimization. We propose a universal selection rule, which leads to optimal adaptive results in a large variety of statistical models such as nonparametric robust regression and statistical learning with errors in variables. These results are stated in the context of smooth loss functions, where the gradient of the risk appears as a good criterion to measure the performance of our estimators. The selection rule consists of a comparison of gradient empirical risks. It can be viewed as a nontrivial improvement of the so-called Goldenshluger-Lepski method to nonlinear estimators. Furthermore, one main advantage of our selection rule is the nondependency on the Hessian matrix of the risk, usually involved in standard adaptive procedures.

preprint2015arXiv

Minimax fast rates for discriminant analysis with errors in variables

The effect of measurement errors in discriminant analysis is investigated. Given observations $Z=X+ε$ , where $ε$ denotes a random noise, the goal is to predict the density of $X$ among two possible candidates $f$ and $g$ . We suppose that we have at our disposal two learning samples. The aim is to approach the best possible decision rule $G^\star$ defined as a minimizer of the Bayes risk. In the free-noise case $(ε=0)$ , minimax fast rates of convergence are well-known under the margin assumption in discriminant analysis (see \cite{mammen}) or in the more general classification framework (see \cite{tsybakov2004,AT}). In this paper we intend to establish similar results in the noisy case, i.e. when dealing with errors in variables. We prove minimax lower bounds for this problem and explain how can these rates be attained, using in particular an Empirical Risk Minimizer (ERM) method based on deconvolution kernel estimators.

preprint2013arXiv

Adaptive Noisy Clustering

The problem of adaptive noisy clustering is investigated. Given a set of noisy observations $Z_i=X_i+ε_i$ , $i=1,...,n$ , the goal is to design clusters associated with the law of $X_i$ 's, with unknown density $f$ with respect to the Lebesgue measure. Since we observe a corrupted sample, a direct approach as the popular {\it $k$ -means} is not suitable in this case. In this paper, we propose a noisy $k$ -means minimization, which is based on the $k$ -means loss function and a deconvolution estimator of the density $f$ . In particular, this approach suffers from the dependence on a bandwidth involved in the deconvolution kernel. Fast rates of convergence for the excess risk are proposed for a particular choice of the bandwidth, which depends on the smoothness of the density $f$ . Then, we turn out into the main issue of the paper: the data-driven choice of the bandwidth. We state an adaptive upper bound for a new selection rule, called ERC (Empirical Risk Comparison). This selection rule is based on the Lepski's principle, where empirical risks associated with different bandwidths are compared. Finally, we illustrate that this adaptive rule can be used in many statistical problems of $M$ -estimation where the empirical risk depends on a nuisance parameter.

preprint2013arXiv

Anisotropic oracle inequalities in noisy quantization

The effect of errors in variables in quantization is investigated. We prove general exact and non-exact oracle inequalities with fast rates for an empirical minimization based on a noisy sample $Z_i=X_i+ε_i,i=1,\ldots,n$ , where $X_i$ are i.i.d. with density $f$ and $ε_i$ are i.i.d. with density $η$ . These rates depend on the geometry of the density $f$ and the asymptotic behaviour of the characteristic function of $η$ . This general study can be applied to the problem of $k$ -means clustering with noisy data. For this purpose, we introduce a deconvolution $k$ -means stochastic minimization which reaches fast rates of convergence under standard Pollard's regularity assumptions.

preprint2013arXiv

Noisy classification with boundary assumptions

We address the problem of classification when data are collected from two samples with measurement errors. This problem turns to be an inverse problem and requires a specific treatment. In this context, we investigate the minimax rates of convergence using both a margin assumption, and a smoothness condition on the boundary of the set associated to the Bayes classifier. We establish lower and upper bounds (based on a deconvolution classifier) on these rates.

preprint2013arXiv

The algorithm of noisy k-means

In this note, we introduce a new algorithm to deal with finite dimensional clustering with errors in variables. The design of this algorithm is based on recent theoretical advances (see Loustau (2013a,b)) in statistical learning with errors in variables. As the previous mentioned papers, the algorithm mixes different tools from the inverse problem literature and the machine learning community. Coarsely, it is based on a two-step procedure: (1) a deconvolution step to deal with noisy inputs and (2) Newton's iterations as the popular k-means.

preprint2012arXiv

Fast rates for noisy clustering

The effect of errors in variables in empirical minimization is investigated. Given a loss $l$ and a set of decision rules $\mathcal{G}$ , we prove a general upper bound for an empirical minimization based on a deconvolution kernel and a noisy sample $Z_i=X_i+ε_i,i=1,...,n$ . We apply this general upper bound to give the rate of convergence for the expected excess risk in noisy clustering. A recent bound from \citet{levrard} proves that this rate is $\mathcal{O}(1/n)$ in the direct case, under Pollard's regularity assumptions. Here the effect of noisy measurements gives a rate of the form $\mathcal{O}(1/n^{\fracγ{γ+2β}})$ , where $γ$ is the Hölder regularity of the density of $X$ whereas $β$ is the degree of illposedness.

preprint2012arXiv

Statistical learning with indirect observations

Let $(X,Y)\in\mathcal{X}\times \mathcal{Y}$ be a random couple with unknown distribution $P$ . Let $\GG$ be a class of measurable functions and $\ell$ a loss function. The problem of statistical learning deals with the estimation of the Bayes: $$g^*=\arg\min_{g\in\GG}\E_P \ell(g(X),Y). $$ In this paper, we study this problem when we deal with a contaminated sample $(Z_1,Y_1),..., (Z_n,Y_n)$ of i.i.d. indirect observations. Each input $Z_i$ , $i=1,...,n$ is distributed from a density $Af$ , where $A$ is a known compact linear operator and $f$ is the density of the direct input $X$ . We derive fast rates of convergence for empirical risk minimizers based on regularization methods, such as deconvolution kernel density estimators or spectral cut-off. These results are comparable to the existing fast rates in Koltchinskii for the direct case. It gives some insights into the effect of indirect measurements in the presence of fast rates of convergence.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Sébastien Loustau

Research overview

Is this your work?

9 publications

MCMC Louvain for Online Community Detection

Bandwidth selection in kernel empirical risk minimization via the gradient

Minimax fast rates for discriminant analysis with errors in variables

Adaptive Noisy Clustering

Anisotropic oracle inequalities in noisy quantization

Noisy classification with boundary assumptions

The algorithm of noisy k-means

Fast rates for noisy clustering

Statistical learning with indirect observations

See the researcher in context

Building this map preview