Researcher profile

Oleg Lepski

Oleg Lepski contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
9works
0followers
3topics
2close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

9 published item(s)

preprint2020arXiv

Minimax estimation of norms of a probability density: I. Lower bounds

The paper deals with the problem of nonparametric estimating the $L_p$--norm, $p\in (1,\infty)$, of a probability density on $R^d$, $d\geq 1$ from independent observations. The unknown density %to be estimated is assumed to belong to a ball in the anisotropic Nikolskii's space. We adopt the minimax approach, and derive lower bounds on the minimax risk. In particular, we demonstrate that accuracy of estimation procedures essentially depends on whether $p$ is integer or not. Moreover, we develop a general technique for derivation of lower bounds on the minimax risk in the problems of estimating nonlinear functionals. The proposed technique is applicable for a broad class of nonlinear functionals, and it is used for derivation of the lower bounds in the~$L_p$--norm estimation.

preprint2020arXiv

Minimax estimation of norms of a probability density: II. Rate-optimal estimation procedures

In this paper we develop rate--optimal estimation procedures in the problem of estimating the $L_p$--norm, $p\in (0, \infty)$ of a probability density from independent observations. The density is assumed to be defined on $R^d$, $d\geq 1$ and to belong to a ball in the anisotropic Nikolskii space. We adopt the minimax approach and construct rate--optimal estimators in the case of integer $p\geq 2$. We demonstrate that, depending on parameters of Nikolskii's class and the norm index $p$, the risk asymptotics ranges from inconsistency to $\sqrt{n}$--estimation. The results in this paper complement the minimax lower bounds derived in the companion paper \cite{gl20}.

preprint2014arXiv

Adaptive estimation over anisotropic functional classes via oracle approach

We address the problem of adaptive minimax estimation in white gaussian noise model under $L_p$--loss, $1\leq p\leq\infty,$ on the anisotropic Nikolskii classes. We present the estimation procedure based on a new data-driven selection scheme from the family of kernel estimators with varying bandwidths. For proposed estimator we establish so-called Lp-norm oracle inequality and use it for deriving minimax adaptive results. We prove the existence of rate-adaptive estimators and fully characterize behavior of the minimax risk for different relationships between regularity parameters and norm indexes in definitions of the functional class and of the risk. In particular some new asymptotics of the minimax risk are discovered including necessary and sufficient conditions for existence a uniformly consistent estimator. We provide also with detailed overview of existing methods and results and formulate open problems in adaptive minimax estimation.

preprint2014arXiv

Adaptive estimation under single-index constraint in a regression model

The problem of adaptive multivariate function estimation in the single-index regression model with random design and weak assumptions on the noise is investigated. A novel estimation procedure that adapts simultaneously to the unknown index vector and the smoothness of the link function by selecting from a family of specific kernel estimators is proposed. We establish a pointwise oracle inequality which, in its turn, is used to judge the quality of estimating the entire function (``global'' oracle inequality). Both the results are applied to the problems of pointwise and global adaptive estimation over a collection of Hölder and Nikol'skii functional classes, respectively.

preprint2013arXiv

Adaptive estimation in the single-index model via oracle approach

In the framework of nonparametric multivariate function estimation we are interested in structural adaptation. We assume that the function to be estimated has the &#34;single-index&#34; structure where neither the link function nor the index vector is known. We suggest a novel procedure that adapts simultaneously to the unknown index and smoothness of the link function. For the proposed procedure, we prove a &#34;local&#34; oracle inequality (described by the pointwise seminorm), which is then used to obtain the upper bound on the maximal risk of the adaptive estimator under assumption that the link function belongs to a scale of Hölder classes. The lower bound on the minimax risk shows that in the case of estimating at a given point the constructed estimator is optimally rate adaptive over the considered range of classes. For the same procedure we also establish a &#34;global&#34; oracle inequality (under the $ L_r $ norm, $r< \infty $) and examine its performance over the Nikol&#39;skii classes. This study shows that the proposed method can be applied to estimating functions of inhomogeneous smoothness, that is whose smoothness may vary from point to point.

preprint2013arXiv

Estimation adaptative dans le modèle single-index par l&#39;approche d&#39;oracle

In the framework of nonparametric multivariate function estimation we are interested in structural adaptation. We assume that the function to be estimated possesses the single-index structure where neither the link function nor the index vector is known. We propose a novel procedure that adapts simultaneously to the unknown index and smoothness of link function. For the proposed procedure, we present a &#34;local&#34; oracle inequality (described by the pointwise seminorm), which is then used to obtain the upper bound on the maximal risk under regularity assumption on the link function. The lower bound on the minimax risk shows that the constructed estimator is optimally rate adaptive over the considered range of classes. For the same procedure we also establish a &#34;global&#34; oracle inequality (under the $ L_r $ norm, $r< \infty $) and study its performance over the Nikol&#39;skii classes. This study shows that the proposed method can be applied to estimating functions of inhomogeneous smoothness.

preprint2012arXiv

Bandwidth selection in kernel density estimation: Oracle inequalities and adaptive minimax optimality

We address the problem of density estimation with $\mathbb{L}_s$-loss by selection of kernel estimators. We develop a selection procedure and derive corresponding $\mathbb{L}_s$-risk oracle inequalities. It is shown that the proposed selection rule leads to the estimator being minimax adaptive over a scale of the anisotropic Nikol&#39;skii classes. The main technical tools used in our derivations are uniform bounds on the $\mathbb{L}_s$-norms of empirical processes developed recently by Goldenshluger and Lepski [Ann. Probab. (2011), to appear].

preprint2012arXiv

Uniform bounds for norms of sums of independent random functions

In this paper, we develop a general machinery for finding explicit uniform probability and moment bounds on sub-additive positive functionals of random processes. Using the developed general technique, we derive uniform bounds on the ${\mathbb{L}}_s$-norms of empirical and regression-type processes. Usefulness of the obtained results is illustrated by application to the processes appearing in kernel density estimation and in nonparametric estimation of regression functions.

preprint2012arXiv

Upper functions for positive random functionals

The main objective of this paper is to look from the unique point of view at some phenomena arising in different areas of probability theory and mathematical statistics. We will try to understand what is common between classical probabilistic results, such as the law of iterated logarithm for example, and well-known problem in adaptive estimation called price to pay for adaptation. Why exists two different kinds of this price? What relates exponential inequalities for M-estimators, so-called uniform-in-bandwidth consistency in density or regression model and the bounds for modulus of continuity of gaussian random functions defined on a metric space equipped with doubling measure? It turned out that all these and many others problems can be reduced to finding upper functions for a collection real- valued random variables. Each variable is the value of a given sub-additive positive functional of continuous random mapping defined on a totally bounded subset of a metric space.