BZPEERPapers, people, evidence and research pathsDiscover
Research tools
Network
Opportunities
Account
Source author record
Gennady Samorodnitsky appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.
Catalog footprint
Research graph
Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.
BZPEER is loading the nearby papers, people, topics and institutions for this page.
Published work
We investigate how large deviations events cluster in the framework of an infinite moving average process with light-tailed noise and long memory. The long memory makes clusters larger, and the asymptotic behaviour of the size of the cluster turns out to be described by the first hitting time of a randomly shifted fractional Brownian motion with drift.
In this paper, we provide an extension of confidence sequences for settings where the variance of the data-generating distribution does not exist or is infinite. Confidence sequences furnish confidence intervals that are valid at arbitrary data-dependent stopping times, naturally having a wide range of applications. We first establish a lower bound for the width of the Catoni-style confidence sequences for the finite variance case to highlight the looseness of the existing results. Next, we derive tight Catoni-style confidence sequences for data distributions having a relaxed bounded~$p^{th}-$moment, where~$p \in (1,2]$, and strengthen the results for the finite variance case of~$p =2$. The derived results are shown to better than confidence sequences obtained using Dubins-Savage inequality.
A surprising result of Pillai and Meng (2016) showed that a transformation $\sum_{j=1}^n w_j X_j/Y_j$ of two iid centered normal random vectors, $(X_1,\ldots, X_n)$ and $(Y_1,\ldots, Y_n)$, $n>1$, for any weights $0\leq w_j\leq 1$, $ j=1,\ldots, n$, $\sum_{j=1}^n w_j=1$, has a Cauchy distribution regardless of any correlations within the normal vectors. The correlations appear to lose out in the competition with the heavy tails. To clarify how extensive this phenomenon is, we analyze two other transformations of two iid centered normal random vectors. These transformations are similar in spirit to the transformation considered by Pillai and Meng (2016). One transformation involves absolute values: $\sum_{j=1}^n w_j X_j/|Y_j|$. The second involves randomly stopped Brownian motions: $\sum_{j=1}^n w_j X_j\bigl(Y_j^{-2}\bigr)$, where $\bigl\{\bigl( X_1(t),\ldots, X_n(t)\bigr), \, t\geq 0\bigr\},\ n>1,$ is a Brownian motion with positive variances; $(Y_1,\ldots, Y_n)$ is a centered normal random vector with the same law as $( X_1(1),\ldots, X_n(1))$ and independent of it; and $X(Y^{-2})$ is the value of the Brownian motion $X(t)$ evaluated at the random time $t=Y^{-2}$. All three transformations result in a Cauchy distribution if the covariance matrix of the normal components is diagonal, or if all the correlations implied by the covariance matrix equal 1. However, while the transformation Pillai and Meng (2016) considered produces a Cauchy distribution regardless of the normal covariance matrix. the transformations we consider here do not always produce a Cauchy distribution. The correlations between jointly normal random variables are not always overwhelmed by the heaviness of the marginal tails. The mysteries of the connections between normal and Cauchy laws remain to be understood.
We consider the multi-parameter random simplicial complex as a higher dimensional extension of the classical Erdös-Rényi graph. We investigate appearance of "unusual" topological structures in the complex from the point of view of large deviations. We first study upper tail large deviation probabilities for subcomplex counts, deriving the order of magnitude of such probabilities at the logarithmic scale precision. The obtained results are then applied to analyze large deviations for the number of simplices at the critical dimension and below. Finally, these results are also used to deduce large deviation estimates for Betti numbers of the complex in the critical dimension.
Topological study of existing random simplicial complexes is non-trivial and has led to several seminal works. However, the applicability of such studies is limited since the randomness there is usually governed by a single parameter. With this in mind, we focus here on the topology of the recently proposed multi-parameter random simplicial complex and, more importantly, of its dynamic analogue that we introduce here. In this dynamic setup, the temporal evolution of simplices is determined by stationary and possibly non-Markovian processes with a renewal structure. The dynamic versions of the clique complex and the Linial-Meshulum complex are special cases of our setup. Our key result concerns the regime where face-counts of a particular dimension dominate. We show that the Betti numbers corresponding to this dimension and the Euler characteristic satisfy functional strong law of large numbers and functional central limit theorems. Surprisingly, in the latter result, the limiting Gaussian process depends only upon the dynamics in the smallest non-trivial dimension.
We study clustering of the extremes in a stationary sequence with subexponential tails in the maximum domain of attraction of the Gumbel We obtain functional limit theorems in the space of random sup-measures and in the space $D(0,\infty)$. The limits have the Gumbel distribution if the memory is only moderately long. However, as our results demonstrate rather strikingly, the "heuristic of a single big jump" could fail even in a moderately long range dependence setting. As the tails become lighter, the extremal behavior of a stationary process may depend on multiple large values of the driving noise.
A functional limit theorem for the partial maxima of a long memory stable sequence produces a limiting process that can be described as a $β$-power time change in the classical Fréchet extremal process, for $β$ in a subinterval of the unit interval. Any such power time change in the extremal process for $0<β<1$ produces a process with stationary max-increments. This deceptively simple time change hides the much more delicate structure of the resulting process as a self-affine random sup measure. We uncover this structure and show that in a certain range of the parameters this random measure arises as a limit of the partial maxima of the same long memory stable sequence, but in a different space. These results open a way to construct a whole new class of self-similar Fréchet processes with stationary max-increments.
Preferential attachment is a widely adopted paradigm for understanding the dynamics of social networks. Formal statistical inference,for instance GLM techniques, and model verification methods will require knowing test statistics are asymptotically normal even though node or count based network data is nothing like classical data from independently replicated experiments. We therefore study asymptotic normality of degree counts for a sequence of growing simple undirected preferential attachment graphs. The methods of proof rely on identifying martingales and then exploiting the martingale central limit theorems.
How likely is the high level of a continuous Gaussian random field on an Euclidean space to have a "hole" of a certain dimension and depth? Questions of this type are difficult, but in this paper we make progress on questions shedding new light in existence of holes. How likely is the field to be above a high level on one compact set (e.g. a sphere) and to be below a fraction of that level on some other compact set, e.g. at the center of the corresponding ball? How likely is the field to be below that fraction of the level {\it anywhere} inside the ball? We work on the level of large deviations.
We establish a new class of functional central limit theorems for partial sum of certain symmetric stationary infinitely divisible processes with regularly varying Lévy measures. The limit process is a new class of symmetric stable self-similar processes with stationary increments that coincides on a part of its parameter space with a previously described process. The normalizing sequence and the limiting process are determined by the ergodic-theoretical properties of the flow underlying the integral representation of the process. These properties can be interpreted as determining how long the memory of the stationary infinitely divisible process is. We also establish functional convergence, in a strong distributional sense, for conservative pointwise dual ergodic maps preserving an infinite measure.
We prove a functional central limit theorem for partial sums of symmetric stationary long range dependent heavy tailed infinitely divisible processes with a certain type of negative dependence. Previously only positive dependence could be treated. The negative dependence involves cancellations of the Gaussian second order. This leads to new types of limiting processes involving stable random measures, due to heavy tails, Mittag-Leffler processes, due to long memory, and Brownian motions, due to the Gaussian second order cancellations.
We derive a functional limit theorem for the partial maxima process based on a long memory stationary $α$-stable process. The length of memory in the stable process is parameterized by a certain ergodic-theoretical parameter in an integral representation of the process. The limiting process is no longer a classical extremal Fréchet process. It is a self-similar process with $α$-Fréchet marginals, and it has stationary max-increments, a property which we introduce in this paper. The functional limit theorem is established in the space $D[0,\infty)$ equipped with the Skorohod $M_1$-topology; in certain special cases the topology can be strengthened to the Skorohod $J_1$-topology.
We propose a new definition of a multivariate subexponential distribution. We compare this definition with the two existing notions of multivariate subexponentiality, and compute the asymptotic behaviour of the ruin probability in the context of an insurance portfolio, when multivariate subexponentiality holds. Previously such results were available only in the case of multivariate regularly varying claims.
Regular variation of distributional tails is known to be preserved by various linear transformations of some random structures. An inverse problem for regular variation aims at understanding whether the regular variation of a transformed random object is caused by regular variation of components of the original random structure. In this paper we build up on previous work and derive results in the multivariate case and in situations where regular variation is not restricted to one particular direction or quadrant.
For the directed edge preferential attachment network growth model studied by Bollobas et al. (2003) and Krapivsky and Redner (2001), we prove that the joint distribution of in-degree and out-degree has jointly regularly varying tails. Typically the marginal tails of the in-degree distribution and the out-degree distribution have different regular variation indices and so the joint regular variation is non-standard. Only marginal regular variation has been previously established for this distribution in the cases where the marginal tail indices are different.
The structure of Gaussian random fields over high levels is a well researched and well understood area, particularly if the field is smooth. However, the question as to whether or not two or more points which lie in an excursion set belong to the same connected component has constantly eluded analysis. We study this problem from the point of view of large deviations, finding the asymptotic probabilities that two such points are connected by a path laying within the excursion set, and so belong to the same component. In addition, we obtain a characterization and descriptions of the most likely paths, given that one exists.
Abel-Tauberian theorems relate power law behavior of distributions and their transforms. We formulate and prove a multivariate version for non-standard regularly varying measures on $\mathbb{R}_+^p$ and then apply it to prove that the joint distribution of in- and out-degree in a directed edge preferential attachement model has jointly regularly varying tails.
We consider smooth, infinitely divisible random fields $(X(t),t\in M)$, $M\subset {\mathbb{R}}^d$, with regularly varying Levy measure, and are interested in the geometric characteristics of the excursion sets \[A_u=\{t\in M:X(t)>u\}\] over high levels u. For a large class of such random fields, we compute the $u\to\infty$ asymptotic joint distribution of the numbers of critical points, of various types, of X in $A_u$, conditional on $A_u$ being nonempty. This allows us, for example, to obtain the asymptotic conditional distribution of the Euler characteristic of the excursion set. In a significant departure from the Gaussian situation, the high level excursion sets for these random fields can have quite a complicated geometry. Whereas in the Gaussian case nonempty excursion sets are, with high probability, roughly ellipsoidal, in the more general infinitely divisible setting almost any shape is possible.
It is, perhaps, surprising that the location of the unique supremum of a stationary process on an interval can fail to be uniformly distributed over that interval. We show that this distribution is absolutely continuous in the interior of the interval and describe very specific conditions the density has to satisfy. We establish universal upper bounds on the density and demonstrate their optimality.
The method of stable random projections is popular for efficiently computing the Lp distances in high dimension (where 0<p<=2), using small space. Because it adopts nonadaptive linear projections, this method is naturally suitable when the data are collected in a dynamic streaming fashion (i.e., turnstile data streams). In this paper, we propose to use only the signs of the projected data and analyze the probability of collision (i.e., when the two signs differ). We derive a bound of the collision probability which is exact when p=2 and becomes less sharp when p moves away from 2. Interestingly, when p=1 (i.e., Cauchy random projections), we show that the probability of collision can be accurately approximated as functions of the chi-square similarity. For example, when the (un-normalized) data are binary, the maximum approximation error of the collision probability is smaller than 0.0192. In text and vision applications, the chi-square similarity is a popular measure for nonnegative data when the features are generated from histograms. Our experiments confirm that the proposed method is promising for large-scale learning applications.
We study the asymptotic behavior of empirical processes generated by measurable bounded functions of an infinite source Poisson transmission process when the session length have infinite variance. In spite of the boundedness of the function, the normalized fluctuations of such an empirical process converge to a non-Gaussian stable process. This phenomenon can be viewed as caused by the long-range dependence in the transmission process. Completing previous results on the empirical mean of similar types of processes, our results on non-linear bounded functions exhibit the influence of the limit transmission rate distribution at high session lengths on the asymptotic behavior of the empirical process. As an illustration, we apply the main result to estimation of the distribution function of the steady state value of the transmission process.
The location of the unique supremum of a stationary process on an interval does not need to be uniformly distributed over that interval. We describe all possible distributions of the supremum location for a broad class of such stationary processes. We show that, in the strongly mixing case, this distribution does tend to the uniform in a certain sense as the length of the interval increases to infinity.
We obtain the rate of growth of long strange segments and the rate of decay of infinite horizon ruin probabilities for a class of infinite moving average processes with exponentially light tails. The rates are computed explicitly. We show that the rates are very similar to those of an i.i.d. process as long as the moving average coefficients decay fast enough. If they do not, then the rates are significantly different. This demonstrates the change in the length of memory in a moving average process associated with certain changes in the rate of decay of the coefficients.
We address the important question of the extent to which random variables and vectors with truncated power tails retain the characteristic features of random variables and vectors with power tails. We define two truncation regimes, soft truncation regime and hard truncation regime, and show that, in the soft truncation regime, truncated power tails behave, in important respects, as if no truncation took place. On the other hand, in the hard truncation regime much of "heavy tailedness" is lost. We show how to estimate consistently the tail exponent when the tails are truncated, and suggest statistical tests to decide on whether the truncation is soft or hard. Finally, we apply our methods to two recent data sets arising from computer networks.
In this paper, we study the weak convergence of the integrated periodogram indexed by classes of functions for linear processes with symmetric $α$-stable innovations. Under suitable summability conditions on the series of the Fourier coefficients of the index functions, we show that the weak limits constitute $α$-stable processes which have representations as infinite Fourier series with i.i.d. $α$-stable coefficients. The cases $α\in(0,1)$ and $α\in[1,2)$ are dealt with by rather different methods and under different assumptions on the classes of functions. For example, in contrast to the case $α\in(0,1)$, entropy conditions are needed for $α\in[1,2)$ to ensure the tightness of the sequence of integrated periodograms indexed by functions. The results of this paper are of additional interest since they provide limit results for infinite mean random quadratic forms with particular Toeplitz coefficient matrices.