What You See and What You Don't See: The Hidden Moments of a Probability Distribution

preprint2020arXivOpen access

Abstract

Empirical distributions have their in-sample maxima as natural censoring. We look at the "hidden tail", that is, the part of the distribution in excess of the maximum for a sample size of nn. Using extreme value theory, we examine the properties of the hidden tail and calculate its moments of order pp. The method is useful in showing how large a bias one can expect, for a given nn, between the visible in-sample mean and the true statistical mean (or higher moments), which is considerable for αα close to 1. Among other properties, we note that the "hidden" moment of order 00, that is, the exceedance probability for power law distributions, follows an exponential distribution and has for expectation 1n\frac{1}{n} regardless of the parametrization of the scale and tail index.

Explore this paper’s authors, topics and related work.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Reviews 0

Write a reviewWrite

No reviews yet.

Discussion 0

Add a commentWrite

No comments yet.