Hoeffding's inequality for sums of weakly dependent random variables
We provide a systematic approach to deal with the following problem. Let $X_1,\ldots,X_n$ be, possibly dependent, $[0,1]$-valued random variables. What is a sharp upper bound on the probability that their sum is significantly larger than their mean? In the case of independent random variables, a fundamental tool for bounding such probabilities is devised by Wassily Hoeffding. In this paper we consider analogues of Hoeffding's result for sums of dependent random variables for which we have certain information on their dependency structure. We prove a result that yields concentration inequalities for several notions of weak dependence between random variables. Additionally, we obtain a new concentration inequality for sums of, possibly dependent, $[0,1]$-valued random variables, $X_1,\ldots,X_n$, that satisfy the following condition: there exist constants $γ\in (0,1)$ and $δ\in (0,1]$ such that for every subset $A\subseteq \{1,\ldots,n\}$ we have $\mathbb{E}\left[\prod_{i\in A} X_i \prod_{i\notin A}(1-X_i) \right]\leq γ^{|A|} δ^{n-|A|}$, where $|A|$ denotes the cardinality of $A$. Our approach applies to several sums of weakly dependent random variables such as sums of martingale difference sequences, sums of $k$-wise independent random variables and $U$-statistics. Finally, we discuss some applications to the theory of random graphs.
