Sharp bounds on the rate of convergence of the empirical covariance matrix
Let X1,...,XN∈Rn be independent centered random vectors with log-concave distribution and with the identity as covariance matrix. We show that with overwhelming probability at least 1−3exp(−cn)˚ one has $ \sup_{x\in S^{n-1}} \Big|\frac{1/N}\sum_{i=1}^N (|<X_i, x>|^2 - \E|<X_i, x>|^2\r)\Big| \leq C \sqrt{\frac{n/N}},$ where C is an absolute positive constant. This result is valid in a more general framework when the linear forms (<Xi,x>)i≤N,x∈Sn−1 and the Euclidean norms (∣Xi∣/n)i≤N exhibit uniformly a sub-exponential decay. As a consequence, if A denotes the random matrix with columns (Xi), then with overwhelming probability, the extremal singular values λmin and λmax of AA⊤ satisfy the inequalities 1−Cn/N≤λmin/N≤≤λmax/N1+Cn/N which is a quantitative version of Bai-Yin theorem \cite{BY} known for random matrices with i.i.d. entries.