Source author record

Zhidong Bai

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

Catalog footprint

Research overview

28works
6topics
4close collaborators

Published work

28 publications

preprint2022arXiv

A CLT for the LSS of large dimensional sample covariance matrices with unbounded dispersions

In this paper, we establish the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix when the population covariance matrices are not uniformly bounded, which is a nontrivial extension of the Bai-Silverstein theorem (BST) (2004). The latter has strongly stimulated the development of high-dimensional statistics, especially the application of random matrix theory to statistics. However, the assumption of uniform boundedness of the population covariance matrices is found strongly limited to the applications of BST. The aim of this paper is to remove the blockages to the applications of BST. The new CLT, allows the spiked eigenvalues to exist and tend to infinity. It is interesting to note that the roles of either spiked eigenvalues or the bulk eigenvalues or both of the two are dominating in the CLT. Moreover, the results are checked by simulation studies with various population settings. The CLT for LSS is then applied for testing the hypothesis that a covariance matrix $ \bSi $ is equal to an identity matrix. For this, the asymptotic distributions for the corrected likelihood ratio test (LRT) and Nagao's trace test (NT) under alternative are derived, and we also propose the asymptotic power of LRT and NT under certain alternatives.

preprint2022arXiv

Invariance principle and CLT for the spiked eigenvalues of large-dimensional Fisher matrices and applications

This paper aims to derive asymptotical distributions of the spiked eigenvalues of the large-dimensional spiked Fisher matrices without Gaussian assumption and the restrictive assumptions on covariance matrices. We first establish invariance principle for the spiked eigenvalues of the Fisher matrix. That is, we show that the limiting distributions of the spiked eigenvalues are invariant over a large class of population distributions satisfying certain conditions. Using the invariance principle, we further established a central limit theorem (CLT) for the spiked eigenvalues. As some interesting applications, we use the CLT to derive the power functions of Roy Maximum root test for linear hypothesis in linear models and the test in signal detection. We conduct some Monte Carlo simulation to compare the proposed test with existing ones.

preprint2022arXiv

The limiting spectral distribution of large dimensional general information-plus-noise type matrices

Let Xn X_{n} be n×N n\times N random complex matrices, RnR_{n} and TnT_{n} be non-random complex matrices with dimensions n×Nn\times N and n×nn\times n, respectively. We assume that the entries of Xn X_{n} are independent and identically distributed, Tn T_{n} are nonnegative definite Hermitian matrices and TnRnRn∗=RnRn∗TnT_{n}R_{n}R_{n}^{*}= R_{n}R_{n}^{*}T_{n} . The general information-plus-noise type matrices are defined by Cn=1NTn12(Rn+Xn)(Rn+Xn)∗Tn12C_{n}=\frac{1}{N}T_{n}^{\frac{1}{2}} \left( R_{n} +X_{n}\right) \left(R_{n}+X_{n}\right)^{*}T_{n}^{\frac{1}{2}} . In this paper, we establish the limiting spectral distribution of the large dimensional general information-plus-noise type matrices CnC_{n}. Specifically, we show that as nn and NN tend to infinity proportionally, the empirical distribution of the eigenvalues of CnC_{n} converges weakly to a non-random probability distribution, which is characterized in terms of a system of equations of its Stieltjes transform.

preprint2020arXiv

Modified Pillai's trace statistics for two high-dimensional sample covariance matrices

The goal of this study was to test the equality of two covariance matrices by using modified Pillai's trace statistics under a high-dimensional framework, i.e., the dimension and sample sizes go to infinity proportionally. In this paper, we introduce two modified Pillai's trace statistics and obtain their asymptotic distributions under the null hypothesis. The benefits of the proposed statistics include the following: (1) the sample size can be smaller than the dimensions; (2) the limiting distributions of the proposed statistics are universal; and (3) we do not restrict the structure of the population covariance matrices. The theoretical results are established under mild and practical assumptions, and their properties are demonstrated numerically by simulations and a real data analysis.

preprint2020arXiv

Strong consistency of the AIC, BIC, CpC_p and KOO methods in high-dimensional multivariate linear regression

Variable selection is essential for improving inference and interpretation in multivariate linear regression. Although a number of alternative regressor selection criteria have been suggested, the most prominent and widely used are the Akaike information criterion (AIC), Bayesian information criterion (BIC), Mallow's CpC_p, and their modifications. However, for high-dimensional data, experience has shown that the performance of these classical criteria is not always satisfactory. In the present article, we begin by presenting the necessary and sufficient conditions (NSC) for the strong consistency of the high-dimensional AIC, BIC, and CpC_p, based on which we can identify some reasons for their poor performance. Specifically, we show that under certain mild high-dimensional conditions, if the BIC is strongly consistent, then the AIC is strongly consistent, but not vice versa. This result contradicts the classical understanding. In addition, we consider some NSC for the strong consistency of the high-dimensional kick-one-out (KOO) methods introduced by Zhao et al. (1986) and Nishii et al. (1988). Furthermore, we propose two general methods based on the KOO methods and prove their strong consistency. The proposed general methods remove the penalties while simultaneously reducing the conditions for the dimensions and sizes of the regressors. A simulation study supports our consistency conclusions and shows that the convergence rates of the two proposed general KOO methods are much faster than those of the original methods.

preprint2016arXiv

A review of 20 years of naive tests of significance for high-dimensional mean vectors and covariance matrices

In this paper, we will introduce the so called naive tests and give a brief review on the newly development. Naive testing methods are easy to understand and performs robust especially when the dimension is large. In this paper, we mainly focus on reviewing some naive testing methods for the mean vectors and covariance matrices of high dimensional populations and believe this naive test idea can be wildly used in many other testing problems.

preprint2016arXiv

Convergence rate of eigenvector empirical spectral distribution of large Wigner matrices

In this paper, we adopt the eigenvector empirical spectral distribution (VESD) to investigate the limiting behavior of eigenvectors of a large dimensional Wigner matrix W_n. In particular, we derive the optimal bound for the rate of convergence of the expected VESD of W_n to the semicircle law, which is of order O(n^{-1/2}) under the assumption of having finite 10th moment. We further show that the convergence rates in probability and almost surely of the VESD are O(n^{-1/4}) and O(n^{-1/6}), respectively, under finite 8th moment condition. Numerical studies demonstrate that the convergence rate does not depend on the choice of unit vector involved in the VESD function, and the best possible bound for the rate of convergence of the VESD is of order O(n^{-1/2}).

preprint2015arXiv

Convergence of the empirical spectral distribution function of Beta matrices

Let Bn=Sn(Sn+αnTN)−1\mathbf{B}_n=\mathbf {S}_n(\mathbf {S}_n+α_n\mathbf {T}_N)^{-1}, where Sn\mathbf {S}_n and TN\mathbf {T}_N are two independent sample covariance matrices with dimension pp and sample sizes nn and NN, respectively. This is the so-called Beta matrix. In this paper, we focus on the limiting spectral distribution function and the central limit theorem of linear spectral statistics of Bn\mathbf {B}_n. Especially, we do not require Sn\mathbf {S}_n or TN\mathbf {T}_N to be invertible. Namely, we can deal with the case where p>max⁡{n,N}p>\max\{n,N\} and p<n+Np<n+N. Therefore, our results cover many important applications which cannot be simply deduced from the corresponding results for multivariate FF matrices.

preprint2015arXiv

On testing the equality of high dimensional mean vectors with unequal covariance matrices

In this article, we focus on the problem of testing the equality of several high dimensional mean vectors with unequal covariance matrices. This is one of the most important problem in multivariate statistical analysis and there have been various tests proposed in the literature. Motivated by \citet{BaiS96E} and \cite{ChenQ10T}, a test statistic is introduced and the asymptomatic distributions under the null hypothesis as well as the alternative hypothesis are given. In addition, it is compared with a test statistic recently proposed by \cite{SrivastavaK13Ta}. It is shown that our test statistic performs much better especially in the large dimensional case.

preprint2015arXiv

On the semicircular law of large dimensional random quaternion matrices

It is well known that Gaussian symplectic ensemble (GSE) is defined on the space of n×nn\times n quaternion self-dual Hermitian matrices with Gaussian random elements. There is a huge body of literature regarding this kind of matrices. As a natural idea we want to get more universal results by removing the Gaussian condition. For the first step, in this paper we prove that the empirical spectral distribution of the common quaternion self-dual Hermitian matrices tends to semicircular law. The main tool to establish the universal result is given as a lemma in this paper as well.

preprint2014arXiv

CLT for large dimensional general Fisher matrices and its applications in high-dimensional data analysis

Random Fisher matrices arise naturally in multivariate statistical analysis and understanding the properties of its eigenvalues is of primary importance for many hypothesis testing problems like testing the equality between two multivariate population covariance matrices, or testing the independence between sub-groups of a multivariate random vector. This paper is concerned with the properties of a large-dimensional Fisher matrix when the dimension of the population is proportionally large compared to the sample size. Most of existing works on Fisher matrices deal with a particular Fisher matrix where populations have i.i.d components so that the population covariance matrices are all identity. In this paper, we consider general Fisher matrices with arbitrary population covariance matrices. The first main result of the paper establishes the limiting distribution of the eigenvalues of a Fisher matrix while in a second main result, we provide a central limit theorem for a wide class of functionals of its eigenvalues. Some applications of these results are also proposed for testing hypotheses on high-dimensional covariance matrices.

preprint2014arXiv

On the limit of extreme eigenvalues of large dimensional random quaternion matrices

Since E.P.Wigner (1958) established his famous semicircle law, lots of attention has been paid by physicists, probabilists and statisticians to study the asymptotic properties of the largest eigenvalues for random matrices. Bai and Yin (1988) obtained the necessary and sufficient conditions for the strong convergence of the extreme eigenvalues of a Wigner matrix. In this paper, we consider the case of quaternion self-dual Hermitian matrices. We prove the necessary and sufficient conditions for the strong convergence of extreme eigenvalues of quaternion self-dual Hermitian matrices corresponding to the Wigner case.

preprint2013arXiv

A Note on Central Limit Theorems for Linear Spectral Statistics of Large Dimensional F-matrix

Sample covariance matrix and multivariate FF-matrix play important roles in multivariate statistical analysis. The central limit theorems {\sl (CLT)} of linear spectral statistics associated with these matrices were established in Bai and Silverstein (2004) and Zheng (2012) which received considerable attentions and have been applied to solve many large dimensional statistical problems. However, the sample covariance matrices used in these papers are not centralized and there exist some questions about CLT's defined by the centralized sample covariance matrices. In this note, we shall provide some short complements on the CLT's in Bai and Silverstein (2004) and Zheng (2012), and show that the results in these two papers remain valid for the centralized sample covariance matrices, provided that the ratios of dimension pp to sample sizes (n,n1,n2)(n,n_1,n_2) are redefined as p/(n−1)p/(n-1) and p/(ni−1)p/(n_i-1), i=1,2i=1,2, respectively.

preprint2013arXiv

Convergence of Empirical Spectral Distributions of Large Dimensional Quaternion Sample Covariance Matrices

In this paper we establish the limit of the empirical spectral distribution of quaternion sample covariance matrices. Suppose Xn=(xjk(n))p×n\mathbf X_n = ({x_{jk}^{(n)}})_{p\times n} is a quaternion random matrix. For each nn, the entries {xij(n)}\{x_{ij}^{(n)}\} are independent random quaternion variables with a common mean μμ and variance σ2>0σ^2>0. It is shown that the empirical spectral distribution of the quaternion sample covariance matrix Sn=n−1XnXn∗\mathbf S_n=n^{-1}\mathbf X_n\mathbf X_n^* converges to the M-P law as p→∞p\to\infty, n→∞n\to\infty and p/n→y∈(0,+∞)p/n\to y\in(0,+\infty).

preprint2013arXiv

Convergence rates of eigenvector empirical spectral distribution of large dimensional sample covariance matrix

The eigenvector Empirical Spectral Distribution (VESD) is adopted to investigate the limiting behavior of eigenvectors and eigenvalues of covariance matrices. In this paper, we shall show that the Kolmogorov distance between the expected VESD of sample covariance matrix and the Marčenko-Pastur distribution function is of order O(N−1/2)O(N^{-1/2}). Given that data dimension nn to sample size NN ratio is bounded between 0 and 1, this convergence rate is established under finite 10th moment condition of the underlying distribution. It is also shown that, for any fixed η>0η>0, the convergence rates of VESD are O(N−1/4)O(N^{-1/4}) in probability and O(N−1/4+η)O(N^{-1/4+η}) almost surely, requiring finite 8th moment of the underlying distribution.

preprint2013arXiv

Convergence Rates of Spectral Distribution of Large Dimensional Quaternion Sample Covariance Matrix

In this paper, we study the convergence rates of empirical spectral distribution of large dimensional quaternion sample covariance matrix. Assume that the entries of Xn\mathbf X_n (p×np\times n) are independent quaternion random variables with mean zero, variance 1 and uniformly bounded sixth moments. Denote Sn=1nXnXn∗\mathbf S_n=\frac{1}{n}\mathbf X_n\mathbf X_n^*. Using Bai inequality, we prove that the expected empirical spectral distribution (ESD) converges to the limiting Marcˇ{\rm \check{c}}enko-Pastur distribution with the ratio of the dimension to sample size yp=p/ny_p=p/n at a rate of O(n−1/2an−3/4)O\left(n^{-1/2}a_n^{-3/4}\right) when an>n−2/5a_n>n^{-2/5} or O(n−1/5)O\left(n^{-1/5}\right) when an≤n−2/5a_n\le n^{-2/5}, where an=(1−yp)2a_n=(1-\sqrt{y_p})^2 is the lower bound for the M-P law. Moreover, the rates for both the convergence in probability and the almost sure convergence are also established. The weak convergence rate of the ESD is O(n−2/5an−2/5)O\left(n^{-2/5}a_n^{-2/5}\right) when an>n−2/5a_n>n^{-2/5} or O(n−1/5)O\left(n^{-1/5}\right) when an≤n−2/5a_n\le n^{-2/5}. The strong convergence rate of the ESD is O(n−2/5+ηan−2/5)O\left(n^{-2/5+η}a_n^{-2/5}\right) when an>n−2/5a_n>n^{-2/5} or O(n−1/5)O\left(n^{-1/5}\right) when an≤n−2/5a_n\le n^{-2/5} for any η>0η>0.

preprint2013arXiv

Convergence rates of the spectral distributions of large random quaternion self-dual Hermitian matrices

In this paper, convergence rates of the spectral distributions of quaternion self-dual Hermitian matrices are investigated. We show that under conditions of finite 6th moments, the expected spectral distribution of a large quaternion self-dual Hermitian matrix converges to the semicircular law in a rate of O(n−1/2)O(n^{-1/2}) and the spectral distribution itself converges to the semicircular law in rates Op(n−2/5)O_p(n^{-2/5}) and Oa.s.(n−2/5+η)O_{a.s.}(n^{-2/5+η}). Those results include GSE as a special case.

preprint2013arXiv

Estimation of the population spectral distribution from a large dimensional sample covariance matrix

This paper introduces a new method to estimate the spectral distribution of a population covariance matrix from high-dimensional data. The method is founded on a meaningful generalization of the seminal Marcenko-Pastur equation, originally defined in the complex plan, to the real line. Beyond its easy implementation and the established asymptotic consistency, the new estimator outperforms two existing estimators from the literature in almost all the situations tested in a simulation experiment. An application to the analysis of the correlation matrix of S&P stocks data is also given.

preprint2013arXiv

Extreme Eigenvalues of Large Dimensional Quaternion Sample Covariance Matrix

In this paper, we shall investigate the almost sure limits of the largest and smallest eigenvalues of a quaternion sample covariance matrix. Suppose that Xn\mathbf X_n is a p×np\times n matrix whose elements are independent quaternion variables with mean zero, variance 1 and uniformly bounded fourth moments. Denote Sn=1nXnXn∗\mathbf S_n=\frac{1}{n}\mathbf X_n\mathbf X_n^*. In this paper, we shall show that smax⁡(Sn)=sp(Sn)→(1+y)2,a.s.s_{\max}\left(\mathbf S_n\right)=s_{p}\left(\mathbf S_n\right)\to\left(1+\sqrt y\right)^2, a.s. and smin⁡(Sn)→(1−y)2,a.s.s_{\min}\left(\mathbf S_n\right)\to\left(1-\sqrt y\right)^2,a.s. as n→∞n\to\infty, where y=lim⁡p/ny=\lim p/n, s1(Sn)≤⋯≤sp(Sn)s_1\left(\mathbf S_n\right)\le\cdots\le s_{p}\left(\mathbf S_n\right) are the eigenvalues of Sn\mathbf{S}_n, smin⁡(Sn)=sp−n+1(Sn)s_{\min}\left(\mathbf S_n\right)=s_{p-n+1}\left(\mathbf S_n\right) when p>np>n and smin⁡(Sn)=s1(Sn)s_{\min}\left(\mathbf S_n\right)=s_1\left(\mathbf S_n\right) when p≤np\le n. We also prove that the set of conditions are necessary for smax⁡(Sn)→(1+y)2,a.s.s_{\max}\left(\mathbf S_n\right)\to\left(1+\sqrt y\right)^2, a.s. when the entries of Xn\mathbf {X}_n are i. i. d.

preprint2013arXiv

Strong representation of weak convergence

Skorokhod's representation theorem states that if on a Polish space, there is defined a weakly convergent sequence of probability measures μn→wμ0,μ_n\stackrel{w}\toμ_0, as n→∞n\to \infty, then there exist a probability space (Ω,F,P)(Ω, \mathscr F, P) and a sequence of random elements XnX_n such that Xn→XX_n\to X almost surely and XnX_n has the distribution function μnμ_n, n=0,1,2,⋯n=0,1,2,\cdots. In this paper, we shall extend the Skorokhod representation theorem to the case where if there are a sequence of separable metric spaces SnS_n, a sequence of probability measures μnμ_n and a sequence of measurable mappings φnφ_n such that μnφn−1→wμ0μ_nφ_n^{-1}\stackrel {w}\toμ_0, then there exist a probability space (Ω,F,P)(Ω,\mathscr F,P) and SnS_n-valued random elements XnX_n defined on ΩΩ, with distribution μnμ_n and such that φn(Xn)→X0φ_n(X_n)\to X_0 almost surely. In addition, we present several applications of our result including some results in random matrix theory, while the original Skorokhod representation theorem is not applicable.

preprint2011arXiv

Limit theorems for functions of marginal quantiles

Multivariate distributions are explored using the joint distributions of marginal sample quantiles. Limit theory for the mean of a function of order statistics is presented. The results include a multivariate central limit theorem and a strong law of large numbers. A result similar to Bahadur's representation of quantiles is established for the mean of a function of the marginal quantiles. In particular, it is shown that n(1n∑i=1nϕ(Xn:i(1),...,Xn:i(d))−γˉ)=1n∑i=1nZn,i+oP(1)\sqrt{n}\Biggl(\frac{1}{n}\sum_{i=1}^nϕ\bigl(X_{n:i}^{(1)},...,X_{n:i}^{(d)}\bigr)-\barγ\Biggr)=\frac{1}{\sqrt{n}}\sum_{i=1}^nZ_{n,i}+\mathrm{o}_P(1) as n→∞n\rightarrow\infty, where γˉ\barγ is a constant and Zn,iZ_{n,i} are i.i.d. random variables for each nn. This leads to the central limit theorem. Weak convergence to a Gaussian process using equicontinuity of functions is indicated. The results are established under very general conditions. These conditions are shown to be satisfied in many commonly occurring situations.

preprint2010arXiv

Eigen-Inference for Energy Estimation of Multiple Sources

In this paper, a new method is introduced to blindly estimate the transmit power of multiple signal sources in multi-antenna fading channels, when the number of sensing devices and the number of available samples are sufficiently large compared to the number of sources. Recent advances in the field of large dimensional random matrix theory are used that result in a simple and computationally efficient consistent estimator of the power of each source. A criterion to determine the minimum number of sensors and the minimum number of samples required to achieve source separation is then introduced. Simulations are performed that corroborate the theoretical claims and show that the proposed power estimator largely outperforms alternative power inference techniques.

preprint2010arXiv

Functional CLT for sample covariance matrices

Using Bernstein polynomial approximations, we prove the central limit theorem for linear spectral statistics of sample covariance matrices, indexed by a set of functions with continuous fourth order derivatives on an open interval including [(1−y)2,(1+y)2][(1-\sqrt{y})^2,(1+\sqrt{y})^2], the support of the Marucenko--Pastur law. We also derive the explicit expressions for asymptotic mean and covariance functions.

preprint2009arXiv

Corrections to LRT on Large Dimensional Covariance Matrix by RMT

In this paper, we give an explanation to the failure of two likelihood ratio procedures for testing about covariance matrices from Gaussian populations when the dimension is large compared to the sample size. Next, using recent central limit theorems for linear spectral statistics of sample covariance matrices and of random F-matrices, we propose necessary corrections for these LR tests to cope with high-dimensional effects. The asymptotic distributions of these corrected tests under the null are given. Simulations demonstrate that the corrected LR tests yield a realized size close to nominal level for both moderate p (around 20) and high dimension, while the traditional LR tests with chi-square approximation fails. Another contribution from the paper is that for testing the equality between two covariance matrices, the proposed correction applies equally for non-Gaussian populations yielding a valid pseudo-likelihood ratio test.

preprint2008arXiv

Limit theorems for sample eigenvalues in a generalized spiked population model

In the spiked population model introduced by Johnstone (2001),the population covariance matrix has all its eigenvalues equal to unit except for a few fixed eigenvalues (spikes). The question is to quantify the effect of the perturbation caused by the spike eigenvalues. Baik and Silverstein (2006) establishes the almost sure limits of the extreme sample eigenvalues associated to the spike eigenvalues when the population and the sample sizes become large. In a recent work (Bai and Yao, 2008), we have provided the limiting distributions for these extreme sample eigenvalues. In this paper, we extend this theory to a {\em generalized} spiked population model where the base population covariance matrix is arbitrary, instead of the identity matrix as in Johnstone's case. New mathematical tools are introduced for establishing the almost sure convergence of the sample eigenvalues generated by the spikes.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.