BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Zhidong Bai

Zhidong Bai appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.STStatistics Theorymath.PRInformation Theorymath.ITMethodology

Catalog footprint

What is connected

28works
6topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

28 published item(s)

preprint2022arXiv

A CLT for the LSS of large dimensional sample covariance matrices with unbounded dispersions

In this paper, we establish the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix when the population covariance matrices are not uniformly bounded, which is a nontrivial extension of the Bai-Silverstein theorem (BST) (2004). The latter has strongly stimulated the development of high-dimensional statistics, especially the application of random matrix theory to statistics. However, the assumption of uniform boundedness of the population covariance matrices is found strongly limited to the applications of BST. The aim of this paper is to remove the blockages to the applications of BST. The new CLT, allows the spiked eigenvalues to exist and tend to infinity. It is interesting to note that the roles of either spiked eigenvalues or the bulk eigenvalues or both of the two are dominating in the CLT. Moreover, the results are checked by simulation studies with various population settings. The CLT for LSS is then applied for testing the hypothesis that a covariance matrix $ \bSi $ is equal to an identity matrix. For this, the asymptotic distributions for the corrected likelihood ratio test (LRT) and Nagao's trace test (NT) under alternative are derived, and we also propose the asymptotic power of LRT and NT under certain alternatives.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Invariance principle and CLT for the spiked eigenvalues of large-dimensional Fisher matrices and applications

This paper aims to derive asymptotical distributions of the spiked eigenvalues of the large-dimensional spiked Fisher matrices without Gaussian assumption and the restrictive assumptions on covariance matrices. We first establish invariance principle for the spiked eigenvalues of the Fisher matrix. That is, we show that the limiting distributions of the spiked eigenvalues are invariant over a large class of population distributions satisfying certain conditions. Using the invariance principle, we further established a central limit theorem (CLT) for the spiked eigenvalues. As some interesting applications, we use the CLT to derive the power functions of Roy Maximum root test for linear hypothesis in linear models and the test in signal detection. We conduct some Monte Carlo simulation to compare the proposed test with existing ones.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

The limiting spectral distribution of large dimensional general information-plus-noise type matrices

Let $ X_{n} $ be $ n\times N $ random complex matrices, $R_{n}$ and $T_{n}$ be non-random complex matrices with dimensions $n\times N$ and $n\times n$, respectively. We assume that the entries of $ X_{n} $ are independent and identically distributed, $ T_{n} $ are nonnegative definite Hermitian matrices and $T_{n}R_{n}R_{n}^{*}= R_{n}R_{n}^{*}T_{n} $. The general information-plus-noise type matrices are defined by $C_{n}=\frac{1}{N}T_{n}^{\frac{1}{2}} \left( R_{n} +X_{n}\right) \left(R_{n}+X_{n}\right)^{*}T_{n}^{\frac{1}{2}} $. In this paper, we establish the limiting spectral distribution of the large dimensional general information-plus-noise type matrices $C_{n}$. Specifically, we show that as $n$ and $N$ tend to infinity proportionally, the empirical distribution of the eigenvalues of $C_{n}$ converges weakly to a non-random probability distribution, which is characterized in terms of a system of equations of its Stieltjes transform.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Modified Pillai's trace statistics for two high-dimensional sample covariance matrices

The goal of this study was to test the equality of two covariance matrices by using modified Pillai's trace statistics under a high-dimensional framework, i.e., the dimension and sample sizes go to infinity proportionally. In this paper, we introduce two modified Pillai's trace statistics and obtain their asymptotic distributions under the null hypothesis. The benefits of the proposed statistics include the following: (1) the sample size can be smaller than the dimensions; (2) the limiting distributions of the proposed statistics are universal; and (3) we do not restrict the structure of the population covariance matrices. The theoretical results are established under mild and practical assumptions, and their properties are demonstrated numerically by simulations and a real data analysis.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Strong consistency of the AIC, BIC, $C_p$ and KOO methods in high-dimensional multivariate linear regression

Variable selection is essential for improving inference and interpretation in multivariate linear regression. Although a number of alternative regressor selection criteria have been suggested, the most prominent and widely used are the Akaike information criterion (AIC), Bayesian information criterion (BIC), Mallow's $C_p$, and their modifications. However, for high-dimensional data, experience has shown that the performance of these classical criteria is not always satisfactory. In the present article, we begin by presenting the necessary and sufficient conditions (NSC) for the strong consistency of the high-dimensional AIC, BIC, and $C_p$, based on which we can identify some reasons for their poor performance. Specifically, we show that under certain mild high-dimensional conditions, if the BIC is strongly consistent, then the AIC is strongly consistent, but not vice versa. This result contradicts the classical understanding. In addition, we consider some NSC for the strong consistency of the high-dimensional kick-one-out (KOO) methods introduced by Zhao et al. (1986) and Nishii et al. (1988). Furthermore, we propose two general methods based on the KOO methods and prove their strong consistency. The proposed general methods remove the penalties while simultaneously reducing the conditions for the dimensions and sizes of the regressors. A simulation study supports our consistency conclusions and shows that the convergence rates of the two proposed general KOO methods are much faster than those of the original methods.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

A review of 20 years of naive tests of significance for high-dimensional mean vectors and covariance matrices

In this paper, we will introduce the so called naive tests and give a brief review on the newly development. Naive testing methods are easy to understand and performs robust especially when the dimension is large. In this paper, we mainly focus on reviewing some naive testing methods for the mean vectors and covariance matrices of high dimensional populations and believe this naive test idea can be wildly used in many other testing problems.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Convergence rate of eigenvector empirical spectral distribution of large Wigner matrices

In this paper, we adopt the eigenvector empirical spectral distribution (VESD) to investigate the limiting behavior of eigenvectors of a large dimensional Wigner matrix W_n. In particular, we derive the optimal bound for the rate of convergence of the expected VESD of W_n to the semicircle law, which is of order O(n^{-1/2}) under the assumption of having finite 10th moment. We further show that the convergence rates in probability and almost surely of the VESD are O(n^{-1/4}) and O(n^{-1/6}), respectively, under finite 8th moment condition. Numerical studies demonstrate that the convergence rate does not depend on the choice of unit vector involved in the VESD function, and the best possible bound for the rate of convergence of the VESD is of order O(n^{-1/2}).

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Convergence of the empirical spectral distribution function of Beta matrices

Let $\mathbf{B}_n=\mathbf {S}_n(\mathbf {S}_n+α_n\mathbf {T}_N)^{-1}$, where $\mathbf {S}_n$ and $\mathbf {T}_N$ are two independent sample covariance matrices with dimension $p$ and sample sizes $n$ and $N$, respectively. This is the so-called Beta matrix. In this paper, we focus on the limiting spectral distribution function and the central limit theorem of linear spectral statistics of $\mathbf {B}_n$. Especially, we do not require $\mathbf {S}_n$ or $\mathbf {T}_N$ to be invertible. Namely, we can deal with the case where $p>\max\{n,N\}$ and $p<n+N$. Therefore, our results cover many important applications which cannot be simply deduced from the corresponding results for multivariate $F$ matrices.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

On testing the equality of high dimensional mean vectors with unequal covariance matrices

In this article, we focus on the problem of testing the equality of several high dimensional mean vectors with unequal covariance matrices. This is one of the most important problem in multivariate statistical analysis and there have been various tests proposed in the literature. Motivated by \citet{BaiS96E} and \cite{ChenQ10T}, a test statistic is introduced and the asymptomatic distributions under the null hypothesis as well as the alternative hypothesis are given. In addition, it is compared with a test statistic recently proposed by \cite{SrivastavaK13Ta}. It is shown that our test statistic performs much better especially in the large dimensional case.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

On the semicircular law of large dimensional random quaternion matrices

It is well known that Gaussian symplectic ensemble (GSE) is defined on the space of $n\times n$ quaternion self-dual Hermitian matrices with Gaussian random elements. There is a huge body of literature regarding this kind of matrices. As a natural idea we want to get more universal results by removing the Gaussian condition. For the first step, in this paper we prove that the empirical spectral distribution of the common quaternion self-dual Hermitian matrices tends to semicircular law. The main tool to establish the universal result is given as a lemma in this paper as well.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

CLT for large dimensional general Fisher matrices and its applications in high-dimensional data analysis

Random Fisher matrices arise naturally in multivariate statistical analysis and understanding the properties of its eigenvalues is of primary importance for many hypothesis testing problems like testing the equality between two multivariate population covariance matrices, or testing the independence between sub-groups of a multivariate random vector. This paper is concerned with the properties of a large-dimensional Fisher matrix when the dimension of the population is proportionally large compared to the sample size. Most of existing works on Fisher matrices deal with a particular Fisher matrix where populations have i.i.d components so that the population covariance matrices are all identity. In this paper, we consider general Fisher matrices with arbitrary population covariance matrices. The first main result of the paper establishes the limiting distribution of the eigenvalues of a Fisher matrix while in a second main result, we provide a central limit theorem for a wide class of functionals of its eigenvalues. Some applications of these results are also proposed for testing hypotheses on high-dimensional covariance matrices.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

On the limit of extreme eigenvalues of large dimensional random quaternion matrices

Since E.P.Wigner (1958) established his famous semicircle law, lots of attention has been paid by physicists, probabilists and statisticians to study the asymptotic properties of the largest eigenvalues for random matrices. Bai and Yin (1988) obtained the necessary and sufficient conditions for the strong convergence of the extreme eigenvalues of a Wigner matrix. In this paper, we consider the case of quaternion self-dual Hermitian matrices. We prove the necessary and sufficient conditions for the strong convergence of extreme eigenvalues of quaternion self-dual Hermitian matrices corresponding to the Wigner case.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

A Note on Central Limit Theorems for Linear Spectral Statistics of Large Dimensional F-matrix

Sample covariance matrix and multivariate $F$-matrix play important roles in multivariate statistical analysis. The central limit theorems {\sl (CLT)} of linear spectral statistics associated with these matrices were established in Bai and Silverstein (2004) and Zheng (2012) which received considerable attentions and have been applied to solve many large dimensional statistical problems. However, the sample covariance matrices used in these papers are not centralized and there exist some questions about CLT's defined by the centralized sample covariance matrices. In this note, we shall provide some short complements on the CLT's in Bai and Silverstein (2004) and Zheng (2012), and show that the results in these two papers remain valid for the centralized sample covariance matrices, provided that the ratios of dimension $p$ to sample sizes $(n,n_1,n_2)$ are redefined as $p/(n-1)$ and $p/(n_i-1)$, $i=1,2$, respectively.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Convergence of Empirical Spectral Distributions of Large Dimensional Quaternion Sample Covariance Matrices

In this paper we establish the limit of the empirical spectral distribution of quaternion sample covariance matrices. Suppose $\mathbf X_n = ({x_{jk}^{(n)}})_{p\times n}$ is a quaternion random matrix. For each $n$, the entries $\{x_{ij}^{(n)}\}$ are independent random quaternion variables with a common mean $μ$ and variance $σ^2>0$. It is shown that the empirical spectral distribution of the quaternion sample covariance matrix $\mathbf S_n=n^{-1}\mathbf X_n\mathbf X_n^*$ converges to the M-P law as $p\to\infty$, $n\to\infty$ and $p/n\to y\in(0,+\infty)$.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Convergence rates of eigenvector empirical spectral distribution of large dimensional sample covariance matrix

The eigenvector Empirical Spectral Distribution (VESD) is adopted to investigate the limiting behavior of eigenvectors and eigenvalues of covariance matrices. In this paper, we shall show that the Kolmogorov distance between the expected VESD of sample covariance matrix and the Marčenko-Pastur distribution function is of order $O(N^{-1/2})$. Given that data dimension $n$ to sample size $N$ ratio is bounded between 0 and 1, this convergence rate is established under finite 10th moment condition of the underlying distribution. It is also shown that, for any fixed $η>0$, the convergence rates of VESD are $O(N^{-1/4})$ in probability and $O(N^{-1/4+η})$ almost surely, requiring finite 8th moment of the underlying distribution.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Convergence Rates of Spectral Distribution of Large Dimensional Quaternion Sample Covariance Matrix

In this paper, we study the convergence rates of empirical spectral distribution of large dimensional quaternion sample covariance matrix. Assume that the entries of $\mathbf X_n$ ($p\times n$) are independent quaternion random variables with mean zero, variance 1 and uniformly bounded sixth moments. Denote $\mathbf S_n=\frac{1}{n}\mathbf X_n\mathbf X_n^*$. Using Bai inequality, we prove that the expected empirical spectral distribution (ESD) converges to the limiting Mar${\rm \check{c}}$enko-Pastur distribution with the ratio of the dimension to sample size $y_p=p/n$ at a rate of $O\left(n^{-1/2}a_n^{-3/4}\right)$ when $a_n>n^{-2/5}$ or $O\left(n^{-1/5}\right)$ when $a_n\le n^{-2/5}$, where $a_n=(1-\sqrt{y_p})^2$ is the lower bound for the M-P law. Moreover, the rates for both the convergence in probability and the almost sure convergence are also established. The weak convergence rate of the ESD is $O\left(n^{-2/5}a_n^{-2/5}\right)$ when $a_n>n^{-2/5}$ or $O\left(n^{-1/5}\right)$ when $a_n\le n^{-2/5}$. The strong convergence rate of the ESD is $O\left(n^{-2/5+η}a_n^{-2/5}\right)$ when $a_n>n^{-2/5}$ or $O\left(n^{-1/5}\right)$ when $a_n\le n^{-2/5}$ for any $η>0$.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Convergence rates of the spectral distributions of large random quaternion self-dual Hermitian matrices

In this paper, convergence rates of the spectral distributions of quaternion self-dual Hermitian matrices are investigated. We show that under conditions of finite 6th moments, the expected spectral distribution of a large quaternion self-dual Hermitian matrix converges to the semicircular law in a rate of $O(n^{-1/2})$ and the spectral distribution itself converges to the semicircular law in rates $O_p(n^{-2/5})$ and $O_{a.s.}(n^{-2/5+η})$. Those results include GSE as a special case.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Estimation of the population spectral distribution from a large dimensional sample covariance matrix

This paper introduces a new method to estimate the spectral distribution of a population covariance matrix from high-dimensional data. The method is founded on a meaningful generalization of the seminal Marcenko-Pastur equation, originally defined in the complex plan, to the real line. Beyond its easy implementation and the established asymptotic consistency, the new estimator outperforms two existing estimators from the literature in almost all the situations tested in a simulation experiment. An application to the analysis of the correlation matrix of S&P stocks data is also given.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Extreme Eigenvalues of Large Dimensional Quaternion Sample Covariance Matrix

In this paper, we shall investigate the almost sure limits of the largest and smallest eigenvalues of a quaternion sample covariance matrix. Suppose that $\mathbf X_n$ is a $p\times n$ matrix whose elements are independent quaternion variables with mean zero, variance 1 and uniformly bounded fourth moments. Denote $\mathbf S_n=\frac{1}{n}\mathbf X_n\mathbf X_n^*$. In this paper, we shall show that $s_{\max}\left(\mathbf S_n\right)=s_{p}\left(\mathbf S_n\right)\to\left(1+\sqrt y\right)^2, a.s.$ and $s_{\min}\left(\mathbf S_n\right)\to\left(1-\sqrt y\right)^2,a.s.$ as $n\to\infty$, where $y=\lim p/n$, $s_1\left(\mathbf S_n\right)\le\cdots\le s_{p}\left(\mathbf S_n\right)$ are the eigenvalues of $\mathbf{S}_n$, $s_{\min}\left(\mathbf S_n\right)=s_{p-n+1}\left(\mathbf S_n\right)$ when $p>n$ and $s_{\min}\left(\mathbf S_n\right)=s_1\left(\mathbf S_n\right)$ when $p\le n$. We also prove that the set of conditions are necessary for $s_{\max}\left(\mathbf S_n\right)\to\left(1+\sqrt y\right)^2, a.s.$ when the entries of $\mathbf {X}_n$ are i. i. d.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Strong representation of weak convergence

Skorokhod's representation theorem states that if on a Polish space, there is defined a weakly convergent sequence of probability measures $μ_n\stackrel{w}\toμ_0,$ as $n\to \infty$, then there exist a probability space $(Ω, \mathscr F, P)$ and a sequence of random elements $X_n$ such that $X_n\to X$ almost surely and $X_n$ has the distribution function $μ_n$, $n=0,1,2,\cdots$. In this paper, we shall extend the Skorokhod representation theorem to the case where if there are a sequence of separable metric spaces $S_n$, a sequence of probability measures $μ_n$ and a sequence of measurable mappings $φ_n$ such that $μ_nφ_n^{-1}\stackrel {w}\toμ_0$, then there exist a probability space $(Ω,\mathscr F,P)$ and $S_n$-valued random elements $X_n$ defined on $Ω$, with distribution $μ_n$ and such that $φ_n(X_n)\to X_0$ almost surely. In addition, we present several applications of our result including some results in random matrix theory, while the original Skorokhod representation theorem is not applicable.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Limit theorems for functions of marginal quantiles

Multivariate distributions are explored using the joint distributions of marginal sample quantiles. Limit theory for the mean of a function of order statistics is presented. The results include a multivariate central limit theorem and a strong law of large numbers. A result similar to Bahadur's representation of quantiles is established for the mean of a function of the marginal quantiles. In particular, it is shown that \[\sqrt{n}\Biggl(\frac{1}{n}\sum_{i=1}^nϕ\bigl(X_{n:i}^{(1)},...,X_{n:i}^{(d)}\bigr)-\barγ\Biggr)=\frac{1}{\sqrt{n}}\sum_{i=1}^nZ_{n,i}+\mathrm{o}_P(1)\] as $n\rightarrow\infty$, where $\barγ$ is a constant and $Z_{n,i}$ are i.i.d. random variables for each $n$. This leads to the central limit theorem. Weak convergence to a Gaussian process using equicontinuity of functions is indicated. The results are established under very general conditions. These conditions are shown to be satisfied in many commonly occurring situations.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Eigen-Inference for Energy Estimation of Multiple Sources

In this paper, a new method is introduced to blindly estimate the transmit power of multiple signal sources in multi-antenna fading channels, when the number of sensing devices and the number of available samples are sufficiently large compared to the number of sources. Recent advances in the field of large dimensional random matrix theory are used that result in a simple and computationally efficient consistent estimator of the power of each source. A criterion to determine the minimum number of sensors and the minimum number of samples required to achieve source separation is then introduced. Simulations are performed that corroborate the theoretical claims and show that the proposed power estimator largely outperforms alternative power inference techniques.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Functional CLT for sample covariance matrices

Using Bernstein polynomial approximations, we prove the central limit theorem for linear spectral statistics of sample covariance matrices, indexed by a set of functions with continuous fourth order derivatives on an open interval including $[(1-\sqrt{y})^2,(1+\sqrt{y})^2]$, the support of the Marucenko--Pastur law. We also derive the explicit expressions for asymptotic mean and covariance functions.

0 citations0 reviewsNo code linkedOpen access
preprint2009arXiv

Corrections to LRT on Large Dimensional Covariance Matrix by RMT

In this paper, we give an explanation to the failure of two likelihood ratio procedures for testing about covariance matrices from Gaussian populations when the dimension is large compared to the sample size. Next, using recent central limit theorems for linear spectral statistics of sample covariance matrices and of random F-matrices, we propose necessary corrections for these LR tests to cope with high-dimensional effects. The asymptotic distributions of these corrected tests under the null are given. Simulations demonstrate that the corrected LR tests yield a realized size close to nominal level for both moderate p (around 20) and high dimension, while the traditional LR tests with chi-square approximation fails. Another contribution from the paper is that for testing the equality between two covariance matrices, the proposed correction applies equally for non-Gaussian populations yielding a valid pseudo-likelihood ratio test.

0 citations0 reviewsNo code linkedOpen access
preprint2008arXiv

Limit theorems for sample eigenvalues in a generalized spiked population model

In the spiked population model introduced by Johnstone (2001),the population covariance matrix has all its eigenvalues equal to unit except for a few fixed eigenvalues (spikes). The question is to quantify the effect of the perturbation caused by the spike eigenvalues. Baik and Silverstein (2006) establishes the almost sure limits of the extreme sample eigenvalues associated to the spike eigenvalues when the population and the sample sizes become large. In a recent work (Bai and Yao, 2008), we have provided the limiting distributions for these extreme sample eigenvalues. In this paper, we extend this theory to a {\em generalized} spiked population model where the base population covariance matrix is arbitrary, instead of the identity matrix as in Johnstone's case. New mathematical tools are introduced for establishing the almost sure convergence of the sample eigenvalues generated by the spikes.

0 citations0 reviewsNo code linkedOpen access