BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

David E. Tyler

David E. Tyler appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
Methodologymath.STStatistics TheoryComputationApplications

Catalog footprint

What is connected

12works
5topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

12 published item(s)

preprint2022arXiv

Linear pooling of sample covariance matrices

We consider the problem of estimating high-dimensional covariance matrices of $K$-populations or classes in the setting where the sample sizes are comparable to the data dimension. We propose estimating each class covariance matrix as a distinct linear combination of all class sample covariance matrices. This approach is shown to reduce the estimation error when the sample sizes are limited, and the true class covariance matrices share a somewhat similar structure. We develop an effective method for estimating the coefficients in the linear combination that minimize the mean squared error under the general assumption that the samples are drawn from (unspecified) elliptically symmetric distributions possessing finite fourth-order moments. To this end, we utilize the spatial sign covariance matrix, which we show (under rather general conditions) to be an asymptotically unbiased estimator of the normalized covariance matrix as the dimension grows to infinity. We also show how the proposed method can be used in choosing the regularization parameters for multiple target matrices in a single class covariance matrix estimation problem. We assess the proposed method via numerical simulation studies including an application in global minimum variance portfolio optimization using real stock data.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Breakdown points of penalized and hybrid M-estimators of covariance

We introduce a class of hybrid M-estimators of multivariate scatter which, analogous to the popular spatial sign covariance matrix (SSCM), possess high breakdown points. We also show that the SSCM can be viewed as an extreme member of this class. Unlike the SSCM, but like the regular M-estimators of scatter, this new class of estimators takes into account the shape of the contours of the data cloud for downweighting observations.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Geodesic Convexity and Regularized Scatter Estimators

As observed by Auderset et al. (2005) and Wiesel (2012), viewing covariance matrices as elements of a Riemannian manifold and using the concept of geodesic convexity provide useful tools for studying M-estimators of multivariate scatter. In this paper, we begin with a mathematically rigorous self-contained overview of Riemannian geometry on the space of symmetric positive definite matrices and of the notion of geodesic convexity. The overview contains both a review as well as new results. In particular, we introduce and utilize first and second order Taylor expansions with respect to geodesic parametrizations. This enables us to give sufficient conditions for a function to be geodesically convex. In addition, we introduce the concept of geodesic coercivity, which is important in establishing the existence of a minimum to a geodesic convex function. We also develop a general partial Newton algorithm for minimizing smooth and strictly geodesically convex functions. We then use these results to generate a fairly complete picture of the existence, uniqueness and computation of regularized M-estimators of scatter defined using additive geodescially convex penalty terms. Various such penalties are demonstrated which shrink an estimator towards the identity matrix or multiples of the identity matrix. Finally, we propose a cross-validation method for choosing the scaling parameter for the penalty function, and illustrate our results using a numerical example.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

On the eigenvalues of the spatial sign covariance matrix in more than two dimensions

We gather several results on the eigenvalues of the spatial sign covariance matrix of an elliptical distribution. It is shown that the eigenvalues are a one-to-one function of the eigenvalues of the shape matrix and that they are closer together than the latter. We further provide a one-dimensional integral representation of the eigenvalues, which facilitates their numerical computation.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Simultaneous penalized M-estimation of covariance matrices using geodesically convex optimization

A common assumption when sampling $p$-dimensional observations from $K$ distinct group is the equality of the covariance matrices. In this paper, we propose two penalized $M$-estimation approaches for the estimation of the covariance or scatter matrices under the broader assumption that they may simply be close to each other, and hence roughly deviate from some positive definite "center". The first approach begins by generating a pooled $M$-estimator of scatter based on all the data, followed by a penalised $M$-estimator of scatter for each group, with the penalty term chosen so that the individual scatter matrices are shrunk towards the pooled scatter matrix. In the second approach, we minimize the sum of the individual group $M$-estimation cost functions together with an additive joint penalty term which enforces some similarity between the individual scatter estimators, i.e. shrinkage towards a mutual center. In both approaches, we utilize the concept of geodesic convexity to prove the existence and uniqueness of the penalized solution under general conditions. We consider three specific penalty functions based on the Euclidean, the Riemannian, and the Kullback-Leibler distances. In the second approach, the distance based penalties are shown to lead to estimators of the mutual center that are related to the arithmetic, the Riemannian and the harmonic means of positive definite matrices, respectively. A penalty based on an ellipticity measure is also considered which is particularly useful for shape matrix estimators. Fixed point equations are derived for each penalty function and the benefits of the estimators are illustrated in regularized discriminant analysis problem.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

A cautionary note on robust covariance plug-in methods

Many multivariate statistical methods rely heavily on the sample covariance matrix. It is well known though that the sample covariance matrix is highly non-robust. One popular alternative approach for "robustifying" the multivariate method is to simply replace the role of the covariance matrix with some robust scatter matrix. The aim of this paper is to point out that in some situations certain properties of the covariance matrix are needed for the corresponding robust "plug-in" method to be a valid approach, and that not all scatter matrices necessarily possess these important properties. In particular, the following three multivariate methods are discussed in this paper: independent components analysis, observational regression and graphical modeling. For each case, it is shown that using a symmetrized robust scatter matrix in place of the covariance matrix results in a proper robust multivariate method.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Breakdown Properties of the M-Estimators of Multivariate Scatter

The M-estimators of multivariate scatter are known to have breakdown points no greater than 1/(p+1), where p is the dimension of the data. In high dimension, the breakdown points are usually considered to be disappointingly low. This paper studies the breakdown problem in more detail. The exact breakdown points for the M-estimators of scatter are obtained and it is shown that their low values are primarily due to contamination restricted to some plane. If such "coplanar" contamination is not present, then there exists M-estimators which have breakdown points close to 1/2. The effect of coplanar contamination is further examined and is shown to be related to the singularity of the scatter matrix. Finally, the implications of the results of this paper on whether the low breakdown point is necessarily a bad feature and on multivariate outlier detection are briefly discussed. This paper is a reprint of an unpublished 1986 Rutgers Technical Report.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Regularized $M$-estimators of scatter matrix

In this paper, a general class of regularized $M$-estimators of scatter matrix are proposed which are suitable also for low or insufficient sample support (small $n$ and large $p$) problems. The considered class constitutes a natural generalization of $M$-estimators of scatter matrix (Maronna, 1976) and are defined as a solution to a penalized $M$-estimation cost function that depend on a pair $(α,β)$ of regularization parameters. We derive general conditions for uniqueness of the solution using concept of geodesic convexity. Since these conditions do not include Tyler's $M$-estimator, necessary and sufficient conditions for uniqueness of the penalized Tyler's cost function are established separately. For the regularized Tyler's $M$-estimator, we also derive a simple, closed form and data dependent solution for choosing the regularization parameter based on shape matrix matching in the mean squared sense. An iterative algorithm that converges to the solution of the regularized $M$-estimating equation is also provided. Finally, some simulations studies illustrate the improved accuracy of the proposed regularized $M$-estimators of scatter compared to their non-regularized counterparts in low sample support problems. An example of radar detection using normalized matched filter (NMF) illustrate that an adaptive NMF detector based on regularized $M$-estimators are able to maintain accurately the preset CFAR level and at at the same time provide similar probability of detection as the (theoretical) NMF detector.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Robust estimators for non-decomposable elliptical graphical models

Asymptotic properties of scatter estimators for elliptical graphical models are studied. Such models impose a given pattern of zeros on the inverse of the shape matrix of an elliptically distributed random vector. In particular, we introduce the class of graphical M-estimators and compare them to plug-in M-estimators. It turns out that, under suitable conditions, both approaches yield the same asymptotic efficiency. Furthermore, the results of this paper apply to both decomposable and non-decomposable graphical models and so generalize the results for decomposable models given by Vogel & Fried (2011) for the plug-in M-estimators.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

The asymptotic inadmissibility of the spatial sign covariance matrix for elliptically symmetric distributions

The asymptotic efficiency of the spatial sign covariance matrix (SSCM) relative to affine equivariant estimates of scatter is studied in detail. In particular, the SSCM is shown to be asymptoticaly inadmissible, i.e. the asymptotic variance-covariance matrix of the consistency corrected SSCM is uniformly smaller than that of its affine equivariant counterpart, namely Tyler's scatter matrix. Although the SSCM has often been recommended when one is interested in principal components analysis, the degree of the inefficiency of the SSCM is shown to be most severe in situations where principal components are of most interest. A finite sample simulation shows the inefficiency of the SSCM also holds for small sample sizes, and that the asymptotic relative efficiency is a good approximation to the finite sample efficiency for relatively modest sample sizes.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Robust functional principal components: A projection-pursuit approach

In many situations, data are recorded over a period of time and may be regarded as realizations of a stochastic process. In this paper, robust estimators for the principal components are considered by adapting the projection pursuit approach to the functional data setting. Our approach combines robust projection-pursuit with different smoothing methods. Consistency of the estimators are shown under mild assumptions. The performance of the classical and robust procedures are compared in a simulation study under different contamination schemes.

0 citations0 reviewsNo code linkedOpen access