Researcher profile

William E. Strawderman

William E. Strawderman contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
17works
0followers
3topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

17 published item(s)

preprint2021arXiv

On admissible estimation of a mean vector when the scale is unknown

We consider admissibility of generalized Bayes estimators of the mean of a multivariate normal distribution when the scale is unknown under quadratic loss. The priors considered put the improper invariant prior on the scale while the prior on the mean has a hierarchical normal structure conditional on the scale. This conditional hierarchical prior is essentially that of Maruyama and Strawderman (2021, Biometrika) (MS21) which is indexed by a hyperparameter $a$. In that paper $a$ is chosen so this conditional prior is proper which corresponds to $a>-1$. This paper extends MS21 by considering improper conditional priors with $a$ in the closed interval $[-2, -1]$, and establishing admissibility for such $a$. The authors, in Maruyama and Strawderman (2017, JMVA), have earlier shown that such conditional priors with $a < -2$ lead to inadmissible estimators. This paper therefore completes the determination of admissibility/inadmissibility for this class of priors. It establishes the the boundary as $a = -2$, with admissibility holding for $a\geq -2$ and inadmissibility for $a < -2$. This boundary corresponds exactly to that in the known scale case for these conditional priors, and which follows from Brown (1971, AOMS). As a notable benefit of this enlargement of the class of admissible generalized Bayes estimators, we give admissible and minimax estimators in all dimensions greater than $2$ as opposed to MS21 which required the dimension to be greater than $4$. In one particularly interesting special case, we establish that the joint Stein prior for the unknown scale case leads to a minimax admissible estimator in all dimensions greater than $2$.

preprint2016arXiv

A sharp boundary for SURE-based admissibility for the Normal means problem under unknown scale

We consider quasi-admissibility/inadmissibility of Stein-type shrinkage estimators of the mean of a multivariate normal distribution with covariance matrix an unknown multiple of the identity. Quasi-admissibility/inadmissibility is defined in terms of non-existence/existence of a solution to a differential inequality based on Stein&#39;s unbiased risk estimate (SURE). We find a sharp boundary between quasi-admissible and quasi-inadmissible estimators related to the optimal James-Stein estimator. We also find a class of priors related to the Strawderman class in the known variance case where the boundary between quasi-admissibility and quasi-inadmissibility corresponds to the boundary between admissibility and inadmissibility in the known variance case. Additionally, we also briefly consider generalization to the case of general spherically symmetric distributions with a residual vector.

preprint2014arXiv

On Predictive Density Estimation for Location Families under Integrated $L_2$ and $L_1$ Losses

Our investigation concerns the estimation of predictive densities and a study of efficiency as measured by the frequentist risk of such predictive densities with integrated $L_2$ and $L_1$ losses. Our findings relate to a $p-$variate spherically symmetric observable $X \sim p_X(\|x-μ\|^2)$ and the objective of estimating the density of $Y \sim q_Y(\|y-μ\|^2)$ based on $X$. For $L_2$ loss, we describe Bayes estimation, minimum risk equivariant estimation (MRE), and minimax estimation. We focus on the risk performance of the benchmark minimum risk equivariant estimator, plug-in estimators, and plug-in type estimators with expanded scale. For the multivariate normal case, we make use of a duality result with a point estimation problem bringing into play reflected normal loss. In three of more dimensions (i.e., $p \geq 3$), we show that the MRE estimator is inadmissible under $L_2$ loss and provide dominating estimators. This brings into play Stein-type results for estimating a multivariate normal mean with a loss which is a concave and increasing function of $\|\hatμ-μ\|^2$. We also study the phenomenon of improvement on the plug-in density estimator of the form $q_Y(\|y-aX\|^2)\,, 0<a \leq 1\,,$ by a subclass of scale expansions $\frac{1}{c^p} \, q_Y(\|(y -aX)/c \|^2)$ with $c>1$, showing in some cases, inevitably for large enough $p$, that all choices $c>1$ are dominating estimators. Extensions are obtained for scale mixture of normals including a general inadmissibility result of the MRE estimator for $p \geq 3$. Finally, we describe and expand on analogous plug-in dominance results for spherically symmetric distributions with $p \geq 4$ under $L_1$ loss.

preprint2013arXiv

Dominance properties of constrained Bayes and empirical Bayes estimators

This paper studies decision theoretic properties of benchmarked estimators which are of some importance in small area estimation problems. Benchmarking is intended to improve certain aggregate properties (such as study-wide averages) when model based estimates have been applied to individual small areas. We study decision-theoretic properties of such estimators by reducing the problem to one of studying these problems in a related derived problem. For certain such problems, we show that unconstrained solutions in the original (unbenchmarked) problem give unconstrained Bayes and improved estimators which automatically satisfy the benchmark constraint. Also, dominance properties of constrained empirical Bayes estimators are shown in the Fay-Herriot model, a frequently used model in small area estimation.

preprint2013arXiv

Improved robust Bayes estimators of the error variance in linear models

We consider the problem of estimating the error variance in a general linear model when the error distribution is assumed to be spherically symmetric, but not necessary Gaussian. In particular we study the case of a scale mixture of Gaussians including the particularly important case of the multivariate-t distribution. Under Stein&#39;s loss, we construct a class of estimators that improve on the usual best unbiased (and best equivariant) estimator. Our class has the interesting double robustness property of being simultaneously generalized Bayes (for the same generalized prior) and minimax over the entire class of scale mixture of Gaussian distributions.

preprint2013arXiv

Robust Bayesian variable selection with sub-harmonic priors

This paper studies Bayesian variable selection in linear models with general spherically symmetric error distributions. We propose sub-harmonic priors which arise as a class of mixtures of Zellner&#39;s g-priors for which the Bayes factors are independent of the underlying error distribution, as long as it is in the spherically symmetric class. Because of this invariance to spherically symmetric error distribution, we refer to our method as a robust Bayesian variable selection method. We demonstrate that our Bayes factors have model selection consistency and are coherent. We also develop Laplace approximations to Bayes factors for a number of recently studied mixtures of g-priors that have recently appeared in the literature (including our own) for Gaussian errors. These approximations, in each case, are given by the Gaussian Bayes factor based on BIC times a simple rational function of the prior&#39;s hyper-parameters and the R^2&#39;s for the respective models. We also extend model selection consistency for several g-prior based Bayes factor methods for Gaussian errors to the entire class of spherically symmetric error distributions. Additionally we demonstrate that our class of sub-harmonic priors are the only ones within a large class of mixtures of g-priors studied in the literature which are robust in our sense. A simulation study and an analysis of two real data sets indicates good performance of our robust Bayes factors relative to BIC and to other mixture of g-prior based methods.

preprint2012arXiv

A new Monte Carlo sampling in Bayesian probit regression

We study probit regression from a Bayesian perspective and give an alternative form for the posterior distribution when the prior distribution for the regression parameters is the uniform distribution. This new form allows simple Monte Carlo simulation of the posterior as opposed to MCMC simulation studied in much of the literature and may therefore be more efficient computationally. We also provide alternative explicit expression for the first and second moments. Additionally we provide analogous results for Gaussian priors.

preprint2012arXiv

A Tribute to Charles Stein

In 1956, Charles Stein published an article that was to forever change the statistical approach to high-dimensional estimation. His stunning discovery that the usual estimator of the normal mean vector could be dominated in dimensions 3 and higher amazed many at the time, and became the catalyst for a vast and rich literature of substantial importance to statistical theory and practice. As a tribute to Charles Stein, this special issue on minimax shrinkage estimation is devoted to developments that ultimately arose from Stein&#39;s investigations into improving on the UMVUE of a multivariate normal mean vector. Of course, much of the early literature on the subject was due to Stein himself, including a key technical lemma commonly referred to as Stein&#39;s Lemma, which leads to an unbiased estimator of the risk of an almost arbitrary estimator of the mean vector.

preprint2012arXiv

A unified minimax result for restricted parameter spaces

We provide a development that unifies, simplifies and extends considerably a number of minimax results in the restricted parameter space literature. Various applications follow, such as that of estimating location or scale parameters under a lower (or upper) bound restriction, location parameter vectors restricted to a polyhedral cone, scale parameters subject to restricted ratios or products, linear combinations of restricted location parameters, location parameters bounded to an interval with unknown scale, quantiles for location-scale families with parametric restrictions and restricted covariance matrices.

preprint2012arXiv

On Bayesian credible sets in restricted parameter space problems and lower bounds for frequentist coverage

For estimating a lower bounded parametric function in the framework of Marchand and Strawderman (2006), we provide through a unified approach a class of Bayesian confidence intervals with credibility $1-α$ and frequentist coverage probability bounded below by $\frac{1-α}{1+α}$. In cases where the underlying pivotal distribution is symmetric, the findings represent extensions with respect to the specification of the credible set achieved through the choice of a {\it spending function}, and include Marchand and Strawderman&#39;s HPD procedure result. For non-symmetric cases, the determination of a such a class of Bayesian credible sets fills a gap in the literature and includes an &#34;equal-tails&#34; modification of the HPD procedure. Several examples are presented demonstrating wide applicability.

preprint2012arXiv

Stein Estimation for Spherically Symmetric Distributions: Recent Developments

This paper reviews advances in Stein-type shrinkage estimation for spherically symmetric distributions. Some emphasis is placed on developing intuition as to why shrinkage should work in location problems whether the underlying population is normal or not. Considerable attention is devoted to generalizing the &#34;Stein lemma&#34; which underlies much of the theoretical development of improved minimax estimation for spherically symmetric distributions. A main focus is on distributional robustness results in cases where a residual vector is available to estimate an unknown scale parameter, and, in particular, in finding estimators which are simultaneously generalized Bayes and minimax over large classes of spherically symmetric distributions. Some attention is also given to the problem of estimating a location vector restricted to lie in a polyhedral cone.

preprint2011arXiv

Shrinkage estimation with a matrix loss function

Consider estimating the n by p matrix of means of an n by p matrix of independent normally distributed observations with constant variance, where the performance of an estimator is judged using a p by p matrix quadratic error loss function. A matrix version of the James-Stein estimator is proposed, depending on a tuning constant. It is shown to dominate the usual maximum likelihood estimator for some choices of of the tuning constant when n is greater than or equal to 3. This result also extends to other shrinkage estimators and settings.

preprint2010arXiv

Bayesian predictive densities for linear regression models under alpha-divergence loss: some results and open problems

This paper considers estimation of the predictive density for a normal linear model with unknown variance under alpha-divergence loss for -1 <= alpha <= 1. We first give a general canonical form for the problem, and then give general expressions for the generalized Bayes solution under the above loss for each alpha. For a particular class of hierarchical generalized priors studied in Maruyama and Strawderman (2005, 2006) for the problems of estimating the mean vector and the variance respectively, we give the generalized Bayes predictive density. Additionally, we show that, for a subclass of these priors, the resulting estimator dominates the generalized Bayes estimator with respect to the right invariant prior when alpha=1, i.e., the best (fully) equivariant minimax estimator.

preprint2006arXiv

On the behavior of Bayesian credible intervals for some restricted parameter space problems

For estimating a positive normal mean, Zhang and Woodroofe (2003) as well as Roe and Woodroofe (2000) investigate 100($1-α)%$ HPD credible sets associated with priors obtained as the truncation of noninformative priors onto the restricted parameter space. Namely, they establish the attractive lower bound of $\frac{1-α}{1+α}$ for the frequentist coverage probability of these procedures. In this work, we establish that the lower bound of $\frac{1-α}{1+α}$ is applicable for a substantially more general setting with underlying distributional symmetry, and obtain various other properties. The derivations are unified and are driven by the choice of a right Haar invariant prior. Investigations of non-symmetric models are carried out and similar results are obtained. Namely, (i) we show that the lower bound $\frac{1-α}{1+α}$ still applies for certain types of asymmetry (or skewness), and (ii) we extend results obtained by Zhang and Woodroofe (2002) for estimating the scale parameter of a Fisher distribution; which arises in estimating the ratio of variance components in a one-way balanced random effects ANOVA. Finally, various examples illustrating the wide scope of applications are expanded upon. Examples include estimating parameters in location models and location-scale models, estimating scale parameters in scale models, estimating linear combinations of location parameters such as differences, estimating ratios of scale parameters, and problems with non-independent observations.

preprint2005arXiv

A new class of generalized Bayes minimax ridge regression estimators

Let y=Aβ+ε, where y is an N\times1 vector of observations, βis a p\times1 vector of unknown regression coefficients, A is an N\times p design matrix and εis a spherically symmetric error term with unknown scale parameter σ. We consider estimation of βunder general quadratic loss functions, and, in particular, extend the work of Strawderman [J. Amer. Statist. Assoc. 73 (1978) 623-627] and Casella [Ann. Statist. 8 (1980) 1036-1056, J. Amer. Statist. Assoc. 80 (1985) 753-758] by finding adaptive minimax estimators (which are, under the normality assumption, also generalized Bayes) of β, which have greater numerical stability (i.e., smaller condition number) than the usual least squares estimator. In particular, we give a subclass of such estimators which, surprisingly, has a very simple form. We also show that under certain conditions the generalized Bayes minimax estimators in the normal case are also generalized Bayes and minimax in the general case of spherically symmetric errors.