Source author record

Art Owen

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

math.NA math.ST Statistics Theory Computation Information Retrieval Information Theory Machine Learning math.IT Methodology

Catalog footprint

Research overview

4works

9topics

4close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2020arXiv

Combining Observational and Experimental Datasets Using Shrinkage Estimators

We consider the problem of combining data from observational and experimental sources to make causal conclusions. This problem is increasingly relevant, as the modern era has yielded passive collection of massive observational datasets in areas such as e-commerce and electronic health. These data may be used to supplement experimental data, which is frequently expensive to obtain. In Rosenman et al. (2018), we considered this problem under the assumption that all confounders were measured. Here, we relax the assumption of unconfoundedness. To derive combined estimators with desirable properties, we make use of results from the Stein Shrinkage literature. Our contributions are threefold. First, we propose a generic procedure for deriving shrinkage estimators in this setting, making use of a generalized unbiased risk estimate. Second, we develop two new estimators, prove finite sample conditions under which they have lower risk than an estimator using only experimental data, and show that each achieves a notion of asymptotic optimality. Third, we draw connections between our approach and results in sensitivity analysis, including proposing a method for evaluating the feasibility of our estimators.

preprint2013arXiv

Guaranteed Conservative Fixed Width Confidence Intervals Via Monte Carlo Sampling

Monte Carlo methods are used to approximate the means, $μ$ , of random variables $Y$ , whose distributions are not known explicitly. The key idea is that the average of a random sample, $Y_1, ..., Y_n$ , tends to $μ$ as $n$ tends to infinity. This article explores how one can reliably construct a confidence interval for $μ$ with a prescribed half-width (or error tolerance) $\varepsilon$ . Our proposed two-stage algorithm assumes that the kurtosis of $Y$ does not exceed some user-specified bound. An initial independent and identically distributed (IID) sample is used to confidently estimate the variance of $Y$ . A Berry-Esseen inequality then makes it possible to determine the size of the IID sample required to construct the desired confidence interval for $μ$ . We discuss the important case where $Y=f(\vX)$ and $\vX$ is a random $d$ -vector with probability density function $ρ$ . In this case $μ$ can be interpreted as the integral $\int_{\reals^d} f(\vx) ρ(\vx) \dif \vx$, and the Monte Carlo method becomes a method for multidimensional cubature.

preprint2013arXiv

Higher order Sobol' indices

Sobol' indices measure the dependence of a high dimensional function on groups of variables defined on the unit cube $[0,1]^d$ . They are based on the ANOVA decomposition of functions, which is an $L^2$ decomposition. In this paper we discuss generalizations of Sobol' indices which yield $L^p$ measures of the dependence of $f$ on subsets of variables. Our interest is in values $p>2$ because then variable importance becomes more about reaching the extremes of $f$ . We introduce two methods. One based on higher order moments of the ANOVA terms and another based on higher order norms of a spectral decomposition of $f$ , including Fourier and Haar variants. Both of our generalizations have representations as integrals over $[0,1]^{kd}$ for $k\ge 1$ , allowing direct Monte Carlo or quasi-Monte Carlo estimation. We find that they are sensitive to different aspects of $f$ , and thus quantify different notions of variable importance.

preprint2012arXiv

One Permutation Hashing for Efficient Search and Learning

Recently, the method of b-bit minwise hashing has been applied to large-scale linear learning and sublinear time near-neighbor search. The major drawback of minwise hashing is the expensive preprocessing cost, as the method requires applying (e.g.,) k=200 to 500 permutations on the data. The testing time can also be expensive if a new data point (e.g., a new document or image) has not been processed, which might be a significant issue in user-facing applications. We develop a very simple solution based on one permutation hashing. Conceptually, given a massive binary data matrix, we permute the columns only once and divide the permuted columns evenly into k bins; and we simply store, for each data vector, the smallest nonzero location in each bin. The interesting probability analysis (which is validated by experiments) reveals that our one permutation scheme should perform very similarly to the original (k-permutation) minwise hashing. In fact, the one permutation scheme can be even slightly more accurate, due to the "sample-without-replacement" effect. Our experiments with training linear SVM and logistic regression on the webspam dataset demonstrate that this one permutation hashing scheme can achieve the same (or even slightly better) accuracies compared to the original k-permutation scheme. To test the robustness of our method, we also experiment with the small news20 dataset which is very sparse and has merely on average 500 nonzeros in each data vector. Interestingly, our one permutation scheme noticeably outperforms the k-permutation scheme when k is not too small on the news20 dataset. In summary, our method can achieve at least the same accuracy as the original k-permutation scheme, at merely 1/k of the original preprocessing cost.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.