BZPEERReading, trust and collaboration for research
Menu

Discover

GraphFollow connections around a paper, topic or saved view.

Workspaces

HomePick up where your research flow left off.InboxHandle requests, replies and notifications from one place.CollectionsCurate reading lists, evidence sets and shareable dossiers.ResearchSee your private provenance graph, trail and imports.CollaborationMove from discovery into focused discussion rooms.PublishDraft, preview and publish full-text research articles.

Network

ExpertsFind specialists worth following or asking for help.CommunitiesJoin research circles organized around shared work.PartnersSee external organizations active around the same topics.

Opportunities

ListingsBrowse roles, calls and collaborations with clearer fit signals.

Account

Log inReturn to your reading and collaboration workspace.Create accountStart saving work, following people and joining teams.
Log inCreate account

Researcher profile

Fred J. Hickernell

Fred J. Hickernell contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate
math.NAMachine LearningComputationmath.FAmath.OCmath.STMathematical SoftwareMethodologyNumerical AnalysisStatistics Theory

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
12works
0followers
10topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

12 published item(s)

preprint2019arXiv

Fast Automatic Bayesian Cubature Using Lattice Sampling

Automatic cubatures approximate multidimensional integrals to user-specified error tolerances. For high dimensional problems, it makes sense to fix the sampling density but determine the sample size, $n$, automatically. Bayesian cubature postulates that the integrand is an instance of a stochastic process. Here we assume a Gaussian process parameterized by a constant mean and a covariance function defined by a scale parameter times a parameterized function specifying how the integrand values at two different points in the domain are related. These parameters are estimated from integrand values or are given non-informative priors. The sample size, $n$, is chosen to make the half-width of the credible interval for the Bayesian posterior mean no greater than the error tolerance. The process just outlined typically requires vector-matrix operations with a computational cost of $O(n^3)$. Our innovation is to pair low discrepancy nodes with matching kernels that lower the computational cost to $O(n \log n)$. This approach is demonstrated using rank-1 lattice sequences and shift-invariant kernels. Our algorithm is implemented in the Guaranteed Automatic Integration Library (GAIL).

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Adaptive Multidimensional Integration Based on Rank-1 Lattices

Quasi-Monte Carlo methods are used for numerically integrating multivariate functions. However, the error bounds for these methods typically rely on a priori knowledge of some semi-norm of the integrand, not on the sampled function values. In this article, we propose an error bound based on the discrete Fourier coefficients of the integrand. If these Fourier coefficients decay more quickly, the integrand has less fine scale structure, and the accuracy is higher. We focus on rank-1 lattices because they are a commonly used quasi-Monte Carlo design and because their algebraic structure facilitates an error analysis based on a Fourier decomposition of the integrand. This leads to a guaranteed adaptive cubature algorithm with computational cost $O(mb^m)$, where $b$ is some fixed prime number and $b^m$ is the number of data points.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

GAIL---Guaranteed Automatic Integration Library in MATLAB: Documentation for Version 2.1

Automatic and adaptive approximation, optimization, or integration of functions in a cone with guarantee of accuracy is a relatively new paradigm. Our purpose is to create an open-source MATLAB package, Guaranteed Automatic Integration Library (GAIL), following the philosophy of reproducible research and sustainable practices of robust scientific software development. For our conviction that true scholarship in computational sciences are characterized by reliable reproducibility, we employ the best practices in mathematical research and software engineering known to us and available in MATLAB. This document describes the key features of functions in GAIL, which includes one-dimensional function approximation and minimization using linear splines, one-dimensional numerical integration using trapezoidal rule, and last but not least, mean estimation and multidimensional integration by Monte Carlo methods or Quasi Monte Carlo methods.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Reliable Adaptive Cubature Using Digital Sequences

Quasi-Monte Carlo cubature methods often sample the integrand using Sobol' (or other digital) sequences to obtain higher accuracy than IID sampling. An important question is how to conservatively estimate the error of a digital sequence cubature so that the sampling can be terminated when the desired tolerance is reached. We propose an error bound based on the discrete Walsh coefficients of the integrand and use this error bound to construct an adaptive digital sequence cubature algorithm. The error bound and the corresponding algorithm are guaranteed to work for integrands whose true Walsh coefficients satisfy certain cone conditions. Intuitively, these cone conditions imply that the ordered Walsh coefficients do not dip down for a long stretch and then jump back up. An upper bound on the cost of our new algorithm is given in terms of the \emph{unknown} decay rate of the Walsh coefficients.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Guaranteed Monte Carlo Methods for Bernoulli Random Variables

Simple Monte Carlo is a versatile computational method with a convergence rate of $O(n^{-1/2})$. It can be used to estimate the means of random variables whose distributions are unknown. Bernoulli random variables, $Y$, are widely used to model success (failure) of complex systems. Here $Y=1$ denotes a success (failure), and $p=\mathbb{E}(Y)$ denotes the probability of that success (failure). Another application of Bernoulli random variables is $Y=\mathbb{1}_{R}(\boldsymbol{X})$, where then $p$ is the probability of $\boldsymbol{X}$ lying in the region $R$. This article explores how estimate $p$ to a prescribed absolute error tolerance, $\varepsilon$, with a high level of confidence, $1-α$. The proposed algorithm automatically determines the number of samples of $Y$ needed to reach the prescribed error tolerance with the specified confidence level by using Hoeffding's inequality. The algorithm described here has been implemented in MATLAB and is part of the Guaranteed Automatic Integration Library (GAIL).

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Tractability of the function approximation problem in terms of the kernel's shape and scale parameters

This article studies the problem of approximating functions belonging to a Hilbert space $\mathcal H_d$ with a reproducing kernel of the form $$\tilde K_d(\boldsymbol x,\boldsymbol t):=\prod_{\ell=1}^d \left(1-α_\ell^2+α_\ell^2K_{γ_\ell}(x_\ell,t_\ell)\right)\ \ \ \mbox{for all} \ \ \ \boldsymbol x,\boldsymbol t\in\mathbb R^d.$$ The $α_\ell\in[0,1]$ are scale parameters, and the $γ_\ell>0$ are sometimes called shape parameters. The reproducing kernel $K_γ$ corresponds to some Hilbert space of functions defined on $\mathbb R$. The kernel $\tilde K_d$ generalizes the anisotropic Gaussian reproducing kernel, whose tractability properties have been established in the literature. We present sufficient conditions on $\{α_\ell γ_\ell\}_{\ell=1}^{\infty}$ under which polynomial tractability holds for function approximation problems on $\mathcal H_d$. The exponent of strong polynomial tractability arises from bounds on the eigenvalues of a positive definite linear operator.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Guaranteed Conservative Fixed Width Confidence Intervals Via Monte Carlo Sampling

Monte Carlo methods are used to approximate the means, $μ$, of random variables $Y$, whose distributions are not known explicitly. The key idea is that the average of a random sample, $Y_1, ..., Y_n$, tends to $μ$ as $n$ tends to infinity. This article explores how one can reliably construct a confidence interval for $μ$ with a prescribed half-width (or error tolerance) $\varepsilon$. Our proposed two-stage algorithm assumes that the kurtosis of $Y$ does not exceed some user-specified bound. An initial independent and identically distributed (IID) sample is used to confidently estimate the variance of $Y$. A Berry-Esseen inequality then makes it possible to determine the size of the IID sample required to construct the desired confidence interval for $μ$. We discuss the important case where $Y=f(\vX)$ and $\vX$ is a random $d$-vector with probability density function $ρ$. In this case $μ$ can be interpreted as the integral $\int_{\reals^d} f(\vx) ρ(\vx) \dif \vx$, and the Monte Carlo method becomes a method for multidimensional cubature.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Solving Support Vector Machines in Reproducing Kernel Banach Spaces with Positive Definite Functions

In this paper we solve support vector machines in reproducing kernel Banach spaces with reproducing kernels defined on nonsymmetric domains instead of the traditional methods in reproducing kernel Hilbert spaces. Using the orthogonality of semi-inner-products, we can obtain the explicit representations of the dual (normalized-duality-mapping) elements of support vector machine solutions. In addition, we can introduce the reproduction property in a generalized native space by Fourier transform techniques such that it becomes a reproducing kernel Banach space, which can be even embedded into Sobolev spaces, and its reproducing kernel is set up by the related positive definite function. The representations of the optimal solutions of support vector machines (regularized empirical risks) in these reproducing kernel Banach spaces are formulated explicitly in terms of positive definite functions, and their finite numbers of coefficients can be computed by fixed point iteration. We also give some typical examples of reproducing kernel Banach spaces induced by Matérn functions (Sobolev splines) so that their support vector machine solutions are well computable as the classical algorithms. Moreover, each of their reproducing bases includes information from multiple training data points. The concept of reproducing kernel Banach spaces offers us a new numerical tool for solving support vector machines.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

The Cost of Deterministic, Adaptive, Automatic Algorithms: Cones, Not Balls

Automatic numerical algorithms attempt to provide approximate solutions that differ from exact solutions by no more than a user-specified error tolerance. The computational cost is often determined \emph{adaptively} by the algorithm based on the function values sampled. While adaptive, automatic algorithms are widely used in practice, most lack \emph{guarantees}, i.e., conditions on input functions that ensure that the error tolerance is met. This article establishes a framework for guaranteed, adaptive, automatic algorithms. Sufficient conditions for success and two-sided bounds on the computational cost are provided in Theorems \ref{TwoStageDetermThm} and \ref{MultiStageThm}. Lower bounds on the complexity of the problem are given in Theorem \ref{complowbd}, and conditions under which the proposed algorithms have optimal order are given in Corollary \ref{optimcor}. These general theorems are illustrated for univariate numerical integration and function recovery via adaptive algorithms based on linear splines. The key to these adaptive algorithms is performing the analysis for \emph{cones} of input functions rather than balls. Cones provide a setting where adaption may be beneficial.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Reproducing Kernel Banach Spaces with the l1 Norm

Targeting at sparse learning, we construct Banach spaces B of functions on an input space X with the properties that (1) B possesses an l1 norm in the sense that it is isometrically isomorphic to the Banach space of integrable functions on X with respect to the counting measure; (2) point evaluations are continuous linear functionals on B and are representable through a bilinear form with a kernel function; (3) regularized learning schemes on B satisfy the linear representer theorem. Examples of kernel functions admissible for the construction of such spaces are given.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Rate of Convergence and Tractability of the Radial Function Approximation Problem

This article studies the problem of approximating functions belonging to a Hilbert space $H_d$ with an isotropic or anisotropic Gaussian reproducing kernel, $$ K_d(\bx,\bt) = \exp\left(-\sum_{\ell=1}^dγ_\ell^2(x_\ell-t_\ell)^2\right) \ \ \ \mbox{for all}\ \ \bx,\bt\in\reals^d. $$ The isotropic case corresponds to using the same shape parameters for all coordinates, namely $γ_\ell=γ>0$ for all $\ell$, whereas the anisotropic case corresponds to varying shape parameters $γ_\ell$. We are especially interested in moderate to large $d$.

0 citations0 reviewsNo code linkedOpen access
preprint2008arXiv

A Multivariate Fast Discrete Walsh Transform with an Application to Function Interpolation

For high dimensional problems, such as approximation and integration, one cannot afford to sample on a grid because of the curse of dimensionality. An attractive alternative is to sample on a low discrepancy set, such as an integration lattice or a digital net. This article introduces a multivariate fast discrete Walsh transform for data sampled on a digital net that requires only $O(N \log N)$ operations, where $N$ is the number of data points. This algorithm and its inverse are digital analogs of multivariate fast Fourier transforms. This fast discrete Walsh transform and its inverse may be used to approximate the Walsh coefficients of a function and then construct a spline interpolant of the function. This interpolant may then be used to estimate the function's effective dimension, an important concept in the theory of numerical multivariate integration. Numerical results for various functions are presented.

0 citations0 reviewsNo code linkedOpen access