Source author record

Mark Richardson

Mark Richardson appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

math.NA astro-ph astro-ph.CO Graphics Information Theory Machine Learning math.IT

Catalog footprint

What is connected

6works

7topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2020arXiv

ITENE: Intrinsic Transfer Entropy Neural Estimator

Quantifying the directionality of information flow is instrumental in understanding, and possibly controlling, the operation of many complex systems, such as transportation, social, neural, or gene-regulatory networks. The standard Transfer Entropy (TE) metric follows Granger's causality principle by measuring the Mutual Information (MI) between the past states of a source signal $X$ and the future state of a target signal $Y$ while conditioning on past states of $Y$. Hence, the TE quantifies the improvement, as measured by the log-loss, in the prediction of the target sequence $Y$ that can be accrued when, in addition to the past of $Y$, one also has available past samples from $X$. However, by conditioning on the past of $Y$, the TE also measures information that can be synergistically extracted by observing both the past of $X$ and $Y$, and not solely the past of $X$. Building on a private key agreement formulation, the Intrinsic TE (ITE) aims to discount such synergistic information to quantify the degree to which $X$ is \emph{individually} predictive of $Y$, independent of $Y$'s past. In this paper, an estimator of the ITE is proposed that is inspired by the recently proposed Mutual Information Neural Estimation (MINE). The estimator is based on variational bound on the KL divergence, two-sample neural network classifiers, and the pathwise estimator of Monte Carlo gradients.

preprint2016arXiv

Resolution-optimal exponential and double-exponential transform methods for functions with endpoint singularities

We introduce a numerical method for the approximation of functions which are analytic on compact intervals, except at the endpoints. This method is based on variable transforms using particular parametrized exponential and double-exponential mappings, in combination with Fourier-like approximation in a truncated domain. We show theoretically that this method is superior to variable transform techniques based on the standard exponential and double-exponential mappings. In particular, it can resolve oscillatory behaviour using near-optimal degrees of freedom, whereas the standard mappings require degrees of freedom that grow superlinearly with the frequency of oscillation. We highlight these results with several numerical experiments. Therein it is observed that near-machine epsilon accuracy is achieved using a number of degrees of freedom that is between four and ten times smaller than those of existing techniques.

preprint2014arXiv

New exponential variable transform methods for functions with endpoint singularities

The focus of this article is the approximation of functions which are analytic on a compact interval except at the endpoints. Typical numerical methods for approximating such functions depend upon the use of particular conformal maps from the original interval to either a semi-infinite or an infinite interval, followed by an appropriate approximation procedure on the new region. We first analyse the convergence of these existing methods and show that, in a precisely defined sense, they are sub-optimal. Specifically, they exhibit poor resolution properties, by which we mean that many more degrees of freedom are required to resolve oscillatory functions than standard approximation schemes for analytic functions such as Chebyshev interpolation. To remedy this situation, we introduce two new transforms; one for each of the above settings. We provide full convergence results for these new approximations and then demonstrate that, for a particular choice of parameters, these methods lead to substantially better resolution properties. Finally, we show that optimal resolution power can be achieved by an appropriate choice of parameters, provided one forfeits classical convergence. Instead, the resulting method attains a finite, but user-controlled accuracy specified by the parameter choice.

preprint2012arXiv

Efficient computational noise in GLSL

We present GLSL implementations of Perlin noise and Perlin simplex noise that run fast enough for practical consideration on current generation GPU hardware. The key benefits are that the functions are purely computational, i.e. they use neither textures nor lookup tables, and that they are implemented in GLSL version 1.20, which means they are compatible with all current GLSL-capable platforms, including OpenGL ES 2.0 and WebGL 1.0. Their performance is on par with previously presented GPU implementations of noise, they are very convenient to use, and they scale well with increasing parallelism in present and upcoming GPU architectures.

preprint2009arXiv

Power spectrum for the small-scale Universe

The first objects to arise in a cold dark matter universe present a daunting challenge for models of structure formation. In the ultra small-scale limit, CDM structures form nearly simultaneously across a wide range of scales. Hierarchical clustering no longer provides a guiding principle for theoretical analyses and the computation time required to carry out credible simulations becomes prohibitively high. To gain insight into this problem, we perform high-resolution (N=720^3 - 1584^3) simulations of an Einstein-de Sitter cosmology where the initial power spectrum is P(k) propto k^n, with -2.5 < n < -1. Self-similar scaling is established for n=-1 and n=-2 more convincingly than in previous, lower-resolution simulations and for the first time, self-similar scaling is established for an n=-2.25 simulation. However, finite box-size effects induce departures from self-similar scaling in our n=-2.5 simulation. We compare our results with the predictions for the power spectrum from (one-loop) perturbation theory and demonstrate that the renormalization group approach suggested by McDonald improves perturbation theory's ability to predict the power spectrum in the quasilinear regime. In the nonlinear regime, our power spectra differ significantly from the widely used fitting formulae of Peacock & Dodds and Smith et al. and a new fitting formula is presented. Implications of our results for the stable clustering hypothesis vs. halo model debate are discussed. Our power spectra are inconsistent with predictions of the stable clustering hypothesis in the high-k limit and lend credence to the halo model. Nevertheless, the fitting formula advocated in this paper is purely empirical and not derived from a specific formulation of the halo model.

preprint2008arXiv

Predictions of Quasar Clustering: Redshift, Luminosity and Selection Dependence

We show that current clustering observations of quasars and luminous AGN can be explained by a merger model augmented by feedback from outflows. Using numerical simulations large enough to study clustering out to 25 comoving h^{-1} Mpc, we calculate correlation functions, biases, and correlation lengths as a function of AGN redshift and optical and X-ray luminosity. At optical wavelengths, our results match a wide range of current observations and generate predictions for future data sets. We reproduce the weak luminosity dependence of clustering over the currently well-measured range, and predict a much stronger dependence at higher luminosities. The increase in the amplitude of binary quasar clustering observed in the Sloan Digital Sky Survey (SDSS) is also reproduced and is predicted to occur at higher redshift, an effect that is due to the one halo term in the correlation function. On the other hand, our results do not match the rapid evolution of the correlation length observed in the SDSS at z\simeq 3, a discrepancy that is at least partially due to differences in the scales probed by our simulation versus this survey. In fact, we show that changing the distances sampled from our simulations can produce changes as large as 40% in the fitted correlation lengths. Finally, in the X-ray, our simulations produce correlation lengths similar to that observed in the Chandra Deep Field (CDF) North, but not the significantly larger correlation length observed in the CDF South.