Source author record

Nigel J. Newton

Nigel J. Newton appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

math.OC math.PR Information Theory math.IT cond-mat.stat-mech math-ph math.MP math.ST Statistics Theory Systems and Control

Catalog footprint

What is connected

4works

10topics

3close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2016arXiv

Infinite-dimensional statistical manifolds based on a balanced chart

We develop a family of infinite-dimensional Banach manifolds of measures on an abstract measurable space, employing charts that are "balanced" between the density and log-density functions. The manifolds, $(\tilde{M}_λ,λ\in [2,\infty))$, retain many of the features of finite-dimensional information geometry; in particular, the $α$-divergences are of class $C^{\lceilλ\rceil-1}$, enabling the definition of the Fisher metric and $α$-derivatives of particular classes of vector fields. Manifolds of probability measures, $(M_λ,λ\in [2,\infty))$, based on centred versions of the charts are shown to be $C^{\lceilλ\rceil-1}$-embedded submanifolds of the $\tilde{M}_λ$. The Fisher metric is a pseudo-Riemannian metric on $\tilde{M}_λ$. However, when restricted to finite-dimensional embedded submanifolds it becomes a Riemannian metric, allowing the full development of the geometry of $α$-covariant derivatives. $\tilde{M}_λ$ and $M_λ$ provide natural settings for the study and comparison of approximations to posterior distributions in problems of Bayesian estimation.

preprint2016arXiv

Transfer Entropy and Directed Information in Gaussian diffusion processes

Transfer Entropy and Directed Information are information-theoretic measures of the directional dependency between stochastic processes. Following the definitions of Schreiber and Massey in discrete time, we define and evaluate these measures for the components of multidimensional Gaussian diffusion processes. When the components are jointly Markov, the Transfer Entropy and Directed Information are both measures of influence according to a simple physical principle. More generally, the effect of other components has to be accounted for, and this can be achieved in more than one way. We propose two definitions, one of which preserves the properties of influence of the jointly Markov case. The Transfer Entropy and Directed Information are expressed in terms of the solutions of matrix Riccati equations, and so are easy to compute. The definition of continuous-time Directed Information we propose differs from that previously appearing in the literature. We argue that the latter is not strictly directional.

preprint2015arXiv

Information Geometric Nonlinear Filtering

This paper develops information geometric representations for nonlinear filters in continuous time. The posterior distribution associated with an abstract nonlinear filtering problem is shown to satisfy a stochastic differential equation on a Hilbert information manifold. This supports the Fisher metric as a pseudo-Riemannian metric. Flows of Shannon information are shown to be connected with the quadratic variation of the process of posterior distributions in this metric. Apart from providing a suitable setting in which to study such information-theoretic properties, the Hilbert manifold has an appropriate topology from the point of view of multi-objective filter approximations. A general class of finite-dimensional exponential filters is shown to fit within this framework, and an intrinsic evolution equation, involving Amari's $-1$-covariant derivative, is developed for such filters. Three example systems, one of infinite dimension, are developed in detail.

preprint2014arXiv

Maximum work extraction and implementation costs for non-equilibrium Maxwell's demons

In this theoretical study, we determine the maximum amount of work extractable in finite time by a demon performing continuous measurements on a quadratic Hamiltonian system subjected to thermal fluctuations, in terms of the information extracted from the system. This is in contrast to many recent studies that focus on demons' maximizing the extracted work over received information, and operate close to equilibrium. The maximum work demon is found to apply a high-gain continuous feedback using a Kalman-Bucy estimate of the system state. A simple and concrete electrical implementation of the feedback protocol is proposed, which allows for analytic expressions of the flows of energy and entropy inside the demon. This let us show that any implementation of the demon must necessarily include an external power source, which we prove both from classical thermodynamics arguments and from a version of Landauer's memory erasure argument extended to non-equilibrium linear systems.