Source author record

John Moriarty

John Moriarty appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

20works
18topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

20 published item(s)

preprint2022arXiv

Markov risk mappings and risk-sensitive optimal prediction

We formulate a probabilistic Markov property in discrete time under a dynamic risk framework with minimal assumptions. This is useful for recursive solutions to risk-sensitive versions of dynamic optimisation problems such as optimal prediction, where at each stage the recursion depends on the whole future. The property holds for standard measures of risk used in practice, and is formulated in several equivalent versions including a representation via acceptance sets, a strong version, and a dual representation.

preprint2022arXiv

RangL: A Reinforcement Learning Competition Platform

The RangL project hosted by The Alan Turing Institute aims to encourage the wider uptake of reinforcement learning by supporting competitions relating to real-world dynamic decision problems. This article describes the reusable code repository developed by the RangL team and deployed for the 2022 Pathways to Net Zero Challenge, supported by the UK Net Zero Technology Centre. The winning solutions to this particular Challenge seek to optimize the UK's energy transition policy to net zero carbon emissions by 2050. The RangL repository includes an OpenAI Gym reinforcement learning environment and code that supports both submission to, and evaluation in, a remote instance of the open source EvalAI platform as well as all winning learning agent strategies. The repository is an illustrative example of RangL's capability to provide a reusable structure for future challenges.

preprint2016arXiv

Energy imbalance market call options and the valuation of storage

The use of energy storage to balance electric grids is increasing and, with it, the importance of operational optimisation from the twin viewpoints of cost and system stability. In this paper we assess the real option value of balancing reserve provided by an energy-limited storage unit. The contractual arrangement is a series of American-style call options in an energy imbalance market (EIM), physically covered and delivered by the store, and purchased by the power system operator. We take the EIM price as a general regular one-dimensional diffusion and impose natural economic conditions on the option parameters. In this framework we derive the operational strategy of the storage operator by solving two timing problems: when to purchase energy to load the store (to provide physical cover for the option) and when to sell the option to the system operator. We give necessary and sufficient conditions for the finiteness and positivity of the value function -- the total discounted cash flows generated by operation of the storage unit. We also provide a straightforward procedure for the numerical evaluation of the optimal operational strategy (EIM prices at which power should be purchased) and the value function. This is illustrated with an operational and economic analysis using data from the German Amprion EIM.

preprint2016arXiv

Optimal Entry to an Irreversible Investment Plan with Non Convex Costs

A problem of optimally purchasing electricity at a real-valued spot price (that is, with potentially negative cost) has been recently addressed in De Angelis, Ferrari and Moriarty (2015) [SIAM J. Control Optim. 53(3)]. This problem can be considered one of irreversible investment with a cost functional which is non convex with respect to the control variable. In this paper we study the optimal entry into this investment plan. The optimal entry policy can have an irregular boundary arising from this non convexity, with a kinked shape.

preprint2015arXiv

A geometric answer to an open question of singular control with stopping

We solve a problem of singular stochastic control with discretionary stopping, suggested as an interesting open problem by Karatzas, Ocone, Wang and Zervos (2000), by providing suitable candidates for the moving boundaries in an unsolved parameter range. We proceed by identifying an optimal stopping problem with similar variational inequalities and inspecting its parameter-dependent geometry (in a sense going back to Dynkin (1965)), which reveals a discontinuity not previously exploited. We thus highlight the potential importance of this geometric information in both singular control and parameter-dependent optimal stopping.

preprint2015arXiv

A solvable two-dimensional singular stochastic control problem with non convex costs

In this paper we provide a complete theoretical analysis of a two-dimensional degenerate non convex singular stochastic control problem. The optimisation is motivated by a storage-consumption model in an electricity market, and features a stochastic real-valued spot price modelled by Brownian motion. We find analytical expressions for the value function, the optimal control and the boundaries of the action and inaction regions. The optimal policy is characterised in terms of two monotone and discontinuous repelling free boundaries, although part of one boundary is constant and the smooth fit condition holds there.

preprint2015arXiv

Building massive compact planetesimal disks from the accretion of pebbles

We present a model in which planetesimal disks are built from the combination of planetesimal formation and accretion of radially drifting pebbles onto existing planetesimals. In this model, the rate of accretion of pebbles onto planetesimals quickly outpaces the rate of direct planetesimal formation in the inner disk. This allows for the formation of a high mass inner disk without the need for enhanced planetesimal formation or a massive protoplanetary disk. Our proposed mechanism for planetesimal disk growth does not require any special conditions to operate. Consequently, we expect that high mass planetesimal disks form naturally in nearly all systems. The extent of this growth is controlled by the total mass in pebbles that drifts through the inner disk. Anything that reduces the rate or duration of pebble delivery will correspondingly reduce the final mass of the planetesimal disk. Therefore, we expect that low mass stars (with less massive protoplanetary disks), low metallicity stars and stars with giant planets should all grow less massive planetesimal disks. The evolution of planetesimal disks into planetary systems remains a mystery. However, we argue that late stage planet formation models should begin with a massive disk. This reinforces the idea that massive and compact planetary systems could form in situ but does not exclude the possibility that significant migration occurs post-planet formation.

preprint2015arXiv

Fiber scrambling for high-resolution spectrographs. II. A double fiber scrambler for Keck Observatory

We have designed a fiber scrambler as a prototype for the Keck HIRES spectrograph, using double scrambling to stabilize illumination of the spectrometer and a pupil slicer to increase spectral resolution to R = 70,000 with minimal slit losses. We find that the spectral line spread function (SLSF) for the double scrambler observations is 18 times more stable than the SLSF for comparable slit observations and 9 times more stable than the SLSF for a single fiber scrambler that we tested in 2010. For the double scrambler test data, we further reduced the radial velocity scatter from an average of 2.1 m/s to 1.5 m/s after adopting a median description of the stabilized SLSF in our Doppler model. This demonstrates that inaccuracies in modeling the SLSF contribute to the velocity RMS. Imperfect knowledge of the SLSF, rather than stellar jitter, sets the precision floor for chromospherically quiet stars analyzed with the iodine technique using Keck HIRES and other slit-fed spectrometers. It is increasingly common practice for astronomers to scale stellar noise in quadrature with formal errors such that their Keplerian model yields a chi-squared fit of 1.0. When this is done, errors from inaccurate modeling of the SLSF (and perhaps from other sources) are attributed to the star and the floor of the stellar noise is overestimated.

preprint2015arXiv

The Kepler Dichotomy in Planetary Disks: Linking Kepler Observables to Simulations of Late-Stage Planet Formation

NASA's Kepler Mission uncovered a wealth of planetary systems, many with planets on short-period orbits. These short-period systems reside around 50% of Sun-like stars and are similarly prevalent around M dwarfs. Their formation and subsequent evolution is the subject of active debate. In this paper, we simulate late-stage, in-situ planet formation across a grid of planetesimal disks with varying surface density profiles and total mass. We compare simulation results with observable characteristics of the Kepler sample. We identify mixture models with different primordial planetesimal disk properties that self-consistently recover the multiplicity, period ratio and duration ratio distributions of the Kepler planets. We draw three main conclusions: (1) We favor a "frozen-in" narrative for systems of short period planets, in which they are stable over long timescales, as opposed to metastable. (2) The "Kepler dichotomy", an observed phenomenon of the Kepler sample wherein the architectures of planetary systems appear to either vary significantly or have multiple modes, can naturally be explained by formation within planetesimal disks with varying surface density profiles. Finally, (3) we quantify the nature of the "Kepler dichotomy" for both GK stars and M dwarfs, and find that it varies with stellar type. While the mode of planet formation that accounts for highly multiplistic systems occurs in 24+/-7% of planetary systems orbiting GK stars, it occurs in 63+/-16% of planetary systems orbiting M dwarfs.

preprint2014arXiv

A Non Convex Singular Stochastic Control Problem and its Related Optimal Stopping Boundaries

Equivalences are known between problems of singular stochastic control (SSC) with convex performance criteria and related questions of optimal stopping, see for example Karatzas and Shreve [SIAM J. Control Optim. 22 (1984)]. The aim of this paper is to investigate how far connections of this type generalise to a non convex problem of purchasing electricity. Where the classical equivalence breaks down we provide alternative connections to optimal stopping problems. We consider a non convex infinite time horizon SSC problem whose state consists of an uncontrolled diffusion representing a real-valued commodity price, and a controlled increasing bounded process representing an inventory. We analyse the geometry of the action and inaction regions by characterising their (optimal) boundaries. Unlike the case of convex SSC problems we find that the optimal boundaries may be both reflecting and repelling and it is natural to interpret the problem as one of SSC with discretionary stopping.

preprint2014arXiv

Chemistry in an Evolving Protoplanetary Disk: Effects on Terrestrial Planet Composition

The composition of planets is largely determined by the chemical and dynamical evolution of the disk during planetesimal formation and growth. To predict the diversity of exoplanet compositions, previous works modeled planetesimal composition as the equilibrium chemical composition of a proto- planetary disk at a single time. However, planetesimals form over an extended period of time, during which, elements sequentially condense out of the gas as the disk cools and are accreted onto planetesi- mals. To account for the evolution of the disk during planetesimal formation, we couple models of disk chemistry and dynamics with a prescription for planetesimal formation. We then follow the growth of these planetesimals into terrestrial planets with N-body simulations of late stage planet formation to evaluate the effect of sequential condensation on the bulk composition of planets. We find that our model produces results similar to those of earlier models for disks with C/O ratios close to the solar value (0.54). However, in disks with C/O ratios greater than 0.8, carbon rich planetesimals form throughout a much larger radial range of the disk. Furthermore, our model produces carbon rich planetesimals in disks with C/O ratios as low as ~0.65, which is not possible in the static equilibrium chemistry case. These results suggest that (1) there may be a large population of short period carbon rich planets around moderately carbon enhanced stars (0.65 < C/O < 0.8) and (2) carbon rich planets can form throughout the terrestrial planet region around carbon rich stars (C/O > 0.8).

preprint2013arXiv

Robust estimation of microbial diversity in theory and in practice

Quantifying diversity is of central importance for the study of structure, function and evolution of microbial communities. The estimation of microbial diversity has received renewed attention with the advent of large-scale metagenomic studies. Here, we consider what the diversity observed in a sample tells us about the diversity of the community being sampled. First, we argue that one cannot reliably estimate the absolute and relative number of microbial species present in a community without making unsupported assumptions about species abundance distributions. The reason for this is that sample data do not contain information about the number of rare species in the tail of species abundance distributions. We illustrate the difficulty in comparing species richness estimates by applying Chao's estimator of species richness to a set of in silico communities: they are ranked incorrectly in the presence of large numbers of rare species. Next, we extend our analysis to a general family of diversity metrics ("Hill diversities"), and construct lower and upper estimates of diversity values consistent with the sample data. The theory generalizes Chao's estimator, which we retrieve as the lower estimate of species richness. We show that Shannon and Simpson diversity can be robustly estimated for the in silico communities. We analyze nine metagenomic data sets from a wide range of environments, and show that our findings are relevant for empirically-sampled communities. Hence, we recommend the use of Shannon and Simpson diversity rather than species richness in efforts to quantify and compare microbial diversity.

preprint2012arXiv

Ancestral Inference from Functional Data: Statistical Methods and Numerical Examples

Many biological characteristics of evolutionary interest are not scalar variables but continuous functions. Here we use phylogenetic Gaussian process regression to model the evolution of simulated function-valued traits. Given function-valued data only from the tips of an evolutionary tree and utilising independent principal component analysis (IPCA) as a method for dimension reduction, we construct distributional estimates of ancestral function-valued traits, and estimate parameters describing their evolutionary dynamics.

preprint2012arXiv

Evolutionary Inference for Function-valued Traits: Gaussian Process Regression on Phylogenies

Biological data objects often have both of the following features: (i) they are functions rather than single numbers or vectors, and (ii) they are correlated due to phylogenetic relationships. In this paper we give a flexible statistical model for such data, by combining assumptions from phylogenetics with Gaussian processes. We describe its use as a nonparametric Bayesian prior distribution, both for prediction (placing posterior distributions on ancestral functions) and model selection (comparing rates of evolution across a phylogeny, or identifying the most likely phylogenies consistent with the observed data). Our work is integrative, extending the popular phylogenetic Brownian Motion and Ornstein-Uhlenbeck models to functional data and Bayesian inference, and extending Gaussian Process regression to phylogenies. We provide a brief illustration of the application of our method.

preprint2012arXiv

Function-Valued Traits in Evolution

Many biological characteristics of evolutionary interest are not scalar variables but continuous functions. Given a dataset of function-valued traits generated by evolution, we develop a practical statistical approach to infer ancestral function-valued traits, and estimate the generative evolutionary process. We do this by combining dimension reduction and phylogenetic Gaussian process regression, a nonparametric procedure which explicitly accounts for known phylogenetic relationships. We test the methods' performance on simulated function-valued data generated from a stochastic evolutionary model. The methods are applied assuming that only the phylogeny and the function-valued traits of taxa at its tips are known. Our method is robust and applicable to a wide range of function-valued data, and also offers a phylogenetically aware method for estimating the autocorrelation of function-valued traits.

preprint2011arXiv

M2K: II. A Triple-Planet System Orbiting HIP 57274

Doppler observations from Keck Observatory have revealed a triple planet system orbiting the nearby mid-type K dwarf, HIP 57274. The inner planet, HIP 57274b, is a super-Earth with \msini\ = 11.6 \mearth (0.036 \mjup), an orbital period of 8.135 $\pm$ 0.004 d, and slightly eccentric orbit $e=0.19 \pm 0.1$. We calculate a transit probability of 6.5% for the inner planet. The second planet has \msini\ = 0.4 \mjup\ with an orbital period of 32.0 $\pm 0.02$ d in a nearly circular orbit, and $e = 0.05 \pm 0.03$. The third planet has \msini\ = 0.53 \mjup\ with an orbital period of 432 $\pm 8$ d (1.18 years) and an eccentricity $e = 0.23 \pm 0.03$. This discovery adds to the number of super Earth mass planets with $\msini < 12 \mearth\ $ that have been detected with Doppler surveys. We find that 56 $\pm 18$% super-Earths are members of multi-planet systems. This is certainly a lower limit because of observational detectability limits, yet significantly higher than the fraction of Jupiter mass exoplanets, $20 \pm 8$%, that are members of Doppler-detected, multi-planet systems.

preprint2008arXiv

Exit problems associated with affine reflection groups

We obtain a formula for the distribution of the first exit time of Brownian motion from the alcove of an affine Weyl group. In most cases the formula is expressed compactly, in terms of Pfaffians. Expected exit times are derived in the type à case. The results extend to other Markov processes. We also give formulas for the real eigenfunctions of the Dirichlet and Neumann Laplacians on alcoves, observing that the `Hot Spots' conjecture of J. Rauch is true for alcoves.