Researcher profile

Will Handley

Will Handley contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
20works
0followers
13topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

20 published item(s)

preprint2023arXiv

Use of Time Dependent Data in Bayesian Global 21cm Foreground and Signal Modelling

Global 21cm cosmology aims to investigate the cosmic dawn and epoch of reionisation by measuring the sky averaged HI absorption signal, which requires, accurate modelling of, or correction for, the bright radio foregrounds and distortions arising from chromaticity of the antenna beam. We investigate the effect of improving foreground modelling by fitting data sets from many observation times simultaneously in a single Bayesian analysis, fitting for the same parameter set by performing these fits on simulated data. We find that for a hexagonal dipole antenna, this simultaneous fitting produces a significant improvement in the accuracy of the recovered 21cm signal, relative to fitting a time average of the data. Furthermore, the recovered models of the foreground are also seen to become more accurate by up to a factor of $\sim$2-3 relative to time averaged fitting. For a less chromatic log spiral antenna, no significant improvement in signal recovery was found by this process. However, the modelling of the foregrounds was still significantly improved. We also investigate extending this technique to fit multiple data sets from different antennae simultaneously for the same parameters. This is also found to improve both 21cm signal and foreground modelling, to a higher degree than fitting data set from multiple times from the same antenna.

preprint2022arXiv

Analytical approximations for curved primordial power spectra

We extend the work of Contaldi et al. and derive analytical approximations for primordial power spectra arising from models of inflation which include primordial spatial curvature. These analytical templates are independent of any specific inflationary potential and therefore illustrate and provide insight into the generic effects and predictions of primordial curvature, manifesting as cut-offs and oscillations at low multipoles and agreeing with numerical calculations. We identify through our analytical approximation that the effects of curvature can be mathematically attributed to shifts in the wavevectors participating dynamically.

preprint2022arXiv

Cosmology Intertwined: A Review of the Particle Physics, Astrophysics, and Cosmology Associated with the Cosmological Tensions and Anomalies

In this paper we will list a few important goals that need to be addressed in the next decade, also taking into account the current discordances between the different cosmological probes, such as the disagreement in the value of the Hubble constant $H_0$, the $σ_8$--$S_8$ tension, and other less statistically significant anomalies. While these discordances can still be in part the result of systematic errors, their persistence after several years of accurate analysis strongly hints at cracks in the standard cosmological scenario and the necessity for new physics or generalisations beyond the standard model. In this paper, we focus on the $5.0\,σ$ tension between the {\it Planck} CMB estimate of the Hubble constant $H_0$ and the SH0ES collaboration measurements. After showing the $H_0$ evaluations made from different teams using different methods and geometric calibrations, we list a few interesting new physics models that could alleviate this tension and discuss how the next decade's experiments will be crucial. Moreover, we focus on the tension of the {\it Planck} CMB data with weak lensing measurements and redshift surveys, about the value of the matter energy density $Ω_m$, and the amplitude or rate of the growth of structure ($σ_8,fσ_8$). We list a few interesting models proposed for alleviating this tension, and we discuss the importance of trying to fit a full array of data with a single model and not just one parameter at a time. Additionally, we present a wide range of other less discussed anomalies at a statistical significance level lower than the $H_0$--$S_8$ tensions which may also constitute hints towards new physics, and we discuss possible generic theoretical approaches that can collectively explain the non-standard nature of these signals.[Abridged]

preprint2022arXiv

Exploring phase space with Nested Sampling

We present the first application of a Nested Sampling algorithm to explore the high-dimensional phase space of particle collision events. We describe the adaptation of the algorithm, designed to perform Bayesian inference computations, to the integration of partonic scattering cross sections and the generation of individual events distributed according to the corresponding squared matrix element. As a first concrete example we consider gluon scattering processes into 3-, 4- and 5-gluon final states and compare the performance with established sampling techniques. Starting from a flat prior distribution Nested Sampling outperforms the Vegas algorithm and achieves results comparable to a dedicated multi-channel importance sampler. We outline possible approaches to combine Nested Sampling with non-flat prior distributions to further reduce the variance of integral estimates and to increase unweighting efficiencies.

preprint2022arXiv

Nested sampling for frequentist computation: fast estimation of small $p$-values

We propose a novel method for computing $p$-values based on nested sampling (NS) applied to the sampling space rather than the parameter space of the problem, in contrast to its usage in Bayesian computation. The computational cost of NS scales as $\log^2{1/p}$, which compares favorably to the $1/p$ scaling for Monte Carlo (MC) simulations. For significances greater than about $4σ$ in both a toy problem and a simplified resonance search, we show that NS requires orders of magnitude fewer simulations than ordinary MC estimates. This is particularly relevant for high-energy physics, which adopts a $5σ$ gold standard for discovery. We conclude with remarks on new connections between Bayesian and frequentist computation and possibilities for tuning NS implementations for still better performance in this setting.

preprint2022arXiv

Nested sampling for physical scientists

We review Skilling's nested sampling (NS) algorithm for Bayesian inference and more broadly multi-dimensional integration. After recapitulating the principles of NS, we survey developments in implementing efficient NS algorithms in practice in high-dimensions, including methods for sampling from the so-called constrained prior. We outline the ways in which NS may be applied and describe the application of NS in three scientific fields in which the algorithm has proved to be useful: cosmology, gravitational-wave astronomy, and materials science. We close by making recommendations for best practice when using NS and by summarizing potential limitations and optimizations of NS.

preprint2022arXiv

Primordial power spectra from $k$-inflation with curvature

We investigate the primordial power spectra for general kinetic inflation models that support a period of kinetic dominance in the case of curved universes. We present derivations of the Mukhanov-Sasaki equations with a nonstandard scalar kinetic Lagrangian which manifests itself through the inflationary sound speed $c_s^2$. We extend the analytical approximations exploited in Contaldi et al [1] and Thavanesan et al [2] to general kinetic Lagrangians and show the effect of $k$-inflation on the primordial power spectra for models with curvature. In particular, the interplay between sound speed and curvature results in a natural low wavenumber cutoff for the power spectra in the case of closed universes. Using the analytical approximation, we further show that a change in the inflationary sound speed between different epochs of inflation results in non-decaying oscillations in the resultant power spectra for the comoving curvature perturbation.

preprint2022arXiv

Rescuing Palindromic Universes with Improved Recombination Modelling

We explore the linearly quantised primordial power spectra associated with palindromic universes. Extending the results of Lasenby et al. [1] and Bartlett et al. [2], we improve the modelling of recombination and include higher orders in the photonic Boltzmann hierarchy. In so doing, we find that the predicted power spectra become largely consistent with observational data. The improved recombination modelling involves developing further techniques for dealing with the future conformal boundary, by integrating the associated perturbation equations both forwards and backwards in conformal time. The resulting wavevector quantisation gives a lowest allowed wavenumber ${k_0 = 9.93 \times 10^{-5} \textrm{Mpc}^{-1}}$ and linear spacing ${Δk = 1.63 \times 10^{-4} \textrm{Mpc}^{-1}}$, providing fits consistent with observational data equivalent in quality to the $Λ$CDM model.

preprint2022arXiv

Simple and statistically sound recommendations for analysing physical theories

Physical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to statistical inference. Many models in particle physics, astrophysics and cosmology fall into one or both of these categories. These issues are often sidestepped with statistically unsound ad hoc methods, involving intersection of parameter intervals estimated by multiple experiments, and random or grid sampling of model parameters. Whilst these methods are easy to apply, they exhibit pathologies even in low-dimensional parameter spaces, and quickly become problematic to use and interpret in higher dimensions. In this article we give clear guidance for going beyond these procedures, suggesting where possible simple methods for performing statistically sound inference, and recommendations of readily-available software tools and standards that can assist in doing so. Our aim is to provide any physicists lacking comprehensive statistical training with recommendations for reaching correct scientific conclusions, with only a modest increase in analysis burden. Our examples can be reproduced with the code publicly available at https://doi.org/10.5281/zenodo.4322283.

preprint2022arXiv

Split personalities in Bayesian Neural Networks: the case for full marginalisation

The true posterior distribution of a Bayesian neural network is massively multimodal. Whilst most of these modes are functionally equivalent, we demonstrate that there remains a level of real multimodality that manifests in even the simplest neural network setups. It is only by fully marginalising over all posterior modes, using appropriate Bayesian sampling tools, that we can capture the split personalities of the network. The ability of a network trained in this manner to reason between multiple candidate solutions dramatically improves the generalisability of the model, a feature we contend is not consistently captured by alternative approaches to the training of Bayesian neural networks. We provide a concise minimal example of this, which can provide lessons and a future path forward for correctly utilising the explainability and interpretability of Bayesian neural networks.

preprint2021arXiv

Convergent Bayesian Global Fits of 4D Composite Higgs Models

Models in which the Higgs boson is a composite pseudo-Nambu-Goldstone boson offer attractive solutions to the Higgs mass naturalness problem. We consider three such models based on the minimal $SO(5) \rightarrow SO(4)$ symmetry breaking pattern, and perform convergent global fits on the models under a Bayesian framework in order to find the regions of their parameter spaces that best fit a wide range of constraints, including recent Higgs measurements. We use a novel technique to analyse the fine-tuning of the models, quantifying the tuning as the Kullback-Leibler divergence from the prior to the posterior probability on the parameter space. Each model is found to be able to satisfy all constraints at the $3σ$ level simultaneously. As a by-product of the fits, we analyse the collider phenomenology of our models in these viable regions. In two of the three models, we find that the $g g \rightarrow H \rightarrow γγ$ cross section is less than ${\sim}90$% that predicted by the SM, which is already in slight tension with experiment and could potentially be ruled out in the future high-luminosity run of the LHC. In addition, the lightest fermions $F$ arising from the new strong dynamics in these models are seen in general to lie above ${\sim}1.1$ TeV, with the $F \rightarrow tW^{+}$ and $F \rightarrow \bar{b}W^{+}$ decays offering particularly promising channels for probing these models in future collider searches.

preprint2021arXiv

CosmoBit: A GAMBIT module for computing cosmological observables and likelihoods

We introduce $\sf{CosmoBit}$, a module within the open-source $\sf{GAMBIT}$ software framework for exploring connections between cosmology and particle physics with joint global fits. $\sf{CosmoBit}$ provides a flexible framework for studying various scenarios beyond $Λ$CDM, such as models of inflation, modifications of the effective number of relativistic degrees of freedom, exotic energy injection from annihilating or decaying dark matter, and variations of the properties of elementary particles such as neutrino masses and the lifetime of the neutron. Many observables and likelihoods in $\sf{CosmoBit}$ are computed via interfaces to $\sf{AlterBBN}$, $\sf{CLASS}$, $\sf{DarkAges}$, $\sf{MontePython}$, $\sf{MultiModeCode}$, and $\sf{plc}$. This makes it possible to apply a wide range of constraints from large-scale structure, Type Ia supernovae, Big Bang Nucleosynthesis and the cosmic microwave background. Parameter scans can be performed using the many different statistical sampling algorithms available within the $\sf{GAMBIT}$ framework, and results can be combined with calculations from other $\sf{GAMBIT}$ modules focused on particle physics and dark matter. We include extensive validation plots and a first application to scenarios with non-standard relativistic degrees of freedom and neutrino temperature, showing that the corresponding constraint on the sum of neutrino masses is much weaker than in the standard scenario.

preprint2021arXiv

Nested sampling with plateaus

It was recently emphasised by Riley (2019); Schittenhelm & Wacker (2020) that that in the presence of plateaus in the likelihood function nested sampling (NS) produces faulty estimates of the evidence and posterior densities. After informally explaining the cause of the problem, we present a modified version of NS that handles plateaus and can be applied retrospectively to NS runs from popular NS software using anesthetic. In the modified NS, live points in a plateau are evicted one by one without replacement, with ordinary NS compression of the prior volume after each eviction but taking into account the dynamic number of live points. The live points are replenished once all points in the plateau are removed. We demonstrate it on a number of examples. Since the modification is simple, we propose that it becomes the canonical version of Skilling's NS algorithm.

preprint2021arXiv

Thermal WIMPs and the Scale of New Physics: Global Fits of Dirac Dark Matter Effective Field Theories

We assess the status of a wide class of WIMP dark matter (DM) models in light of the latest experimental results using the global fitting framework $\textsf{GAMBIT}$. We perform a global analysis of effective field theory (EFT) operators describing the interactions between a gauge-singlet Dirac fermion and the Standard Model quarks, the gluons and the photon. In this bottom-up approach, we simultaneously vary the coefficients of 14 such operators up to dimension 7, along with the DM mass, the scale of new physics and several nuisance parameters. Our likelihood functions include the latest data from $\mathit{Planck}$, direct and indirect detection experiments, and the LHC. For DM masses below 100 GeV, we find that it is impossible to satisfy all constraints simultaneously while maintaining EFT validity at LHC energies. For new physics scales around 1 TeV, our results are influenced by several small excesses in the LHC data and depend on the prescription that we adopt to ensure EFT validity. Furthermore, we find large regions of viable parameter space where the EFT is valid and the relic density can be reproduced, implying that WIMPs can still account for the DM of the universe while being consistent with the latest data.

preprint2020arXiv

Beyond the Runge-Kutta-Wentzel-Kramers-Brillouin method

We explore higher-dimensional generalizations of the Runge-Kutta-Wentzel-Kramers-Brillouin method for integrating coupled systems of first-order ordinary differential equations with highly oscillatory solutions. Such methods could improve the performance and adaptability of the codes which are used to compute numerical solutions to the Einstein-Boltzmann equations. We test Magnus expansion-based methods on the Einstein-Boltzmann equations for a simple universe model dominated by photons with a small amount of cold dark matter. The Magnus expansion methods achieve an increase in run speed of about 50% compared to a standard Runge-Kutta integration method. A comparison of approximate solutions derived from the Magnus expansion and the Wentzel-Kramers-Brillouin (WKB) method implies the two are distinct mathematical approaches. Simple Magnus expansion solutions show inferior long range accuracy compared to WKB. However we also demonstrate how one can improve on the standard Magnus approach to obtain a new "Jordan-Magnus" method. This has a WKB-like performance on simple two-dimensional systems, although its higher-dimensional generalization remains elusive.

preprint2020arXiv

Compromise-free Bayesian neural networks

We conduct a thorough analysis of the relationship between the out-of-sample performance and the Bayesian evidence (marginal likelihood) of Bayesian neural networks (BNNs), as well as looking at the performance of ensembles of BNNs, both using the Boston housing dataset. Using the state-of-the-art in nested sampling, we numerically sample the full (non-Gaussian and multimodal) network posterior and obtain numerical estimates of the Bayesian evidence, considering network models with up to 156 trainable parameters. The networks have between zero and four hidden layers, either $\tanh$ or $ReLU$ activation functions, and with and without hierarchical priors. The ensembles of BNNs are obtained by determining the posterior distribution over networks, from the posterior samples of individual BNNs re-weighted by the associated Bayesian evidence values. There is good correlation between out-of-sample performance and evidence, as well as a remarkable symmetry between the evidence versus model size and out-of-sample performance versus model size planes. Networks with $ReLU$ activation functions have consistently higher evidences than those with $\tanh$ functions, and this is reflected in their out-of-sample performance. Ensembling over architectures acts to further improve performance relative to the individual BNNs.

preprint2020arXiv

Nested sampling cross-checks using order statistics

Nested sampling (NS) is an invaluable tool in data analysis in modern astrophysics, cosmology, gravitational wave astronomy and particle physics. We identify a previously unused property of NS related to order statistics: the insertion indexes of new live points into the existing live points should be uniformly distributed. This observation enabled us to create a novel cross-check of single NS runs. The tests can detect when an NS run failed to sample new live points from the constrained prior and plateaus in the likelihood function, which break an assumption of NS and thus leads to unreliable results. We applied our cross-check to NS runs on toy functions with known analytic results in 2 - 50 dimensions, showing that our approach can detect problematic runs on a variety of likelihoods, settings and dimensions. As an example of a realistic application, we cross-checked NS runs performed in the context of cosmological model selection. Since the cross-check is simple, we recommend that it become a mandatory test for every applicable NS run.

preprint2020arXiv

Quantifying Ionospheric Effects on Global 21-cm Observations

We modelled the two major layer of Earth's ionosphere, the F-layer and the D-layer, by a simplified spatial model with temporal variance to study the chromatic ionospheric effects on global 21-cm observations. From the analyses, we found that the magnitude of the ionospheric disruptions due to ionospheric refraction and absorption can be greater than the expected global 21-cm signal, and the variation of its magnitude can differ, depending on the ionospheric conditions. Within the parameter space adopted in the model, the shape of the global 21-cm signal is distorted after propagating through the ionosphere, while its amplitude is weakened. It is observed that the ionospheric effects do not cancel out over time, and thus should be accounted for in the foreground calibration at each timestep to account for the chromaticity introduced by the ionosphere.

preprint2019arXiv

Curvature tension: evidence for a closed universe

The curvature parameter tension between Planck 2018, cosmic microwave background lensing, and baryon acoustic oscillation data is measured using the suspiciousness statistic to be 2.5 to 3$σ$. Conclusions regarding the spatial curvature of the universe which stem from the combination of these data should therefore be viewed with suspicion. Without CMB lensing or BAO, Planck 2018 has a moderate preference for closed universes, with Bayesian betting odds of over 50:1 against a flat universe, and over 2000:1 against an open universe.

preprint2019arXiv

Quantifying Suspiciousness Within Correlated Data Sets

We propose a principled Bayesian method for quantifying tension between correlated datasets with wide uninformative parameter priors. This is achieved by extending the Suspiciousness statistic, which is insensitive to priors. Our method uses global summary statistics, and as such it can be used as a diagnostic for internal consistency. We show how our approach can be combined with methods that use parameter space and data space to identify the existing internal discrepancies. As an example, we use it to test the internal consistency of the KiDS-450 data in 4 photometric redshift bins, and to recover controlled internal discrepancies in simulated KiDS data. We propose this as a diagnostic of internal consistency for present and future cosmological surveys, and as a tension metric for data sets that have non-negligible correlation, such as LSST and Euclid.