Source author record

Adrian Liu

Adrian Liu appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

41works
9topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

41 published item(s)

preprint2022arXiv

A galaxy-free phenomenological model for the 21-cm power spectrum during reionization

Upper limits from the current generation of interferometers targeting the 21-cm signal from high redshifts have recently begun to rule out physically realistic, though still extreme, models of the Epoch of Reionization (EoR). While inferring the detailed properties of the first galaxies is one of the most important motivations for measuring the high-$z$ 21-cm signal, they can also provide useful constraints on the properties of the intergalactic medium (IGM). Motivated by this, we build a simple, phenomenological model for the 21-cm power spectrum that works directly in terms of IGM properties, which bypasses the computationally expensive 3-D semi-numerical modeling generally employed in inference pipelines and avoids explicit assumptions about galaxy properties. The key simplifying assumptions are that (i) the ionization field is binary, and composed of spherical bubbles with an abundance described well by a parametric bubble size distribution, and (ii) that the spin temperature of the ``bulk'' IGM outside bubbles is uniform. Despite the simplicity of the model, the mean ionized fraction and spin temperature of the IGM recovered from mock 21-cm power spectra generated with \textsc{21cmfast} are generally in good agreement with the true input values. This suggests that it is possible to obtain comparable constraints on the IGM using models with very different assumptions, parameters, and priors. Our approach will thus be complementary to semi-numerical models as upper limits continue to improve in the coming years.

preprint2022arXiv

Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study with the Hydrogen Epoch of Reionization Array

We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets.

preprint2022arXiv

Joint constraints on reionization: a framework for combining the global 21cm signal and the kinetic Sunyaev-Zel'dovich effect

Recent measurements from the CMB and from high-redshift galaxy observations have placed rough constraints on the midpoint and duration of the Epoch of Reionization. Detailed measurements of the ionization history remain elusive, although two proposed probes show great promise for this purpose: the 21cm global signal and the kinetic Sunyaev-Zel'dovich (kSZ) effect. We formally confirm the common assumption that these two probes are highly complementary, with the kSZ being more sensitive to extended ionization histories and the global signal to rapidly evolving ones. We do so by performing a Karhunen-Loève (KL) transformation, which casts the data in a basis designed to emphasize the information content of each probe. We find that reconstructing the ionization history using both probes gives significantly more precise results than individual constraints, although carefully chosen, physically motivated priors play a crucial part in obtaining a bias-free reconstruction. Additionally, in the KL basis, measurements from one probe can be used to detect the presence of residual systematics in the other, providing a safeguard against systematics that would go undetected when data from each probe is analyzed in isolation. Once detected, the modes contaminated by systematics can be discarded from the data analysis to avoid biases in reconstruction.

preprint2022arXiv

Signatures of reionization feedback in the near-infrared background

The reionization of the intergalactic medium at redshifts $z\gtrsim 6$ is expected to have a lasting impact on galaxies residing in low-mass dark matter halos. Unable to accrete or retain gas photo-heated to temperatures $T \gtrsim 10^4$ K, the star formation histories of faint galaxies in the early Universe are expected to decline as they exhaust their gas supply, resulting in a turn-over in the galaxy luminosity function (LF) and a potential solution to the missing satellites problem in the local group. Unfortunately, there are several challenges to constraining `reionization feedback' empirically, most notably that galaxies in low-mass halos are intrinsically faint, and that there are other physical mechanisms capable of inducing a turn-over in the LF. In this work, we investigate a new signature of reionization feedback that is in principle distinct from other processes: as faint galaxies are quenched by reionization, their stellar populations passively age and grow redder while the brighter galaxies nearby continue to form stars at an increasing rate and so remain relatively blue. We find that this contrast, between quenched and un-quenched galaxies induces a scale and colour-dependent signature in the present-day near-infrared background comparable to the expected sensitivity of NASA's upcoming SPHEREx mission. Whereas models with pure mass suppression largely affect the signal at wavelengths $\lesssim 2 μ\rm{m}$, $\sim 5$%-level differences in the background persist out to $\sim 5 μ\rm{m}$ for reionization feedback models. Finally, the power spectra of intensity ratio maps exhibit larger variations, and may thus be a promising target for future analyses.

preprint2022arXiv

Snowmass2021 Cosmic Frontier White Paper: 21cm Radiation as a Probe of Physics Across Cosmic Ages

The 21cm line refers to a forbidden transition in neutral hydrogen associated with alignment of spins of the proton and electron. It is a very low energy transition that is emitted whenever there is neutral hydrogen in the Universe. Since baryons are mostly (~75%) hydrogen, one can in principle detect this emission throughout much of the history of the Universe. The dominant emission mechanism is different across cosmic ages. Before the photons decouple from matter, hydrogen is in an ionized state and does not emit in 21cm. After recombination and during the Dark Ages, at z ~ 30-1000, the 21cm emission is associated with density fluctuations in the neutral hydrogen medium. After the first stars turn on and galaxies begin to form, the 21cm emission traces bubbles of ionized hydrogen in the sea of the neutral medium. This epoch, spanning z ~ 6-30, is often referred to as cosmic dawn and the Epoch of Reionization (EoR). At redshifts below z<6, the intergalactic medium is largely ionized, but pockets of self-shielded neutral gas form in dense galactic environments and 21cm emission traces the distribution of galaxies. The vastly different emission mechanisms allow us to probe very different physics at different redshifts, corresponding to different observational frequencies. The instrumental challenges, namely building very sensitive and exquisitely calibrated radio telescopes, however, share many commonalities across frequency bands. The potential of the 21cm probe has been recognized by the Decadal Survey of Astronomy & Astrophysics, whose Panel on Cosmology identified the Dark Ages as its sole discovery area. We argue that HEP should recognize the potential of 21cm as a probe of fundamental physics across many axes and invest in the technology development that will enable full exploitation of this rich technique.

preprint2022arXiv

Towards Understanding How Machines Can Learn Causal Overhypotheses

Recent work in machine learning and cognitive science has suggested that understanding causal information is essential to the development of intelligence. The extensive literature in cognitive science using the ``blicket detector'' environment shows that children are adept at many kinds of causal inference and learning. We propose to adapt that environment for machine learning agents. One of the key challenges for current machine learning algorithms is modeling and understanding causal overhypotheses: transferable abstract hypotheses about sets of causal relationships. In contrast, even young children spontaneously learn and use causal overhypotheses. In this work, we present a new benchmark -- a flexible environment which allows for the evaluation of existing techniques under variable causal overhypotheses -- and demonstrate that many existing state-of-the-art methods have trouble generalizing in this environment. The code and resources for this benchmark are available at https://github.com/CannyLab/casual_overhypotheses.

preprint2021arXiv

First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum

We report upper-limits on the Epoch of Reionization (EoR) 21 cm power spectrum at redshifts 7.9 and 10.4 with 18 nights of data ($\sim36$ hours of integration) from Phase I of the Hydrogen Epoch of Reionization Array (HERA). The Phase I data show evidence for systematics that can be largely suppressed with systematic models down to a dynamic range of $\sim10^9$ with respect to the peak foreground power. This yields a 95% confidence upper limit on the 21 cm power spectrum of $Δ^2_{21} \le (30.76)^2\ {\rm mK}^2$ at $k=0.192\ h\ {\rm Mpc}^{-1}$ at $z=7.9$, and also $Δ^2_{21} \le (95.74)^2\ {\rm mK}^2$ at $k=0.256\ h\ {\rm Mpc}^{-1}$ at $z=10.4$. At $z=7.9$, these limits are the most sensitive to-date by over an order of magnitude. While we find evidence for residual systematics at low line-of-sight Fourier $k_\parallel$ modes, at high $k_\parallel$ modes we find our data to be largely consistent with thermal noise, an indicator that the system could benefit from deeper integrations. The observed systematics could be due to radio frequency interference, cable sub-reflections, or residual instrumental cross-coupling, and warrant further study. This analysis emphasizes algorithms that have minimal inherent signal loss, although we do perform a careful accounting in a companion paper of the small forms of loss or bias associated with the pipeline. Overall, these results are a promising first step in the development of a tuned, instrument-specific analysis pipeline for HERA, particularly as Phase II construction is completed en route to reaching the full sensitivity of the experiment.

preprint2021arXiv

Validation of the HERA Phase I Epoch of Reionization 21 cm Power Spectrum Software Pipeline

We describe the validation of the HERA Phase I software pipeline by a series of modular tests, building up to an end-to-end simulation. The philosophy of this approach is to validate the software and algorithms used in the Phase I upper limit analysis on wholly synthetic data satisfying the assumptions of that analysis, not addressing whether the actual data meet these assumptions. We discuss the organization of this validation approach, the specific modular tests performed, and the construction of the end-to-end simulations. We explicitly discuss the limitations in scope of the current simulation effort. With mock visibility data generated from a known analytic power spectrum and a wide range of realistic instrumental effects and foregrounds, we demonstrate that the current pipeline produces power spectrum estimates that are consistent with known analytic inputs to within thermal noise levels (at the 2 sigma level) for k > 0.2 h/Mpc for both bands and fields considered. Our input spectrum is intentionally amplified to enable a strong `detection' at k ~0.2 h/Mpc -- at the level of ~25 sigma -- with foregrounds dominating on larger scales, and thermal noise dominating at smaller scales. Our pipeline is able to detect this amplified input signal after suppressing foregrounds with a dynamic range (foreground to noise ratio) of > 10^7. Our validation test suite uncovered several sources of scale-independent signal loss throughout the pipeline, whose amplitude is well-characterized and accounted for in the final estimates. We conclude with a discussion of the steps required for the next round of data analysis.

preprint2020arXiv

Absolute Calibration Strategies for the Hydrogen Epoch of Reionization Array and Their Impact on the 21 cm Power Spectrum

We discuss absolute calibration strategies for Phase I of the Hydrogen Epoch of Reionization Array (HERA), which aims to measure the cosmological 21 cm signal from the Epoch of Reionization (EoR). HERA is a drift-scan array with a 10 degree wide field of view, meaning bright, well-characterized point source transits are scarce. This, combined with HERA's redundant sampling of the uv plane and the modest angular resolution of the Phase I instrument, make traditional sky-based and self-calibration techniques difficult to implement with high dynamic range. Nonetheless, in this work we demonstrate calibration for HERA using point source catalogues and electromagnetic simulations of its primary beam. We show that unmodeled diffuse flux and instrumental contaminants can corrupt the gain solutions, and present a gain smoothing approach for mitigating their impact on the 21 cm power spectrum. We also demonstrate a hybrid sky and redundant calibration scheme and compare it to pure sky-based calibration, showing only a marginal improvement to the gain solutions at intermediate delay scales. Our work suggests that the HERA Phase I system can be well-calibrated for a foreground-avoidance power spectrum estimator by applying direction-independent gains with a small set of degrees of freedom across the frequency and time axes.

preprint2020arXiv

Detection of Cosmic Structures using the Bispectrum Phase. II. First Results from Application to Cosmic Reionization Using the Hydrogen Epoch of Reionization Array

Characterizing the epoch of reionization (EoR) at $z\gtrsim 6$ via the redshifted 21 cm line of neutral Hydrogen (HI) is critical to modern astrophysics and cosmology, and thus a key science goal of many current and planned low-frequency radio telescopes. The primary challenge to detecting this signal is the overwhelmingly bright foreground emission at these frequencies, placing stringent requirements on the knowledge of the instruments and inaccuracies in analyses. Results from these experiments have largely been limited not by thermal sensitivity but by systematics, particularly caused by the inability to calibrate the instrument to high accuracy. The interferometric bispectrum phase is immune to antenna-based calibration and errors therein, and presents an independent alternative to detect the EoR HI fluctuations while largely avoiding calibration systematics. Here, we provide a demonstration of this technique on a subset of data from the Hydrogen Epoch of Reionization Array (HERA) to place approximate constraints on the brightness temperature of the intergalactic medium (IGM). From this limited data, at $z=7.7$ we infer "$1σ$" upper limits on the IGM brightness temperature to be $\le 316$ "pseudo" mK at $κ_\parallel=0.33$ "pseudo" $h$ Mpc$^{-1}$ (data-limited) and $\le 1000$ "pseudo" mK at $κ_\parallel=0.875$ "pseudo" $h$ Mpc$^{-1}$ (noise-limited). The "pseudo" units denote only an approximate and not an exact correspondence to the actual distance scales and brightness temperatures. By propagating models in parallel to the data analysis, we confirm that the dynamic range required to separate the cosmic HI signal from the foregrounds is similar to that in standard approaches, and the power spectrum of the bispectrum phase is still data-limited (at $\gtrsim 10^6$ dynamic range) indicating scope for further improvement in sensitivity as the array build-out continues.

preprint2020arXiv

Foreground modelling via Gaussian process regression: an application to HERA data

The key challenge in the observation of the redshifted 21-cm signal from cosmic reionization is its separation from the much brighter foreground emission. Such separation relies on the different spectral properties of the two components, although, in real life, the foreground intrinsic spectrum is often corrupted by the instrumental response, inducing systematic effects that can further jeopardize the measurement of the 21-cm signal. In this paper, we use Gaussian Process Regression to model both foreground emission and instrumental systematics in $\sim 2$ hours of data from the Hydrogen Epoch of Reionization Array. We find that a simple co-variance model with three components matches the data well, giving a residual power spectrum with white noise properties. These consist of an "intrinsic" and instrumentally corrupted component with a coherence-scale of 20 MHz and 2.4 MHz respectively (dominating the line of sight power spectrum over scales $k_{\parallel} \le 0.2$ h cMpc$^{-1}$) and a baseline dependent periodic signal with a period of $\sim 1$ MHz (dominating over $k_{\parallel} \sim 0.4 - 0.8$h cMpc$^{-1}$) which should be distinguishable from the 21-cm EoR signal whose typical coherence-scales is $\sim 0.8$ MHz.

preprint2020arXiv

Measuring HERA's primary beam in-situ: methodology and first results

The central challenge in 21~cm cosmology is isolating the cosmological signal from bright foregrounds. Many separation techniques rely on the accurate knowledge of the sky and the instrumental response, including the antenna primary beam. For drift-scan telescopes such as the Hydrogen Epoch of Reionization Array \citep[HERA, ][]{DeBoer2017} that do not move, primary beam characterization is particularly challenging because standard beam-calibration routines do not apply \citep{Cornwell2005} and current techniques require accurate source catalogs at the telescope resolution. We present an extension of the method from \citet{Pober2012} where they use beam symmetries to create a network of overlapping source tracks that break the degeneracy between source flux density and beam response and allow their simultaneous estimation. We fit the beam response of our instrument using early HERA observations and find that our results agree well with electromagnetic simulations down to a -20~dB level in power relative to peak gain for sources with high signal-to-noise ratio. In addition, we construct a source catalog with 90 sources down to a flux density of 1.4~Jy at 151~MHz.

preprint2020arXiv

Packed Ultra-wideband Mapping Array (PUMA): Astro2020 RFI Response

The Packed Ultra-wideband Mapping Array (PUMA) is a proposed low-resolution transit interferometric radio telescope operating over the frequency range 200 - 1100MHz. Its rich science portfolio will include measuring structure in the universe from redshift z = 0.3 to 6 using 21cm intensity mapping, detecting one million fast radio bursts, and monitoring thousands of pulsars. It will allow PUMA to advance science in three different areas of physics (the physics of dark energy, the physics of cosmic inflation and time-domain astrophysics). This document is a response to a request for information (RFI) by the Panel on Radio, Millimeter, and Submillimeter Observations from the Ground (RMS) of the Decadal Survey on Astronomy and Astrophysics 2020. We present the science case of PUMA, the development path and major risks to the project.

preprint2019arXiv

Canada and the SKA from 2020-2030

This white paper submitted for the 2020 Canadian Long-Range Planning process (LRP2020) presents the prospects for Canada and the Square Kilometre Array (SKA) from 2020-2030, focussing on the first phase of the project (SKA1) scheduled to begin construction early in the next decade. SKA1 will make transformational advances in our understanding of the Universe across a wide range of fields, and Canadians are poised to play leadership roles in several. Canadian key SKA technologies will ensure a good return on capital investment in addition to strong scientific returns, positioning Canadian astronomy for future opportunities well beyond 2030. We therefore advocate for Canada's continued scientific and technological engagement in the SKA from 2020-2030 through participation in the construction and operations phases of SKA1.

preprint2019arXiv

Data Analysis for Precision 21 cm Cosmology

The redshifted 21 cm line is an emerging tool in cosmology, in principle permitting three-dimensional surveys of our Universe that reach unprecedentedly large volumes, previously inaccessible length scales, and hitherto unexplored epochs of our cosmic timeline. Large radio telescopes have been constructed for this purpose, and in recent years there has been considerable progress in transforming 21 cm cosmology from a field of considerable theoretical promise to one of observational reality. Increasingly, practitioners in the field are coming to the realization that the success of observational 21cm cosmology will hinge on software algorithms and analysis pipelines just as much as it does on careful hardware design and telescope construction. This review provides a pedagogical introduction to state-of-the-art ideas in 21 cm data analysis, covering a wide variety of steps in a typical analysis pipeline, from calibration to foreground subtraction to mapmaking to power spectrum estimation to parameter estimation.

preprint2019arXiv

High-redshift 21cm Cosmology in Canada

In the next few years, the 21cm line will enable direct observations of the Dark Ages, Cosmic Dawn, and Reionization, which represent previously unexplored periods in our cosmic history. With a combination of sky-averaged global signal measurements and spatial mapping surveys, the possible science return is enormous. This potentially includes (but is not limited to) constraints on first-generation galaxies (such as their typical masses and luminosities), constraints on cosmological parameters, a measurement of the Hubble parameter at z~15 to 20, the elimination of the optical depth nuisance parameter in the CMB, and searches for exotic phenomena such as baryon-dark matter couplings. To enable continued Canadian leadership in these science opportunities, we recommend 1) continued investments in 21cm experiments at all redshifts, 2) detailed analysis efforts of current data to overcome systematic effects, 3) new investments in preliminary experiments to explore the truly low-frequency sky as a stepping stone towards the Dark Ages, 4) new investments in line-intensity mapping experiments beyond the 21cm line, 5) continued theory support for 21cm cosmology, and 6) continued participation and knowledge transfer to next-generation international efforts such as the Square Kilometre Array.

preprint2019arXiv

Low-redshift 21cm Cosmology in Canada

Line-intensity mapping of the 21cm line is a powerful probe of large scale structure at z<6, tracing large-scale structure via neutral hydrogen content that is found within galaxies. In principle, it enables cost-efficient surveys of the matter distribution up to z~6, unlocking orders of magnitude more modes for observational cosmology. Canada has been a traditional leader in this field, having led the first detections of the cosmological 21cm signal via cross-correlations with optical galaxy surveys and having constructed the Canadian Hydrogen Intensity Mapping Experiment (CHIME). The field is now entering a new era where data is abundant, allowing studies in how to overcome systematics to be tackled in an empirical, head-on fashion. In the next few years, this will produce the first detection of the 21cm auto power spectrum, which will pave the way towards a large suite of scientific possibilities. These potentially include precision measurements on the dark energy equation of state and other LCDM parameters, constraints on how HI mass traces dark matter, a detection of neutrino effects on large-scale structure, and the use of 21cm lensing to further constrain cosmology. To turn these promising directions into reality, we recommend a sustained program of investment in 21cm cosmology, starting with funding for the Canadian Hydrogen Observatory and Radio transient Detector (CHORD), followed by small-scale development efforts targeting next-generation hardware and sustained support for theory and technical staff support. Additionally, Canada should invest in complementary line-intensity mapping efforts (such as with CO or [CII] lines) and maintain participation in next-generation international efforts such as the Packed Ultra-wideband Mapping Array (PUMA) and the Square Kilometre Array (SKA).

preprint2019arXiv

LRP2020: Astrostatistics in Canada

(Abridged from Executive Summary) This white paper focuses on the interdisciplinary fields of astrostatistics and astroinformatics, in which modern statistical and computational methods are applied to and developed for astronomical data. Astrostatistics and astroinformatics have grown dramatically in the past ten years, with international organizations, societies, conferences, workshops, and summer schools becoming the norm. Canada's formal role in astrostatistics and astroinformatics has been relatively limited, but there is a great opportunity and necessity for growth in this area. We conducted a survey of astronomers in Canada to gain information on the training mechanisms through which we learn statistical methods and to identify areas for improvement. In general, the results of our survey indicate that while astronomers see statistical methods as critically important for their research, they lack focused training in this area and wish they had received more formal training during all stages of education and professional development. These findings inform our recommendations for the LRP2020 on how to increase interdisciplinary connections between astronomy and statistics at the institutional, national, and international levels over the next ten years. We recommend specific, actionable ways to increase these connections, and discuss how interdisciplinary work can benefit not only research but also astronomy's role in training Highly Qualified Personnel (HQP) in Canada.

preprint2019arXiv

Mitigating Internal Instrument Coupling II: A Method Demonstration with the Hydrogen Epoch of Reionization Array

We present a study of internal reflection and cross coupling systematics in Phase I of the Hydrogen Epoch of Reionization Array (HERA). In a companion paper, we outlined the mathematical formalism for such systematics and presented algorithms for modeling and removing them from the data. In this work, we apply these techniques to data from HERA's first observing season as a method demonstration. The data show evidence for systematics that, without removal, would hinder a detection of the 21 cm power spectrum for the targeted EoR line-of-sight modes in the range 0.2 < k_parallel < 0.5\ h^-1 Mpc. After systematic removal, we find we can recover these modes in the power spectrum down to the integrated noise-floor of a nightly observation, achieving a dynamic range in the EoR window of 10^-6 in power (mK^2 units) with respect to the bright galactic foreground signal. In the absence of other systematics and assuming the systematic suppression demonstrated here continues to lower noise levels, our results suggest that fully-integrated HERA Phase I may have the capacity to set competitive upper limits on the 21 cm power spectrum. For future observing seasons, HERA will have upgraded analog and digital hardware to better control these systematics in the field.

preprint2016arXiv

Constraining cosmology and ionization history with combined 21 cm power spectrum and global signal measurements

Improvements in current instruments and the advent of next-generation instruments will soon push observational 21 cm cosmology into a new era, with high significance measurements of both the power spectrum and the mean ("global") signal of the 21 cm brightness temperature. In this paper we use the recently commenced Hydrogen Epoch of Reionization Array as a worked example to provide forecasts on astrophysical and cosmological parameter constraints. In doing so we improve upon previous forecasts in a number of ways. First, we provide updated forecasts using the latest best-fit cosmological parameters from the Planck satellite, exploring the impact of different Planck datasets on 21 cm experiments. We also show that despite the exquisite constraints that other probes have placed on cosmological parameters, the remaining uncertainties are still large enough to have a non-negligible impact on upcoming 21 cm data analyses. While this complicates high-precision constraints on reionization models, it provides an avenue for 21 cm reionization measurements to constrain cosmology. We additionally forecast HERA's ability to measure the ionization history using a combination of power spectrum measurements and semi-analytic simulations. Finally, we consider ways in which 21 cm global signal and power spectrum measurements can be combined, and propose a method by which power spectrum results can be used to train a compact parameterization of the global signal. This parameterization reduces the number of parameters needed to describe the global signal, increasing the likelihood of a high significance measurement.

preprint2016arXiv

Constraining High Redshift X-ray Sources with Next Generation 21 cm Power Spectrum Measurements

We use the Fisher matrix formalism and semi-numerical simulations to derive quantitative predictions of the constraints that power spectrum measurements on next-generation interferometers, such as the Hydrogen Epoch of Reionization Array (HERA) and the Square Kilometre Array (SKA), will place on the characteristics of the X-ray sources that heated the high redshift intergalactic medium. Incorporating observations between $z=5$ and $z=25$, we find that the proposed 331 element HERA and SKA phase 1 will be capable of placing $\lesssim 10\%$ constraints on the spectral properties of these first X-ray sources, even if one is unable to perform measurements within the foreground contaminated "wedge" or the FM band. When accounting for the enhancement in power spectrum amplitude from spin temperature fluctuations, we find that the observable signatures of reionization extend well beyond the peak in the power spectrum usually associated with it. We also find that lower redshift degeneracies between the signatures of heating and reionization physics lead to errors on reionization parameters that are significantly greater than previously predicted. Observations over the heating epoch are able to break these degeneracies and improve our constraints considerably. For these two reasons, 21\,cm observations during the heating epoch significantly enhance our understanding of reionization as well.

preprint2016arXiv

Eliminating the optical depth nuisance from the CMB with 21 cm cosmology

Amongst standard model parameters that are constrained by cosmic microwave background (CMB) observations, the optical depth $τ$ stands out as a nuisance parameter. While $τ$ provides some crude limits on reionization, it also degrades constraints on other cosmological parameters. Here we explore how 21 cm cosmology---as a direct probe of reionization---can be used to independently predict $τ$ in an effort to improve CMB parameter constraints. We develop two complementary schemes for doing so. The first uses 21 cm power spectrum observations in conjunction with semi-analytic simulations to predict $τ$. The other uses global 21 cm measurements to directly constrain low redshift (post-reheating) contributions to $τ$ in a relatively model-independent way. Forecasting the performance of the upcoming Hydrogen Epoch of Reionization Array, we find that significant reductions in the errors on $τ$ can be achieved. These results are particularly effective at breaking the CMB degeneracy between $τ$ and the amplitude of the primordial fluctuation spectrum $A_s$, with errors on $\ln (10^{10} A_s)$ reduced by up to a factor of four. Stage 4 CMB constraints on the neutrino mass sum are also improved, with errors potentially reduced to $12\,\textrm{meV}$ regardless of whether CMB experiments can precisely measure the reionization bump in polarization power spectra. Observations of the 21 cm line are therefore capable of improving not only our understanding of reionization astrophysics, but also of cosmology in general.

preprint2016arXiv

Optimized Beam Sculpting with Generalized Fringe-Rate Filters

We generalize the technique of fringe-rate filtering, whereby visibilities measured by a radio interferometer are re-weighted according to their temporal variation. As the Earth rotates, radio sources traverse through an interferometer's fringe pattern at rates that depend on their position on the sky. Capitalizing on this geometric interpretation of fringe rates, we employ time-domain convolution kernels to enact fringe-rate filters that sculpt the effective primary beam of antennas in an interferometer. As we show, beam sculpting through fringe-rate filtering can be used to optimize measurements for a variety of applications, including mapmaking, minimizing polarization leakage, suppressing instrumental systematics, and enhancing the sensitivity of power-spectrum measurements. We show that fringe-rate filtering arises naturally in minimum variance treatments of many of these problems, enabling optimal visibility-based approaches to analyses of interferometric data that avoid systematics potentially introduced by traditional approaches such as imaging. Our techniques have recently been demonstrated in Ali et al. (2015), where new upper limits were placed on the 21 cm power spectrum from reionization, showcasing the ability of fringe-rate filtering to successfully boost sensitivity and reduce the impact of systematics in deep observations.

preprint2016arXiv

Spherical Harmonic Analyses of Intensity Mapping Power Spectra

Intensity mapping is a promising technique for surveying the large scale structure of our Universe from $z=0$ to $z \sim 150$, using the brightness temperature field of spectral lines to directly observe previously unexplored portions of out cosmic timeline. Examples of targeted lines include the $21\,\textrm{cm}$ hyperfine transition of neutral hydrogen, rotational lines of carbon monoxide, and fine structure lines of singly ionized carbon. Recent efforts have focused on detections of the power spectrum of spatial fluctuations, but have been hindered by systematics such as foreground contamination. This has motivated the decomposition of data into Fourier modes perpendicular and parallel to the line-of-sight, which has been shown to be a particularly powerful way to diagnose systematics. However, such a method is well-defined only in the limit of a narrow-field, flat-sky approximation. This limits the sensitivity of intensity mapping experiments, as it means that wide surveys must be separately analyzed as a patchwork of smaller fields. In this paper, we develop a framework for analyzing intensity mapping data in a spherical Fourier-Bessel basis, which incorporates curved sky effects without difficulty. We use our framework to generalize a number of techniques in intensity mapping data analysis from the flat sky to the curved sky. These include visibility-based estimators for the power spectrum, treatments of interloper lines, and the "foreground wedge" signature of spectrally smooth foregrounds.

preprint2015arXiv

Mapmaking for Precision 21 cm Cosmology

In order to study the "Cosmic Dawn" and the Epoch of Reionization with 21 cm tomography, we need to statistically separate the cosmological signal from foregrounds known to be orders of magnitude brighter. Over the last few years, we have learned much about the role our telescopes play in creating a putatively foreground-free region called the "EoR window." In this work, we examine how an interferometer's effects can be taken into account in a way that allows for the rigorous estimation of 21 cm power spectra from interferometric maps while mitigating foreground contamination and thus increasing sensitivity. This requires a precise understanding of the statistical relationship between the maps we make and the underlying true sky. While some of these calculations would be computationally infeasible if performed exactly, we explore several well-controlled approximations that make mapmaking and the calculation of map statistics much faster, especially for compact and highly redundant interferometers designed specifically for 21 cm cosmology. We demonstrate the utility of these methods and the parametrized trade-offs between accuracy and speed using one such telescope, the upcoming Hydrogen Epoch of Reionization Array, as a case study.

preprint2015arXiv

Measuring the Cosmological 21 cm Monopole with an Interferometer

A measurement of the cosmological 21 cm signal remains a promising but as-of-yet unattained ambition of radio astronomy. A positive detection would provide direct observations of key unexplored epochs of our cosmic history, including the cosmic dark ages and reionization. In this paper, we concentrate on measurements of the spatial monopole of the 21 cm brightness temperature as a function of redshift (the "global signal"). Most global experiments to date have been single-element experiments. In this paper, we show how an interferometer can be designed to be sensitive to the monopole mode of the sky, thus providing an alternate approach to accessing the global signature. We provide simple rules of thumb for designing a global signal interferometer and use numerical simulations to show that a modest array of tightly packed antenna elements with moderately sized primary beams (full-width-half-max of $\sim$40$^\circ$) can compete with typical single-element experiments in their ability to constrain phenomenological parameters pertaining to reionization and the pre-reionization era. We also provide a general data analysis framework for extracting the global signal from interferometric measurements (with analysis of single-element experiments arising as a special case) and discuss trade-offs with various data analysis choices. Given that interferometric measurements are able to avoid a number of systematics inherent in single-element experiments, our results suggest that interferometry ought to be explored as a complementary way to probe the global signal.

preprint2015arXiv

PAPER-64 Constraints On Reionization II: The Temperature Of The z=8.4 Intergalactic Medium

We present constraints on both the kinetic temperature of the intergalactic medium (IGM) at z=8.4, and on models for heating the IGM at high-redshift with X-ray emission from the first collapsed objects. These constraints are derived using a semi-analytic method to explore the new measurements of the 21 cm power spectrum from the Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER), which were presented in a companion paper, Ali et al. (2015). Twenty-one cm power spectra with amplitudes of hundreds of mK^2 can be generically produced if the kinetic temperature of the IGM is significantly below the temperature of the Cosmic Microwave Background (CMB); as such, the new results from PAPER place lower limits on the IGM temperature at z=8.4. Allowing for the unknown ionization state of the IGM, our measurements find the IGM temperature to be above ~5 K for neutral fractions between 10% and 85%, above ~7 K for neutral fractions between 15% and 80%, or above ~10 K for neutral fractions between 30% and 70%. We also calculate the heating of the IGM that would be provided by the observed high redshift galaxy population, and find that for most models, these galaxies are sufficient to bring the IGM temperature above our lower limits. However, there are significant ranges of parameter space that could produce a signal ruled out by the PAPER measurements; models with a steep drop-off in the star formation rate density at high redshifts or with relatively low values for the X-ray to star formation rate efficiency of high redshift galaxies are generally disfavored. The PAPER measurements are consistent with (but do not constrain) a hydrogen spin temperature above the CMB temperature, a situation which we find to be generally predicted if galaxies fainter than the current detection limits of optical/NIR surveys are included in calculations of X-ray heating.

preprint2014arXiv

Erasing the variable: Empirical foreground discovery for global 21 cm spectrum experiments

Spectral measurements of the 21 cm monopole background have the promise of revealing the bulk energetic properties and ionization state of our universe from z ~ 6-30. Synchrotron foregrounds are orders of magnitude larger than the cosmological signal, and are the principal challenge faced by these experiments. While synchrotron radiation is thought to be spectrally smooth and described by relatively few degrees of freedom, the instrumental response to bright foregrounds may be much more complex. To deal with such complexities, we develop an approach that discovers contaminated spectral modes using spatial fluctuations of the measured data. This approach exploits the fact that foregrounds vary across the sky while the signal does not. The discovered modes are projected out of each line-of-sight of a data cube. An angular weighting then optimizes the cosmological signal amplitude estimate by giving preference to lower-noise regions. Using this method, we show that it is essential for the passband to be stable to at least ~10^{-4}. In contrast, the constraints on the spectral smoothness of the absolute calibration are mainly aesthetic if one is able to take advantage of spatial information. To the extent it is understood, controlling polarization to intensity leakage at the ~10^{-2} level will also be essential to rejecting Faraday rotation of the polarized synchrotron emission.

preprint2014arXiv

MITEoR: A Scalable Interferometer for Precision 21 cm Cosmology

We report on the MIT Epoch of Reionization (MITEoR) experiment, a pathfinder low-frequency radio interferometer whose goal is to test technologies that improve the calibration precision and reduce the cost of the high-sensitivity 3D mapping required for 21 cm cosmology. MITEoR accomplishes this by using massive baseline redundancy, which enables both automated precision calibration and correlator cost reduction. We demonstrate and quantify the power and robustness of redundancy for scalability and precision. We find that the calibration parameters precisely describe the effect of the instrument upon our measurements, allowing us to form a model that is consistent with $χ^2$ per degree of freedom < 1.2 for as much as 80% of the observations. We use these results to develop an optimal estimator of calibration parameters using Wiener filtering, and explore the question of how often and how finely in frequency visibilities must be reliably measured to solve for calibration coefficients. The success of MITEoR with its 64 dual-polarization elements bodes well for the more ambitious Hydrogen Epoch of Reionization Array (HERA) project and other next-generation instruments, which would incorporate many identical or similar technologies.

preprint2014arXiv

Multi-redshift limits on the 21cm power spectrum from PAPER

The epoch of reionization power spectrum is expected to evolve strongly with redshift, and it is this variation with cosmic history that will allow us to begin to place constraints on the physics of reionization. The primary obstacle to the measurement of the EoR power spectrum is bright foreground emission. We present an analysis of observations from the Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER) telescope which place new limits on the HI power spectrum over the redshift range of $7.5<z<10.5$, extending previously published single redshift results to cover the full range accessible to the instrument. To suppress foregrounds, we use filtering techniques that take advantage of the large instrumental bandwidth to isolate and suppress foreground leakage into the interesting regions of $k$-space. Our 500 hour integration is the longest such yet recorded and demonstrates this method to a dynamic range of $10^4$. Power spectra at different points across the redshift range reveal the variable efficacy of the foreground isolation. Noise limited measurements of $Δ^2$ at $k=$0.2hMpc$^{-1}$ and z$=7.55$ reach as low as (48mK)$^2$ ($1σ$). We demonstrate that the size of the error bars in our power spectrum measurement as generated by a bootstrap method is consistent with the fluctuations due to thermal noise. Relative to this thermal noise, most spectra exhibit an excess of power at a few sigma. The likely sources of this excess include residual foreground leakage, particularly at the highest redshift, and unflagged RFI. We conclude by discussing data reduction improvements that promise to remove much of this excess.

preprint2014arXiv

New Limits on 21cm EoR From PAPER-32 Consistent with an X-Ray Heated IGM at z=7.7

We present new constraints on the 21cm Epoch of Reionization (EoR) power spectrum derived from 3 months of observing with a 32-antenna, dual-polarization deployment of the Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER) in South Africa. In this paper, we demonstrate the efficacy of the delay-spectrum approach to avoiding foregrounds, achieving over 8 orders of magnitude of foreground suppression (in $\textrm{mK}^2$). Combining this approach with a procedure for removing off-diagonal covariances arising from instrumental systematics, we achieve a best 2-sigma upper limit of $(41\,\textrm{mK})^2$ for $k=0.27 h\textrm{Mpc}^{-1}$ at $z=7.7$. This limit falls within an order of magnitude of the brighter predictions of the expected 21cm EoR signal level. Using the upper limits set by these measurements, we generate new constraints on the brightness temperature of 21cm emission in neutral regions for various reionization models. We show that for several ionization scenarios, our measurements are inconsistent with cold reionization. That is, heating of the neutral intergalactic medium (IGM) is necessary to remain consistent with the constraints we report. Hence, we have suggestive evidence that by $z=7.7$, the HI has been warmed from its cold primordial state, probably by X-rays from high-mass X-ray binaries or mini-quasars. The strength of this evidence depends on the ionization state of the IGM, which we are not yet able to constrain. This result is consistent with standard predictions for how reionization might have proceeded.

preprint2014arXiv

Overcoming real-world obstacles in 21 cm power spectrum estimation: A method demonstration and results from early Murchison Widefield Array data

We present techniques for bridging the gap between idealized inverse covariance weighted quadratic estimation of 21 cm power spectra and the real-world challenges presented universally by interferometric observation. By carefully evaluating various estimators and adapting our techniques for large but incomplete data sets, we develop a robust power spectrum estimation framework that preserves the so-called "EoR window" and keeps track of estimator errors and covariances. We apply our method to observations from the 32-tile prototype of the Murchinson Widefield Array to demonstrate the importance of a judicious analysis technique. Lastly, we apply our method to investigate the dependence of the clean EoR window on frequency--especially the frequency dependence of the so-called "wedge" feature--and establish upper limits on the power spectrum from z = 6.2 to z = 11.7. Our lowest limit is Delta(k) < 0.3 Kelvin at 95% confidence at a comoving scale k = 0.046 Mpc^-1 and z = 9.5.

preprint2014arXiv

The Epoch of Reionization Window: I. Mathematical Formalism

The 21 cm line provides a powerful probe of astrophysics and cosmology at high redshifts, but unlocking the potential of this probe requires the robust mitigation of foreground contaminants that are typically several orders of magnitude brighter than the cosmological signal. Recent simulations and observations have shown that the smooth spectral structure of foregrounds combines with instrument chromaticity to contaminate a "wedge"-shaped region in cylindrical Fourier space. While previous efforts have explored the suppression of foregrounds within this wedge, as well as the avoidance of this highly contaminated region, all such efforts have neglected a rigorous examination of the error statistics associated with the wedge. Using a quadratic estimator formalism applied to the interferometric measurement equation, we provide a framework for such a rigorous analysis (incorporating a fully covariant treatment of errors). Additionally, we find that there are strong error correlations at high spatial wavenumbers that have so far been neglected in sensitivity derivations. These error correlations substantially degrade the sensitivity of arrays relying on contributions from long baselines, compared to what one would estimate assuming uncorrelated errors.

preprint2014arXiv

The Epoch of Reionization Window: II. Statistical Methods for Foreground Wedge Reduction

For there to be a successful measurement of the 21 cm Epoch of Reionization (EoR) power spectrum, it is crucial that strong foreground contaminants be robustly suppressed. These foregrounds come from a variety of sources (such as Galactic synchrotron emission and extragalactic point sources), but almost all share the property of being spectrally smooth, and when viewed through the chromatic response of an interferometer, occupy a signature "wedge" region in cylindrical $k_\perp k_\parallel$ Fourier space. The complement of the foreground wedge is termed the "EoR window", and is expected to be mostly foreground-free, allowing clean measurements of the power spectrum. This paper is a sequel to a previous paper that established a rigorous mathematical framework for describing the foreground wedge and the EoR window. Here, we use our framework to explore statistical methods by which the EoR window can be enlarged, thereby increasing the sensitivity of a power spectrum measurement. We adapt the FKP approximation (commonly used in galaxy surveys) for 21 cm cosmology, and also compare the optimal quadratic estimator to simpler estimators that ignore covariances between different Fourier modes. The optimal quadratic estimator is found to suppress foregrounds by an extra factor of $\sim 10^5$ in power at the peripheries of the EoR window, boosting the detection of the cosmological signal from $12σ$ to $50σ$ at the midpoint of reionization in our fiducial models. If numerical issues can be finessed, decorrelation techniques allow the EoR window to be further enlarged, enabling measurements to be made deep within the foreground wedge. These techniques do not assume that foreground are Gaussian-distributed, and we additionally prove that a final round of foreground subtraction can be performed after decorrelation in a way that is guaranteed to have no cosmological signal loss.

preprint2014arXiv

What Next-Generation 21 cm Power Spectrum Measurements Can Teach Us About the Epoch of Reionization

A number of experiments are currently working towards a measurement of the 21 cm signal from the Epoch of Reionization. Whether or not these experiments deliver a detection of cosmological emission, their limited sensitivity will prevent them from providing detailed information about the astrophysics of reionization. In this work, we consider what types of measurements will be enabled by a next-generation of larger 21 cm EoR telescopes. To calculate the type of constraints that will be possible with such arrays, we use simple models for the instrument, foreground emission, and the reionization history. We focus primarily on an instrument modeled after the $\sim 0.1~\rm{km}^2$ collecting area Hydrogen Epoch of Reionization Array (HERA) concept design, and parameterize the uncertainties with regard to foreground emission by considering different limits to the recently described "wedge" footprint in k-space. Uncertainties in the reionization history are accounted for using a series of simulations which vary the ionizing efficiency and minimum virial temperature of the galaxies responsible for reionization, as well as the mean free path of ionizing photons through the IGM. Given various combinations of models, we consider the significance of the possible power spectrum detections, the ability to trace the power spectrum evolution versus redshift, the detectability of salient power spectrum features, and the achievable level of quantitative constraints on astrophysical parameters. Ultimately, we find that $0.1~\rm{km}^2$ of collecting area is enough to ensure a very high significance ($\gtrsim30σ$) detection of the reionization power spectrum in even the most pessimistic scenarios. This sensitivity should allow for meaningful constraints on the reionization history and astrophysical parameters, especially if foreground subtraction techniques can be improved and successfully implemented.

preprint2013arXiv

A Fast Method for Power Spectrum and Foreground Analysis for 21 cm Cosmology

We develop and demonstrate an acceleration of the Liu & Tegmark quadratic estimator formalism for inverse variance foreground subtraction and power spectrum estimation in 21 cm tomography from O(N^3) to O(N log N), where N is the number of voxels of data. This technique makes feasible the megavoxel scale analysis necessary for current and upcoming radio interferometers by making only moderately restrictive assumptions about foreground models and survey geometry. We exploit iterative and Monte Carlo techniques and the symmetries of the foreground covariance matrices to quickly estimate the 21 cm brightness temperature power spectrum, P(k_parallel, k_perpendicular), the Fisher information matrix, the error bars, the window functions, and the bias. We also extend the Liu & Tegmark foreground model to include bright point sources with known positions in a way that scales as O[(N log N)(N point sources)] < O(N^5/3). As a first application of our method, we forecast error bars and window functions for the upcoming 128-tile deployment of the Murchinson Widefield Array, showing that 1000 hours of observation should prove sufficiently sensitive to detect the power spectrum signal from the Epoch of Reionization.

preprint2013arXiv

Global 21cm signal experiments: A designer's guide

[Abridged] The spatially averaged global spectrum of the redshifted 21cm line has generated much experimental interest, for it is potentially a direct probe of the Epoch of Reionization and the Dark Ages. Since the cosmological signal here has a purely spectral signature, most proposed experiments have little angular sensitivity. This is worrisome because with only spectra, the global 21cm signal can be difficult to distinguish from foregrounds such as Galactic synchrotron radiation, as both are spectrally smooth and the latter is orders of magnitude brighter. We establish a mathematical framework for global signal data analysis in a way that removes foregrounds optimally, complementing spectra with angular information. We explore various experimental design trade-offs, and find that 1) with spectral-only methods, it is impossible to mitigate errors that arise from uncertainties in foreground modeling; 2) foreground contamination can be significantly reduced for experiments with fine angular resolution; 3) most of the statistical significance in a positive detection during the Dark Ages comes from a characteristic high-redshift trough in the 21cm brightness temperature; and 4) Measurement errors decrease more rapidly with integration time for instruments with fine angular resolution. We show that if observations and algorithms are optimized based on these findings, an instrument with a 5 degree beam can achieve highly significant detections (greater than 5-sigma) of even extended (high Delta-z) reionization scenarios after integrating for 500 hrs. This is in contrast to instruments without angular resolution, which cannot detect gradual reionization. Abrupt ionization histories can be detected at the level of 10-100's of sigma. The expected errors are also low during the Dark Ages, with a 25-sigma detection of the expected cosmological signal after only 100 hrs of integration.

preprint2013arXiv

Mapping our Universe in 3D with MITEoR

Mapping our universe in 3D by imaging the redshifted 21 cm line from neutral hydrogen has the potential to overtake the cosmic microwave background as our most powerful cosmological probe, because it can map a much larger volume of our Universe, shedding new light on the epoch of reionization, inflation, dark matter, dark energy, and neutrino masses. We report on MITEoR, a pathfinder low-frequency radio interferometer whose goal is to test technologies that greatly reduce the cost of such 3D mapping for a given sensitivity. MITEoR accomplishes this by using massive baseline redundancy both to enable automated precision calibration and to cut the correlator cost scaling from N^2 to NlogN, where N is the number of antennas. The success of MITEoR with its 64 dual-polarization elements bodes well for the more ambitious HERA project, which would incorporate many identical or similar technologies using an order of magnitude more antennas, each with dramatically larger collecting area.

preprint2011arXiv

A Method for 21cm Power Spectrum Estimation in the Presence of Foregrounds

21cm tomography promises to be a powerful tool for estimating cosmological parameters, constraining the epoch of reionization, and probing the so-called dark ages. However, realizing this promise will require the extraction of a cosmological power spectrum from beneath overwhelmingly large sources of foreground contamination. In this paper, we develop a unified matrix-based framework for foreground subtraction and power spectrum estimation, which allows us to quantify the errors and biases that arise in the power spectrum as a result of foreground subtraction. We find that existing line-of-sight foreground subtraction proposals can lead to substantial mode-mixing as well as residual noise and foreground biases, whereas our proposed inverse variance foreground subtraction eliminates noise and foreground biases, gives smaller error bars, and produces less correlated measurements of the power spectrum. We also numerically confirm the intuitive belief in the literature that 21cm foreground subtraction is best done using frequency rather than angular information.

preprint2011arXiv

How well can we measure and understand foregrounds with 21 cm experiments?

Before it becomes a sensitive probe of the Epoch of Reionization, the Dark Ages, and fundamental physics, 21 cm tomography must successfully contend with the issue of foreground contamination. Broadband foreground sources are expected to be roughly four orders of magnitude larger than any cosmological signals, so precise foreground models will be necessary. Such foreground models often contain a large number of parameters, reflecting the complicated physics that governs foreground sources. In this paper, we concentrate on spectral modeling (neglecting, for instance, bright point source removal from spatial maps) and show that 21 cm tomography experiments will likely not be able to measure these parameters without large degeneracies, simply because the foreground spectra are so featureless and generic. However, we show that this is also an advantage, because it means that the foregrounds can be characterized to a high degree of accuracy once a small number of parameters (likely three or four, depending on one's instrumental specifications) are measured. This provides a simple understanding for why 21 cm foreground subtraction schemes are able to remove most of the contaminants by suppressing just a small handful of simple spectral forms. In addition, this suggests that the foreground modeling process should be relatively simple and will likely not be an impediment to the foreground subtraction schemes that are necessary for a successful 21 cm tomography experiment.

preprint2010arXiv

Precision Calibration of Radio Interferometers Using Redundant Baselines

Growing interest in 21 cm tomography has led to the design and construction of broadband radio interferometers with low noise, moderate angular resolution, high spectral resolution, and wide fields of view. With characteristics somewhat different from traditional radio instruments, these interferometers may require new calibration techniques in order to reach their design sensitivities. Self-calibration or redundant calibration techniques that allow an instrument to be calibrated off complicated sky emission structures are ideal. In particular, the large number of redundant baselines possessed by these new instruments makes redundant calibration an especially attractive option. In this paper, we explore the errors and biases in existing redundant calibration schemes through simulations, and show how statistical biases can be eliminated. We also develop a general calibration formalism that includes both redundant baseline methods and basic point source calibration methods as special cases, and show how slight deviations from perfect redundancy and coplanarity can be taken into account.