Source author record

Nithyanandan Thyagarajan

Nithyanandan Thyagarajan appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

33works
10topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

33 published item(s)

preprint2025arXiv

Very-Long Baseline Interferometry Imaging with Closure Invariants using Conditional Image Diffusion

Image reconstruction in very-long baseline interferometry operates under severely sparse aperture coverage with calibration challenges from both the participating instruments and propagation medium, which introduce the risk of biases and artefacts. Interferometric closure invariants offers calibration-independent information on the true source morphology, but the inverse transformation from closure invariants to the source intensity distribution is an ill-posed problem. In this work, we present a generative deep learning approach to tackle the inverse problem of directly reconstructing images from their observed closure invariants. Trained in a supervised manner with simple shapes and the CIFAR-10 dataset, the resulting trained model achieves reduced chi-square data adherence scores of $χ^2_{\rm CI} \lesssim 1$ and maximum normalised cross-correlation image fidelity scores of $ρ_{\rm NX} > 0.9$ on tests of both trained and untrained morphologies, where $ρ_{\rm NX}=1$ denotes a perfect reconstruction. We also adapt our model for the Next Generation Event Horizon Telescope total intensity analysis challenge. Our results on quantitative metrics are competitive to other state-of-the-art image reconstruction algorithms. As an algorithm that does not require finely hand-tuned hyperparameters, this method offers a relatively simple and reproducible calibration-independent imaging solution for very-long baseline interferometry, which ultimately enhances the reliability of sparse VLBI imaging results.

preprint2022arXiv

A Geometric View of Closure Phases in Interferometry

Closure phase is the phase of a closed-loop product of correlations in a $\ge 3$-element interferometer array. Its invariance to element-based phase corruption makes it invaluable for interferometric applications that otherwise require high-accuracy phase calibration. However, its understanding has remained mainly mathematical and limited to the aperture plane (Fourier dual of image plane). Here, we lay the foundations for a geometrical insight. we show that closure phase and its invariance to element-based corruption and to translation are intricately related to the conserved properties (shape, orientation, and size, or SOS) of the principal triangle enclosed by the three fringes formed by a closed triad of array elements, which is referred herein as the "SOS conservation principle". When element-based amplitude calibration is not needed, as is typical in optical interferometry, the 3-element interference image formed from phase-uncalibrated correlations is a true and uncorrupted representation of the source object's morphology, except for a possible shift. Based on this SOS conservation principle, we present two geometric methods to measure the closure phase directly from a 3-element interference image (without requiring an aperture-plane view): (i) the closure phase is directly measurable from any one of the triangle's heights, and (ii) the squared closure phase is proportional to the product of the areas enclosed by the triad of array elements and the principal triangle in the aperture and image planes, respectively. We validate this geometric understanding across a wide range range of interferometric conditions using data from the Very Large Array and the Event Horizon Telescope. This geometric insight can be potentially valuable to other interferometric applications such as optical interferometry. These geometric relationships are generalised for an $N$-element interferometer.

preprint2022arXiv

Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study with the Hydrogen Epoch of Reionization Array

We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets.

preprint2022arXiv

Evaluating the prevalence of spurious correlations in pulsar timing array datasets

Pulsar timing array collaborations have recently reported evidence for a noise process with a common spectrum among the millisecond pulsars in the arrays. The spectral properties of this common-noise process are consistent with expectations for an isotropic gravitational-wave background (GWB) from inspiralling supermassive black-hole binaries. However, recent simulation analyses based on Parkes Pulsar Timing Array data indicate that such a detection may arise spuriously. In this paper, we use simulated pulsar timing array datasets to further test the robustness of the inference methods for spectral and spatial correlations from a GWB. Expanding on our previous results, we find strong support (Bayes factors exceeding $10^5$) for the presence of a common-spectrum noise process in datasets where no common process is present, under a wide range of timing noise prescriptions per pulsar. We show that these results are highly sensitive to the choice of Bayesian priors on timing noise parameters, with priors that more closely match the injected distributions of timing noise parameters resulting in diminished support for a common-spectrum noise process. These results emphasize shortcomings in current methods for inferring the presence of a common-spectrum process, and imply that the detection of a common process is not a reliable precursor to detection of the GWB. Future searches for the nanohertz GWB should remain focussed on detecting spatial correlations, and make use of more tailored specifications for a common-spectrum noise process.

preprint2022arXiv

Invariants in Co-polar Interferometry: an Abelian Gauge Theory

An $N$-element interferometer measures correlations among pairs of array elements. Closure invariants associated with closed loops among array elements are immune to multiplicative, element-based ("local") corruptions that occur in these measurements. Till recently, it has been unclear how a complete set of independent invariants can be analytically determined. We view the local, element-based corruptions in co-polar correlations as gauge tranformations belonging to the gauge group $\textrm{GL}(1,\mathbb{C})$. Closure quantities are then naturally gauge invariant. We use this to provide a simple and effective formalism, and identify the complete set of independent closure invariants from co-polar interferometric correlations using only quantities defined on $(N-1)(N-2)/2$ elementary and independent triangular loops. The $(N-1)(N-2)/2$ closure phases and $N(N-3)/2$ closure amplitudes (totaling $N^2-3N+1$ real invariants), familiar in astronomical interferometry, naturally emerge from this formalism, which unifies what has required separate treatments until now. We do not require auto-correlations, but can easily include them if reliably measured. This unified view clarifies issues relating to noise and inference of object model parameters. It also allows us to extend the rule of parallel transport associated with Pancharatnam phase in optics to apply to amplitudes as well. The framework presented here extends to $\textrm{GL}(2,\mathbb{C}$) for full polarimetric interferometry as presented in a companion paper, which generalizes and clarifies earlier work. Our findings are relevant to state of the art co-polar and full polarimetric very long baseline interferometry measurements to determine features very near the event horizons of blackholes at the centers of M87, Centaurus~A, and the Milky Way.

preprint2022arXiv

Invariants in Polarimetric Interferometry: a non-Abelian Gauge Theory

The discovery of magnetic fields close to the M87 black hole using Very Long Baseline Interferometry (VLBI) by the Event Horizon Telescope collaboration utilized the novel concept of "closure traces", that are immune to element-based aberrations. We take a fundamentally new approach to this promising tool of polarimetric VLBI, using ideas from the geometric phase and gauge theories. The multiplicative distortion of polarized signals at the individual elements are represented as gauge transformations by general $2\times 2$ complex matrices, so the closure traces now appear as gauge-invariant quantities. We apply this formalism to polarimetric interferometry and generalize it to any number of interferometer elements. Our approach goes beyond existing studies in the following respects: (1) we use triangular combinations of correlations as basic building blocks of invariants, (2) we use well-known symmetry properties of the Lorentz group to transparently identify a complete and independent set of invariants, and (3) we do not need auto-correlations, which are susceptible to large systematic biases, and therefore unreliable. This set contains all the information, immune to corruption, available in the interferometer measurements, thus providing important robust constraints for interferometric studies.

preprint2021arXiv

First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum

We report upper-limits on the Epoch of Reionization (EoR) 21 cm power spectrum at redshifts 7.9 and 10.4 with 18 nights of data ($\sim36$ hours of integration) from Phase I of the Hydrogen Epoch of Reionization Array (HERA). The Phase I data show evidence for systematics that can be largely suppressed with systematic models down to a dynamic range of $\sim10^9$ with respect to the peak foreground power. This yields a 95% confidence upper limit on the 21 cm power spectrum of $Δ^2_{21} \le (30.76)^2\ {\rm mK}^2$ at $k=0.192\ h\ {\rm Mpc}^{-1}$ at $z=7.9$, and also $Δ^2_{21} \le (95.74)^2\ {\rm mK}^2$ at $k=0.256\ h\ {\rm Mpc}^{-1}$ at $z=10.4$. At $z=7.9$, these limits are the most sensitive to-date by over an order of magnitude. While we find evidence for residual systematics at low line-of-sight Fourier $k_\parallel$ modes, at high $k_\parallel$ modes we find our data to be largely consistent with thermal noise, an indicator that the system could benefit from deeper integrations. The observed systematics could be due to radio frequency interference, cable sub-reflections, or residual instrumental cross-coupling, and warrant further study. This analysis emphasizes algorithms that have minimal inherent signal loss, although we do perform a careful accounting in a companion paper of the small forms of loss or bias associated with the pipeline. Overall, these results are a promising first step in the development of a tuned, instrument-specific analysis pipeline for HERA, particularly as Phase II construction is completed en route to reaching the full sensitivity of the experiment.

preprint2021arXiv

Hybrid mapping of the Black Hole Shadow in M87

We present a reanalysis of the EHT 228 GHz observations of M87. We apply traditional hybrid mapping techniques to the publicly available `network-calibrated' data. We explore the impact on the final image of different starting models, including: a point source, a disk, an annulus, a Gaussian, and an asymmetric double Gaussian. The images converge to an extended source with a size $\sim 44~μ$as. Starting with the annulus and disk models leads to images with the lowest noise, smallest off-source artifacts, and better closure residuals. The source appears as a ring, or edge-brightened disk, with higher surface brightness in the southern half, consistent with previous results. Starting with the other models leads to a surface brightness distribution with a similar size, and an internal depression, but not as clearly ring-like. A consideration of visibility amplitudes vs. UV-distance argues for a roughly circularly symmetric structure of $\sim 50~μ$as scale, with a sharp-edge, based on a prominent minimum in the UV-distribution, and the amplitude of the secondary peak in the UV-plot is more consistent with an annular model than a flat disk model. With further processing, we find a possible modest extension from the ring toward the southwest, in a direction consistent with the southern limb of the jet seen on 3mm VLBI images on a factor of few larger scales. However, this extension appears along the direction of one of the principle sidelobes of the synthesized beam, and hence requires testing with better UV-coverage.

preprint2021arXiv

Validation of the HERA Phase I Epoch of Reionization 21 cm Power Spectrum Software Pipeline

We describe the validation of the HERA Phase I software pipeline by a series of modular tests, building up to an end-to-end simulation. The philosophy of this approach is to validate the software and algorithms used in the Phase I upper limit analysis on wholly synthetic data satisfying the assumptions of that analysis, not addressing whether the actual data meet these assumptions. We discuss the organization of this validation approach, the specific modular tests performed, and the construction of the end-to-end simulations. We explicitly discuss the limitations in scope of the current simulation effort. With mock visibility data generated from a known analytic power spectrum and a wide range of realistic instrumental effects and foregrounds, we demonstrate that the current pipeline produces power spectrum estimates that are consistent with known analytic inputs to within thermal noise levels (at the 2 sigma level) for k > 0.2 h/Mpc for both bands and fields considered. Our input spectrum is intentionally amplified to enable a strong `detection' at k ~0.2 h/Mpc -- at the level of ~25 sigma -- with foregrounds dominating on larger scales, and thermal noise dominating at smaller scales. Our pipeline is able to detect this amplified input signal after suppressing foregrounds with a dynamic range (foreground to noise ratio) of > 10^7. Our validation test suite uncovered several sources of scale-independent signal loss throughout the pipeline, whose amplitude is well-characterized and accounted for in the final estimates. We conclude with a discussion of the steps required for the next round of data analysis.

preprint2020arXiv

Absolute Calibration Strategies for the Hydrogen Epoch of Reionization Array and Their Impact on the 21 cm Power Spectrum

We discuss absolute calibration strategies for Phase I of the Hydrogen Epoch of Reionization Array (HERA), which aims to measure the cosmological 21 cm signal from the Epoch of Reionization (EoR). HERA is a drift-scan array with a 10 degree wide field of view, meaning bright, well-characterized point source transits are scarce. This, combined with HERA's redundant sampling of the uv plane and the modest angular resolution of the Phase I instrument, make traditional sky-based and self-calibration techniques difficult to implement with high dynamic range. Nonetheless, in this work we demonstrate calibration for HERA using point source catalogues and electromagnetic simulations of its primary beam. We show that unmodeled diffuse flux and instrumental contaminants can corrupt the gain solutions, and present a gain smoothing approach for mitigating their impact on the 21 cm power spectrum. We also demonstrate a hybrid sky and redundant calibration scheme and compare it to pure sky-based calibration, showing only a marginal improvement to the gain solutions at intermediate delay scales. Our work suggests that the HERA Phase I system can be well-calibrated for a foreground-avoidance power spectrum estimator by applying direction-independent gains with a small set of degrees of freedom across the frequency and time axes.

preprint2020arXiv

Detection of Cosmic Structures using the Bispectrum Phase. I. Mathematical Foundations

Many low-frequency radio interferometers are aiming to detect very faint spectral signatures from structures at cosmological redshifts, particularly of neutral Hydrogen using its characteristic 21 cm spectral line. Due to the very high dynamic range needed to isolate these faint spectral fluctuations from the very bright foregrounds, spectral systematics from the instrument or the analysis, rather than thermal noise, are currently limiting their sensitivity. Failure to achieve a spectral calibration with fractional inaccuracy $\lesssim 10^{-5}$ will make the detection of the critical cosmic signal unlikely. The bispectrum phase from interferometric measurements is largely immune to this calibration issue. We present a basis to explore the nature of bispectrum phase in the limit of small spectral fluctuations. We establish that they measure the intrinsic dissimilarity in the transverse structure of the cosmic signal relative to the foregrounds, expressed as rotations in the underlying phase angle. Their magnitude is related to the strength of the cosmic signal relative to the foregrounds. Using a range of sky models, we detail the behavior of bispectrum phase fluctuations using standard Fourier-domain techniques and find it comparable to existing approaches, with a few key differences. Mode-mixed foreground contamination is more pronounced than in existing approaches because the bispectrum phase is a product of three individual interferometric phases. The multiplicative coupling of foregrounds in the bispectrum phase fluctuations results in the mixing of foreground signatures with that of the cosmic signal. We briefly outline a variation of this approach to avoid extensive mode-mixing. Despite its limitations, the interpretation of results using bispectrum phase is possible with forward-modeling. Importantly, it is an independent and a viable alternative to existing approaches.

preprint2020arXiv

Detection of Cosmic Structures using the Bispectrum Phase. II. First Results from Application to Cosmic Reionization Using the Hydrogen Epoch of Reionization Array

Characterizing the epoch of reionization (EoR) at $z\gtrsim 6$ via the redshifted 21 cm line of neutral Hydrogen (HI) is critical to modern astrophysics and cosmology, and thus a key science goal of many current and planned low-frequency radio telescopes. The primary challenge to detecting this signal is the overwhelmingly bright foreground emission at these frequencies, placing stringent requirements on the knowledge of the instruments and inaccuracies in analyses. Results from these experiments have largely been limited not by thermal sensitivity but by systematics, particularly caused by the inability to calibrate the instrument to high accuracy. The interferometric bispectrum phase is immune to antenna-based calibration and errors therein, and presents an independent alternative to detect the EoR HI fluctuations while largely avoiding calibration systematics. Here, we provide a demonstration of this technique on a subset of data from the Hydrogen Epoch of Reionization Array (HERA) to place approximate constraints on the brightness temperature of the intergalactic medium (IGM). From this limited data, at $z=7.7$ we infer "$1σ$" upper limits on the IGM brightness temperature to be $\le 316$ "pseudo" mK at $κ_\parallel=0.33$ "pseudo" $h$ Mpc$^{-1}$ (data-limited) and $\le 1000$ "pseudo" mK at $κ_\parallel=0.875$ "pseudo" $h$ Mpc$^{-1}$ (noise-limited). The "pseudo" units denote only an approximate and not an exact correspondence to the actual distance scales and brightness temperatures. By propagating models in parallel to the data analysis, we confirm that the dynamic range required to separate the cosmic HI signal from the foregrounds is similar to that in standard approaches, and the power spectrum of the bispectrum phase is still data-limited (at $\gtrsim 10^6$ dynamic range) indicating scope for further improvement in sensitivity as the array build-out continues.

preprint2020arXiv

Foreground modelling via Gaussian process regression: an application to HERA data

The key challenge in the observation of the redshifted 21-cm signal from cosmic reionization is its separation from the much brighter foreground emission. Such separation relies on the different spectral properties of the two components, although, in real life, the foreground intrinsic spectrum is often corrupted by the instrumental response, inducing systematic effects that can further jeopardize the measurement of the 21-cm signal. In this paper, we use Gaussian Process Regression to model both foreground emission and instrumental systematics in $\sim 2$ hours of data from the Hydrogen Epoch of Reionization Array. We find that a simple co-variance model with three components matches the data well, giving a residual power spectrum with white noise properties. These consist of an "intrinsic" and instrumentally corrupted component with a coherence-scale of 20 MHz and 2.4 MHz respectively (dominating the line of sight power spectrum over scales $k_{\parallel} \le 0.2$ h cMpc$^{-1}$) and a baseline dependent periodic signal with a period of $\sim 1$ MHz (dominating over $k_{\parallel} \sim 0.4 - 0.8$h cMpc$^{-1}$) which should be distinguishable from the 21-cm EoR signal whose typical coherence-scales is $\sim 0.8$ MHz.

preprint2020arXiv

Measuring HERA's primary beam in-situ: methodology and first results

The central challenge in 21~cm cosmology is isolating the cosmological signal from bright foregrounds. Many separation techniques rely on the accurate knowledge of the sky and the instrumental response, including the antenna primary beam. For drift-scan telescopes such as the Hydrogen Epoch of Reionization Array \citep[HERA, ][]{DeBoer2017} that do not move, primary beam characterization is particularly challenging because standard beam-calibration routines do not apply \citep{Cornwell2005} and current techniques require accurate source catalogs at the telescope resolution. We present an extension of the method from \citet{Pober2012} where they use beam symmetries to create a network of overlapping source tracks that break the degeneracy between source flux density and beam response and allow their simultaneous estimation. We fit the beam response of our instrument using early HERA observations and find that our results agree well with electromagnetic simulations down to a -20~dB level in power relative to peak gain for sources with high signal-to-noise ratio. In addition, we construct a source catalog with 90 sources down to a flux density of 1.4~Jy at 151~MHz.

preprint2020arXiv

Statistical Detection of IGM Structures during Cosmic Reionization using Absorption of the Redshifted 21 cm line by HI against Compact Background Radio Sources

Detecting neutral hydrogen structures in the intergalactic medium (IGM) during cosmic reionization via absorption (21 cm forest) against a background radiation is considered independent and complementary to the three-dimensional tomography and power spectrum techniques. The direct detection of this absorption requires very bright ($\gtrsim 10$-100 mJy) background sources at high redshifts ($z\gtrsim 8$), which are evidently rare; very long times of integration; or instruments of very high sensitivity. This motivates a statistical one-dimensional (1D) power spectrum approach along narrow sightlines but with fainter background objects ($\sim 1$-10 mJy), which are likely to be more abundant and significant contributors at high redshifts. The 1D power spectrum reduces cosmic variance and improves sensitivity especially on small spatial scales. Using standard radiative transfer and fiducial models for the instrument, the background sources, and the evolution of IGM structures during cosmic reionization, the potential of the 1D power spectrum along selected narrow directions is investigated against uncertainties from thermal noise and the chromatic synthesized point spread function (PSF) response. Minimum requirements on the number of high-redshift background sources, the telescope sensitivity, and the PSF quality are estimated for a range of instrumental, background source, and reionization model parameters. The 1D power spectrum is intrinsically stronger at higher redshifts. A $\sim 1000$ hr observing campaign targeting $\sim 100$ narrow sightlines to radio-faint, high-redshift background objects with modern radio telescopes, especially the Square Kilometre Array, can detect the 1D power spectrum on a range of spatial scales and redshifts, and potentially discriminate between models of cosmic reionization.

preprint2019arXiv

Direct Wide-Field Radio Imaging in Real-Time at High Time Resolution using Antenna Electric Fields

The recent demonstration of a real-time direct imaging radio interferometry correlator represents a new capability in radio astronomy. However wide field imaging with this method is challenging since wide-field effects and array non-coplanarity degrade image quality if not compensated for. Here we present an alternative direct imaging correlation strategy using a Direct Fourier Transform (DFT), modelled as a linear operator facilitating a matrix multiplication between the DFT matrix and a vector of the electric fields from each antenna. This offers perfect correction for wide field and non-coplanarity effects. When implemented with data from the Long Wavelength Array (LWA), it offers comparable computational performance to previously demonstrated direct imaging techniques, despite having a theoretically higher floating point cost. It also has additional benefits, such as imaging sparse arrays and control over which sky co-ordinates are imaged, allowing variable pixel placement across an image. It is in practice a highly flexible and efficient method of direct radio imaging when implemented on suitable arrays. A functioning Electric Field Direct imaging architecture using the DFT is presented, alongside an exploration of techniques for wide-field imaging similar to those in visibility based imaging, and an explanation of why they do not fit well to imaging directly with the digitized electric field data. The DFT imaging method is demonstrated on real data from the LWA telescope, alongside a detailed performance analysis, as well as an exploration of its applicability to other arrays.

preprint2019arXiv

Mitigating Internal Instrument Coupling II: A Method Demonstration with the Hydrogen Epoch of Reionization Array

We present a study of internal reflection and cross coupling systematics in Phase I of the Hydrogen Epoch of Reionization Array (HERA). In a companion paper, we outlined the mathematical formalism for such systematics and presented algorithms for modeling and removing them from the data. In this work, we apply these techniques to data from HERA's first observing season as a method demonstration. The data show evidence for systematics that, without removal, would hinder a detection of the 21 cm power spectrum for the targeted EoR line-of-sight modes in the range 0.2 < k_parallel < 0.5\ h^-1 Mpc. After systematic removal, we find we can recover these modes in the power spectrum down to the integrated noise-floor of a nightly observation, achieving a dynamic range in the EoR window of 10^-6 in power (mK^2 units) with respect to the bright galactic foreground signal. In the absence of other systematics and assuming the systematic suppression demonstrated here continues to lower noise levels, our results suggest that fully-integrated HERA Phase I may have the capacity to set competitive upper limits on the 21 cm power spectrum. For future observing seasons, HERA will have upgraded analog and digital hardware to better control these systematics in the field.

preprint2019arXiv

The ALMA Spectroscopic Survey in the HUDF: Constraining cumulative CO emission at $1 \lesssim z \lesssim 4$ with power spectrum analysis of ASPECS LP data from 84 to 115 GHz

We present a power spectrum analysis of the ALMA Spectroscopic Survey Large Program (ASPECS LP) data from 84 to 115 GHz. These data predominantly probe small-scale fluctuations ($k=10$-$100$ h Mpc$^{-1}$) in the aggregate CO emission in galaxies at $1 \lesssim z \lesssim 4$. We place an integral constraint on CO luminosity functions (LFs) in this redshift range via a direct measurement of their second moments in the three-dimensional (3D) auto-power spectrum, finding a total CO shot noise power $P_{\textrm{CO,CO}}(k_{\textrm{CO(2-1)}}) \leq 1.9\times10^2$ $μ$K$^2$ (Mpc h$^{-1}$)$^3$. This upper limit ($3σ$) is consistent with the observed ASPECS CO LFs in Decarli et al. 2019, but rules out a large space in the range of $P_{\textrm{CO,CO}}(k_{\textrm{CO(2-1)}})$ inferred from these LFs, which we attribute primarily to large uncertainties in the normalization $Φ_*$ and knee $L_*$ of the Schechter-form CO LFs at $z > 2$. Also, through power spectrum analyses of ASPECS LP data with 415 positions from galaxies with available optical spectroscopic redshifts, we find that contributions to the observed mean CO intensity and shot noise power of MUSE galaxies are largely accounted for by ASPECS blind detections, though there are $\sim20$% contributions to the CO(2-1) mean intensity due to sources previously undetected in the blind line search. Finally, we sum the fluxes from individual blind CO detections to yield a lower limit on the mean CO surface brightness at 99 GHz of $\langle T_{\textrm{CO}} \rangle = 0.55\pm0.02$ $μ$K, which we estimate represents $68$-$80$% of the total CO surface brightness at this frequency.

preprint2016arXiv

A High Reliability Survey of Discrete Epoch of Reionization Foreground Sources in the MWA EoR0 Field

Detection of the Epoch of Reionization HI signal requires a precise understanding of the intervening galaxies and AGN, both for instrumental calibration and foreground removal. We present a catalogue of 7394 extragalactic sources at 182 MHz detected in the RA=0 field of the Murchison Widefield Array Epoch of Reionization observation programme. Motivated by unprecedented requirements for precision and reliability we develop new methods for source finding and selection. We apply machine learning methods to self-consistently classify the relative reliability of 9490 source candidates. A subset of 7466 are selected based on reliability class and signal-to-noise ratio criteria. These are statistically cross-matched to four other radio surveys using both position and flux density information. We find 7369 sources to have confident matches, including 90 partially resolved sources that split into a total of 192 sub-components. An additional 25 unmatched sources are included as new radio detections. The catalogue sources have a median spectral index of -0.85. Spectral flattening is seen toward lower frequencies with a median of -0.71 predicted at 182 MHz. The astrometric error is 7 arcsec. compared to a 2.3 arcmin. beam FWHM. The resulting catalogue covers approximately 1400 sq. deg. and is complete to approximately 80 mJy within half beam power. This provides the most reliable discrete source sky model available to date in the MWA EoR0 field for precision foreground subtraction.

preprint2016arXiv

CHIPS: The Cosmological HI Power Spectrum Estimator

Detection of the cosmological neutral hydrogen signal from the Epoch of Reionization, and estimation of its basic physical parameters, is the principal scientific aim of many current low-frequency radio telescopes. Here we describe the Cosmological HI Power Spectrum Estimator (CHIPS), an algorithm developed and implemented with data from the Murchison Widefield Array (MWA), to compute the two-dimensional and spherically-averaged power spectrum of brightness temperature fluctuations. The principal motivations for CHIPS are the application of realistic instrumental and foreground models to form the optimal estimator, thereby maximising the likelihood of unbiased signal estimation, and allowing a full covariant understanding of the outputs. CHIPS employs an inverse-covariance weighting of the data through the maximum likelihood estimator, thereby allowing use of the full parameter space for signal estimation ("foreground suppression"). We describe the motivation for the algorithm, implementation, application to real and simulated data, and early outputs. Upon application to a set of 3 hours of data, we set a 2$σ$ upper limit on the EoR dimensionless power at $k=0.05$~h.Mpc$^{-1}$ of $Δ_k^2<7.6\times{10^4}$~mK$^2$ in the redshift range $z=[6.2-6.6]$, consistent with previous estimates.

preprint2016arXiv

Delay Spectrum with Phase-Tracking Arrays: Extracting the HI power spectrum from the Epoch of Reionization

The Detection of redshifted 21 cm emission from the epoch of reionization (EoR) is a challenging task owing to strong foregrounds that dominate the signal. In this paper, we propose a general method, based on the delay spectrum approach, to extract HI power spectra that is applicable to tracking observations using an imaging radio interferometer (Delay Spectrum with Imaging Arrays (DSIA)). Our method is based on modelling the HI signal taking into account the impact of wide field effects such as the $w$-term which are then used as appropriate weights in cross-correlating the measured visibilities. Our method is applicable to any radio interferometer that tracks a phase center and could be utilized for arrays such as MWA, LOFAR, GMRT, PAPER and HERA. In the literature the delay spectrum approach has been implemented for near-redundant baselines using drift scan observations. In this paper we explore the scheme for non-redundant tracking arrays, and this is the first application of delay spectrum methodology to such data to extract the HI signal. We analyze 3 hours of MWA tracking data on the EoR1 field. We present both 2-dimensional ($k_\parallel,k_\perp$) and 1-dimensional (k) power spectra from the analysis. Our results are in agreement with the findings of other pipelines developed to analyse the MWA EoR data.

preprint2016arXiv

Effects of Antenna Beam Chromaticity on Redshifted 21~cm Power Spectrum and Implications for Hydrogen Epoch of Reionization Array

Unaccounted for systematics from foregrounds and instruments can severely limit the sensitivity of current experiments from detecting redshifted 21~cm signals from the Epoch of Reionization (EoR). Upcoming experiments are faced with a challenge to deliver more collecting area per antenna element without degrading the data with systematics. This paper and its companions show that dishes are viable for achieving this balance using the Hydrogen Epoch of Reionization Array (HERA) as an example. Here, we specifically identify spectral systematics associated with the antenna power pattern as a significant detriment to all EoR experiments which causes the already bright foreground power to leak well beyond ideal limits and contaminate the otherwise clean EoR signal modes. A primary source of this chromaticity is reflections in the antenna-feed assembly and between structures in neighboring antennas. Using precise foreground simulations taking wide-field effects into account, we provide a framework to set cosmologically-motivated design specifications on these reflections to prevent further EoR signal degradation. We show HERA will not be impeded by such spectral systematics and demonstrate that even in a conservative scenario that does not perform removal of foregrounds, HERA will detect EoR signal in line-of-sight $k$-modes, $k_\parallel \gtrsim 0.2\,h$~Mpc$^{-1}$, with high significance. All baselines in a 19-element HERA layout are capable of detecting EoR over a substantial observing window on the sky.

preprint2016arXiv

First Limits on the 21 cm Power Spectrum during the Epoch of X-ray heating

We present first results from radio observations with the Murchison Widefield Array seeking to constrain the power spectrum of 21 cm brightness temperature fluctuations between the redshifts of 11.6 and 17.9 (113 and 75 MHz). Three hours of observations were conducted over two nights with significantly different levels of ionospheric activity. We use these data to assess the impact of systematic errors at low frequency, including the ionosphere and radio-frequency interference, on a power spectrum measurement. We find that after the 1-3 hours of integration presented here, our measurements at the Murchison Radio Observatory are not limited by RFI, even within the FM band, and that the ionosphere does not appear to affect the level of power in the modes that we expect to be sensitive to cosmology. Power spectrum detections, inconsistent with noise, due to fine spectral structure imprinted on the foregrounds by reflections in the signal-chain, occupy the spatial Fourier modes where we would otherwise be most sensitive to the cosmological signal. We are able to reduce this contamination using calibration solutions derived from autocorrelations so that we achieve an sensitivity of $10^4$ mK on comoving scales $k\lesssim 0.5 h$Mpc$^{-1}$. This represents the first upper limits on the $21$ cm power spectrum fluctuations at redshifts $12\lesssim z \lesssim 18$ but is still limited by calibration systematics. While calibration improvements may allow us to further remove this contamination, our results emphasize that future experiments should consider carefully the existence of and their ability to calibrate out any spectral structure within the EoR window.

preprint2016arXiv

First Season MWA EoR Power Spectrum Results at Redshift 7

The Murchison Widefield Array (MWA) has collected hundreds of hours of Epoch of Reionization (EoR) data and now faces the challenge of overcoming foreground and systematic contamination to reduce the data to a cosmological measurement. We introduce several novel analysis techniques such as cable reflection calibration, hyper-resolution gridding kernels, diffuse foreground model subtraction, and quality control methods. Each change to the analysis pipeline is tested against a two dimensional power spectrum figure of merit to demonstrate improvement. We incorporate the new techniques into a deep integration of 32 hours of MWA data. This data set is used to place a systematic-limited upper limit on the cosmological power spectrum of $Δ^2 \leq 2.7 \times 10^4$ mK$^2$ at $k=0.27$ h~Mpc$^{-1}$ and $z=7.1$, consistent with other published limits, and a modest improvement (factor of 1.4) over previous MWA results. From this deep analysis we have identified a list of improvements to be made to our EoR data analysis strategies. These improvements will be implemented in the future and detailed in upcoming publications.

preprint2016arXiv

Impact of Instrument Responses on the Detectability of One-point Statistics from Redshifted 21 cm Observations

We study the impact of instrumental systematics on the variance, skewness, and kurtosis of redshifted 21 cm intensity fluctuation observations from the Epoch of Reionization. We simulate realistic 21 cm observations based on the Murchison Widefield Array (MWA) Phase I reionization experiment, using the array's point spread function (PSF) and antenna beam patterns, full-sky 21 cm models, and the FHD imaging pipeline. We measure the observed redshift evolution of pixel probability density functions (PDF) and one-point statistics from the simulated maps, comparing them to the measurements derived from simpler simulations that represent the instrument PSFs with Gaussian kernels. We find that both methods yield statistics with similar trends with greater than 80% correlation. We perform additional simulations based on the Hydrogen Epoch of Reionization Array (HERA), using Gaussian kernels as the instrument PSFs, and study the effect of frequency binning on the statistics. We find that PSF smoothing and sampling variance from measuring the statistics over limited field of view dilute intrinsic features and add fluctuations to the statistics but reveal new detectable features. Observed kurtosis will increase when a few extremely high or low temperature regions are present in the maps. Frequency binning reduces the thermal uncertainty but can also blur regions along the frequency dimension, resulting in kurtosis peaks that only appear in statistics derived from maps of certain frequency bins. We further find that the kurtosis peaks will reach their maxima when the angular resolution of the PSFs match the size scale of the extreme regions that produce the peaks. The HERA array should be capable of charting the evolution of the observed skewness and kurtosis of the 21 cm fluctuations with high sensitivity while the MWA Phase I will likely be capable of detecting the peak in variance.

preprint2016arXiv

Low frequency observations of linearly polarized structures in the interstellar medium near the south Galactic pole

We present deep polarimetric observations at 154 MHz with the Murchison Widefield Array (MWA), covering 625 deg^2 centered on RA=0 h, Dec=-27 deg. The sensitivity available in our deep observations allows an in-band, frequency-dependent analysis of polarized structure for the first time at long wavelengths. Our analysis suggests that the polarized structures are dominated by intrinsic emission but may also have a foreground Faraday screen component. At these wavelengths, the compactness of the MWA baseline distribution provides excellent snapshot sensitivity to large-scale structure. The observations are sensitive to diffuse polarized emission at ~54' resolution with a sensitivity of 5.9 mJy beam^-1 and compact polarized sources at ~2.4' resolution with a sensitivity of 2.3 mJy beam^-1 for a subset (400 deg^2) of this field. The sensitivity allows the effect of ionospheric Faraday rotation to be spatially and temporally measured directly from the diffuse polarized background. Our observations reveal large-scale structures (~1 deg - 8 deg in extent) in linear polarization clearly detectable in ~2 minute snapshots, which would remain undetectable by interferometers with minimum baseline lengths >110 m at 154 MHz. The brightness temperature of these structures is on average 4 K in polarized intensity, peaking at 11 K. Rotation measure synthesis reveals that the structures have Faraday depths ranging from -2 rad m^-2 to 10 rad m^-2 with a large fraction peaking at ~+1 rad m^-2. We estimate a distance of 51+/-20 pc to the polarized emission based on measurements of the in-field pulsar J2330-2005. We detect four extragalactic linearly polarized point sources within the field in our compact source survey. Based on the known polarized source population at 1.4 GHz and non-detections at 154 MHz, we estimate an upper limit on the depolarization ratio of 0.08 from 1.4 GHz to 154 MHz.

preprint2016arXiv

The Hydrogen Epoch of Reionization Array Dish II: Characterization of Spectral Structure with Electromagnetic Simulations and its science Implications

We use time-domain electromagnetic simulations to determine the spectral characteristics of the Hydrogen Epoch of Reionization Arrays (HERA) antenna. These simulations are part of a multi-faceted campaign to determine the effectiveness of the dish's design for obtaining a detection of redshifted 21 cm emission from the epoch of reionization. Our simulations show the existence of reflections between HERA's suspended feed and its parabolic dish reflector that fall below -40 dB at 150 ns and, for reasonable impedance matches, have a negligible impact on HERA's ability to constrain EoR parameters. It follows that despite the reflections they introduce, dishes are effective for increasing the sensitivity of EoR experiments at relatively low cost. We find that electromagnetic resonances in the HERA feed's cylindrical skirt, which is intended to reduce cross coupling and beam ellipticity, introduces significant power at large delays ($-40$ dB at 200 ns) which can lead to some loss of measurable Fourier modes and a modest reduction in sensitivity. Even in the presence of this structure, we find that the spectral response of the antenna is sufficiently smooth for delay filtering to contain foreground emission at line-of-sight wave numbers below $k_\parallel \lesssim 0.2$ $h$Mpc$^{-1}$, in the region where the current PAPER experiment operates. Incorporating these results into a Fisher Matrix analysis, we find that the spectral structure observed in our simulations has only a small effect on the tight constraints HERA can achieve on parameters associated with the astrophysics of reionization.

preprint2016arXiv

The Importance of Wide-field Foreground Removal for 21 cm Cosmology: A Demonstration With Early MWA Epoch of Reionization Observations

In this paper we present observations, simulations, and analysis demonstrating the direct connection between the location of foreground emission on the sky and its location in cosmological power spectra from interferometric redshifted 21 cm experiments. We begin with a heuristic formalism for understanding the mapping of sky coordinates into the cylindrically averaged power spectra measurements used by 21 cm experiments, with a focus on the effects of the instrument beam response and the associated sidelobes. We then demonstrate this mapping by analyzing power spectra with both simulated and observed data from the Murchison Widefield Array. We find that removing a foreground model which includes sources in both the main field-of-view and the first sidelobes reduces the contamination in high k_parallel modes by several percent relative to a model which only includes sources in the main field-of-view, with the completeness of the foreground model setting the principal limitation on the amount of power removed. While small, a percent-level amount of foreground power is in itself more than enough to prevent recovery of any EoR signal from these modes. This result demonstrates that foreground subtraction for redshifted 21 cm experiments is truly a wide-field problem, and algorithms and simulations must extend beyond the main instrument field-of-view to potentially recover the full 21 cm power spectrum.

preprint2015arXiv

Confirmation of Wide-Field Signatures in Redshifted 21 cm Power Spectra

We confirm our recent prediction of the "pitchfork" foreground signature in power spectra of high-redshift 21 cm measurements where the interferometer is sensitive to large-scale structure on all baselines. This is due to the inherent response of a wide-field instrument and is characterized by enhanced power from foreground emission in Fourier modes adjacent to those considered to be the most sensitive to the cosmological H I signal. In our recent paper, many signatures from the simulation that predicted this feature were validated against Murchison Widefield Array (MWA) data, but this key pitchfork signature was close to the noise level. In this paper, we improve the data sensitivity through the coherent averaging of 12 independent snapshots with identical instrument settings and provide the first confirmation of the prediction with a signal-to-noise ratio > 10. This wide-field effect can be mitigated by careful antenna designs that suppress sensitivity near the horizon. Simple models for antenna apertures that have been proposed for future instruments such as the Hydrogen Epoch of Reionization Array and the Square Kilometre Array indicate they should suppress foreground leakage from the pitchfork by ~40 dB relative to the MWA and significantly increase the likelihood of cosmological signal detection in these critical Fourier modes in the three-dimensional power spectrum.

preprint2015arXiv

Empirical Covariance Modeling for 21 cm Power Spectrum Estimation: A Method Demonstration and New Limits from Early Murchison Widefield Array 128-Tile Data

The separation of the faint cosmological background signal from bright astrophysical foregrounds remains one of the most daunting challenges of mapping the high-redshift intergalactic medium with the redshifted 21 cm line of neutral hydrogen. Advances in mapping and modeling of diffuse and point source foregrounds have improved subtraction accuracy, but no subtraction scheme is perfect. Precisely quantifying the errors and error correlations due to missubtracted foregrounds allows for both the rigorous analysis of the 21 cm power spectrum and for the maximal isolation of the "EoR window" from foreground contamination. We present a method to infer the covariance of foreground residuals from the data itself in contrast to previous attempts at a priori modeling. We demonstrate our method by setting limits on the power spectrum using a 3 h integration from the 128-tile Murchison Widefield Array. Observing between 167 and 198 MHz, we find at 95% confidence a best limit of Delta^2(k) < 3.7 x 10^4 mK^2 at comoving scale k = 0.18 hMpc^-1 and at z = 6.8, consistent with existing limits.

preprint2015arXiv

Foregrounds in Wide-Field Redshifted 21 cm Power Spectra

Detection of 21~cm emission of HI from the epoch of reionization, at redshifts z>6, is limited primarily by foreground emission. We investigate the signatures of wide-field measurements and an all-sky foreground model using the delay spectrum technique that maps the measurements to foreground object locations through signal delays between antenna pairs. We demonstrate interferometric measurements are inherently sensitive to all scales, including the largest angular scales, owing to the nature of wide-field measurements. These wide-field effects are generic to all observations but antenna shapes impact their amplitudes substantially. A dish-shaped antenna yields the most desirable features from a foreground contamination viewpoint, relative to a dipole or a phased array. Comparing data from recent Murchison Widefield Array observations, we demonstrate that the foreground signatures that have the largest impact on the HI signal arise from power received far away from the primary field of view. We identify diffuse emission near the horizon as a significant contributing factor, even on wide antenna spacings that usually represent structures on small scales. For signals entering through the primary field of view, compact emission dominates the foreground contamination. These two mechanisms imprint a characteristic "pitchfork" signature on the "foreground wedge" in Fourier delay space. Based on these results, we propose that selective down-weighting of data based on antenna spacing and time can mitigate foreground contamination substantially by a factor ~100 with negligible loss of sensitivity.

preprint2013arXiv

A study of fundamental limitations to statistical detection of redshifted HI from the epoch of reionization

In this paper we explore for the first time the relative magnitudes of three fundamental sources of uncertainty, namely, foreground contamination, thermal noise and sample variance in detecting the HI power spectrum from the Epoch of Reionization (EoR). We derive limits on the sensitivity of a Fourier synthesis telescope to detect EoR based on its array configuration and a statistical representation of images made by the instrument. We use the Murchison Widefield Array (MWA) configuration for our studies. Using a unified framework for estimating signal and noise components in the HI power spectrum, we derive an expression for and estimate the contamination from extragalactic point-like sources in three-dimensional k-space. Sensitivity for EoR HI power spectrum detection is estimated for different observing modes with MWA. With 1000 hours of observing on a single field using the 128-tile MWA, EoR detection is feasible (S/N > 1 for $k\lesssim 0.8$ Mpc$^{-1}$). Bandpass shaping and refinements to the EoR window are found to be effective in containing foreground contamination, which makes the instrument tolerant to imaging errors. We find that for a given observing time, observing many independent fields of view does not offer an advantage over a single field observation when thermal noise dominates over other uncertainties in the derived power spectrum.

preprint2011arXiv

Variable and Transient Radio Sources in the FIRST Survey

A comprehensive search for variable and transient radio sources has been conducted using ~55,000 snapshot images of the FIRST survey. We present an analysis leading to the discovery of 1,627 variable and transient objects down to mJy levels over a wide range of timescales (few minutes to years). Variations observed range from 20% to a factor of 25. Multi-wavelength matching for counterparts reveals the diverse classes of objects exhibiting variability, ranging from nearby stars and pulsars to galaxies and distant quasars. Interestingly, more than half of the objects in the sample have either no classified counterparts or no corresponding sources at any other wavelength and require multi-wavelength follow-up observations. We discuss these classes of variables and speculate on the identity of objects that lack multi-wavelength counterparts.