Source author record

A. R. Offringa

A. R. Offringa appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

60works
7topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

60 published item(s)

preprint2025arXiv

The impact of diffuse Galactic emission on direction-independent gain calibration in high-redshift 21 cm observations

This study examines the impact of diffuse Galactic emission (DGE) on sky-based direction-independent (DI) gain calibration using realistic forward simulations of Low-Frequency Array (LOFAR) observations of the high-redshift 21 cm signal of neutral hydrogen during the Epoch of Reionization (EoR). We simulated LOFAR observations between 147 and 159 MHz using a sky model that includes a point source catalog and DGE. The simulated observations were DI-gain calibrated with the point source catalog alone, utilizing the LOFAR-EoR data analysis pipeline. A full power spectrum (PS) analysis was conducted to measure the systematic bias, relative to thermal noise, caused by DI-gain calibration using a point-source-only (PSO) sky model, when applied to simulated data that include both point sources and DGE. The results are compared to a ground truth scenario where both the simulated sky and the calibration model include only point sources. Additionally, the cross-coherence between observation pairs was computed to determine whether DI-gain calibration errors are coherent or incoherent in specific regions of PS space as a function of integration time. We find that DI-gain calibration with a PSO sky model that omits DGE introduces a systematic bias in the PS for $k_{\parallel}$ bins < 0.2 $h\,\mathrm{Mpc}^{-1}$. The PS errors in these bins are coherent in time and frequency; therefore, the resulting bias could be mitigated during the foreground removal step using Gaussian Process Regression, as demonstrated in previous studies. In contrast, errors for $k_{\parallel}$ > 0.2 $h\,\mathrm{Mpc}^{-1}$ are largely incoherent and average down as noise. We conclude that, based on our analysis prior to foreground removal, missing DGE in the sky model during DI-gain calibration is unlikely to be a dominant contributor to the excess noise observed in the current LOFAR-EoR upper limits on the 21 cm signal PS.

preprint2022arXiv

Deep sub-arcsecond widefield imaging of the Lockman Hole field at 144 MHz

High quality low-frequency radio surveys have the promise of advancing our understanding of many important topics in astrophysics, including the life cycle of active galactic nuclei (AGN), particle acceleration processes in jets, the history of star formation, and exoplanet magnetospheres. Currently leading low-frequency surveys reach an angular resolution of a few arcseconds. However, this resolution is not yet sufficient to study the more compact and distant sources in detail. Sub-arcsecond resolution is therefore the next milestone in advancing these fields. The biggest challenge at low radio frequencies is the ionosphere. If not adequately corrected for, ionospheric seeing blurs the images to arcsecond or even arcminute scales. Additionally, the required image size to map the degree-scale field of view of low-frequency radio telescopes at this resolution is far greater than what typical soft- and hardware is currently capable of handling. Here we present for the first time (to the best of our knowledge) widefield sub-arcsecond imaging at low radio frequencies. We derive ionospheric corrections in a few dozen individual directions and apply those during imaging efficiently using a recently developed imaging algorithm (arXiv:1407.1943, arXiv:1909.07226). We demonstrate our method by applying it to an eight hour observation of the International LOw Frequency ARray (LOFAR) Telescope (ILT) (arXiv:1305.3550). Doing so we have made a sensitive $7.4\ \mathrm{deg}^2$ $144\ \mathrm{MHz}$ map at a resolution of $0.3''$ reaching $25\ μ\mathrm{Jy\ beam}^{-1}$ near the phase centre. The estimated $250,000$ core hours used to produce this image, fit comfortably in the budget of available computing facilities. This result will enable future mapping of the entire northern low-frequency sky at sub-arcsecond resolution.

preprint2022arXiv

Degree-Scale Galactic Radio Emission at 122 MHz around the North Celestial Pole with LOFAR-AARTFAAC

Aims: Contamination from bright diffuse Galactic thermal and non-thermal radio emission poses crucial challenges in experiments aiming to measure the 21-cm signal of neutral hydrogen from the Cosmic Dawn and Epoch of Reionization. If not included in calibration, this diffuse emission can severely impact the analysis and signal extraction in 21-cm experiments. We examine large-scale diffuse Galactic emission at 122~MHz, around the North Celestial Pole, using the AARTFAAC-HBA system. Methods: In this pilot project, we present the first-ever wide-field image produced with a single sub-band of the data recorded with the AARTFAAC-HBA. We demonstrate two methods: multiscale CLEAN and shapelet decomposition, to model the diffuse emission revealed in the image. We use angular power spectrum metrics to quantify different components of the emission and compare the performance of the two diffuse structure modelling approaches. Results: We observe that the point sources dominate the angular power spectrum ($\ell(\ell+1)C_{\ell}/2π\equiv Δ^2(\ell)$) of the emission in the field on scales $\ell\gtrsim 60$ ($\lesssim 3$~degree). The angular power spectrum after subtraction of compact sources is flat within $20\lesssim \ell \lesssim200$ range, suggesting that the residual power is dominated by the diffuse emission on scales $\ell\lesssim200$. The residual diffuse emission has a brightness temperature variance of $Δ^2_{\ell=180} = (145.64 \pm 13.61)~{\rm K}^2$ at 122~MHz on angular scales of 1~degree, and is consistent with a power-law following $C_{\ell}\propto \ell^{-2.0}$ in $20\lesssim \ell \lesssim200$ range. We also find that, in the current setup, the multiscale CLEAN is suitable to model the compact and diffuse structures on a wide range of angular scales, whereas the shapelet decomposition method better models the large scales, which are of the order of a few degrees and wider.

preprint2022arXiv

Statistical analysis of the causes of excess variance in the 21 cm signal power spectra obtained with the Low-Frequency Array

The detection of the 21 cm signal of neutral hydrogen from the Epoch of Reionization (EoR) is challenging due to bright foreground sources, radio frequency interference (RFI), the ionosphere, and instrumental effects. Even after correcting for these effects in the calibration step and applying foreground removal techniques, the remaining residuals in the observed 21 cm power spectra are still above the thermal noise, which is referred to as the "excess variance." We study potential causes of this excess variance based on 13 nights of data obtained with the Low-Frequency Array (LOFAR). We focused on the impact of gain errors, the sky model, and ionospheric effects on the excess variance by correlating the relevant parameters such as the gain variance over time or frequency, local sidereal time (LST), diffractive scale, and phase structure-function slope with the level of excess variance. Our analysis shows that excess variance has an LST dependence, which is related to the power from the sky. And the simulated Stokes I power spectra from bright sources and the excess variance show a similar progression over LST with the minimum power appearing at LST bin 6h to 9h. This LST dependence is also present in sky images of the residual Stokes I of the observations. In very-wide sky images, we demonstrate that the extra power comes exactly from the direction of bright and distant sources Cassiopeia A and Cygnus A with the array beam patterns. These results suggest that the level of excess variance in the 21 cm signal power spectra is related to sky effects and, hence, it depends on LST. In particular, very bright and distant sources such as Cassiopeia A and Cygnus A can dominate the effect. This is in line with earlier studies and offers a path forward toward a solution since the correlation between the sky-related effects and the excess variance is non-negligible.

preprint2021arXiv

Apertif, Phased Array Feeds for the Westerbork Synthesis Radio Telescope

We describe the APERture Tile In Focus (Apertif) system, a phased array feed (PAF) upgrade of the Westerbork Synthesis Radio Telescope which has transformed this telescope into a high-sensitivity, wide field-of-view L-band imaging and transient survey instrument. Using novel PAF technology, up to 40 partially overlapping beams can be formed on the sky simultaneously, significantly increasing the survey speed of the telescope. With this upgraded instrument, an imaging survey covering an area of 2300 deg2 is being performed which will deliver both continuum and spectral line data sets, of which the first data has been publicly released. In addition, a time domain transient and pulsar survey covering 15,000 deg2 is in progress. An overview of the Apertif science drivers, hardware and software of the upgraded telescope is presented, along with its key performance characteristics.

preprint2020arXiv

Cassiopeia A, Cygnus A, Taurus A, and Virgo A at ultra-low radio frequencies

The four persistent radio sources in the northern sky with the highest flux density at metre wavelengths are Cassiopeia A, Cygnus A, Taurus A, and Virgo A; collectively they are called the A-team. Their flux densities at ultra-low frequencies (<100 MHz) can reach several thousands of janskys, and they often contaminate observations of the low-frequency sky by interfering with image processing. Furthermore, these sources are foreground objects for all-sky observations hampering the study of faint signals, such as the cosmological 21 cm line from the epoch of reionisation. We aim to produce robust models for the surface brightness emission as a function of frequency for the A-team sources at ultra-low frequencies. These models are needed for the calibration and imaging of wide-area surveys of the sky with low-frequency interferometers. This requires obtaining images at an angular resolution better than 15 arcsec with a high dynamic range and good image fidelity. We observed the A-team with the Low Frequency Array (LOFAR) at frequencies between 30 MHz and 77 MHz using the Low Band Antenna (LBA) system. We reduced the datasets and obtained an image for each A-team source. The paper presents the best models to date for the sources Cassiopeia A, Cygnus A, Taurus A, and Virgo A between 30 MHz and 77 MHz. We were able to obtain the aimed resolution and dynamic range in all cases. Owing to its compactness and complexity, observations with the long baselines of the International LOFAR Telescope will be required to improve the source model for Cygnus A further.

preprint2020arXiv

Constraining the intergalactic medium at $z\approx$ 9.1 using LOFAR Epoch of Reionization observations

We derive constraints on the thermal and ionization states of the intergalactic medium (IGM) at redshift $\approx$ 9.1 using new upper limits on the 21-cm power spectrum measured by the LOFAR radio-telescope and a prior on the ionized fraction at that redshift estimated from recent cosmic microwave background (CMB) observations. We have used results from the reionization simulation code GRIZZLY and a Bayesian inference framework to constrain the parameters which describe the physical state of the IGM. We find that, if the gas heating remains negligible, an IGM with ionized fraction $\gtrsim 0.13$ and a distribution of the ionized regions with a characteristic size $\gtrsim 8 ~h^{-1}$ comoving megaparsec (Mpc) and a full width at the half maximum (FWHM) $\gtrsim 16 ~h^{-1}$ Mpc is ruled out. For an IGM with a uniform spin temperature $T_{\rm S} \gtrsim 3$ K, no constraints on the ionized component can be computed. If the large-scale fluctuations of the signal are driven by spin temperature fluctuations, an IGM with a volume fraction $\lesssim 0.34$ of heated regions with a temperature larger than CMB, average gas temperature 7-160 K and a distribution of the heated regions with characteristic size 3.5-70 $h^{-1}$ Mpc and FWHM of $\lesssim 110$ $h^{-1}$ Mpc is ruled out. These constraints are within the 95 per cent credible intervals. With more stringent future upper limits from LOFAR at multiple redshifts, the constraints will become tighter and will exclude an increasingly large region of the parameter space.

preprint2020arXiv

Extreme intra-hour variability of the radio source J1402+5347 discovered with Apertif

The propagation of radio waves from distant compact radio sources through turbulent interstellar plasma in our Galaxy causes these sources to twinkle, a phenomenon called interstellar scintillation. Such scintillations are a unique probe of the micro-arcsecond structure of radio sources as well as of the sub-AU-scale structure of the Galactic interstellar medium. Weak scintillations (i.e. an intensity modulation of a few percent) on timescales of a few days or longer are commonly seen at centimetre wavelengths and are thought to result from the line-of-sight integrated turbulence in the interstellar plasma of the Milky Way. So far, only three sources were known that show more extreme variations, with modulations at the level of some dozen percent on timescales shorter than an hour. This requires propagation through nearby (d <~10 pc) anomalously dense (n_e ~10^2 cm^-3) plasma clouds. Here we report the discovery with Apertif of a source (J1402+5347) showing extreme (~50%) and rapid variations on a timescale of just 6.5 minutes in the decimetre band (1.4 GHz). The spatial scintillation pattern is highly anisotropic, with a semi-minor axis of about 20,000 km. The canonical theory of refractive scintillation constrains the scattering plasma to be within the Oort cloud. The sightline to J1402+5347, however, passes unusually close to the B3 star Alkaid (eta UMa) at a distance of 32 pc. If the scintillations are associated with Alkaid, then the angular size of J1402+5347 along the minor axis of the scintels must be smaller than ~10 micro arcsec yielding an apparent brightness temperature for an isotropic source of >~ 10^ 14K. }

preprint2020arXiv

Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\boldsymbol{z \approx 9.1}$ from LOFAR

A new upper limit on the 21-cm signal power spectrum at a redshift of $z \approx 9.1$ is presented, based on 141 hours of data obtained with the Low-Frequency Array (LOFAR). The analysis includes significant improvements in spectrally-smooth gain-calibration, Gaussian Process Regression (GPR) foreground mitigation and optimally-weighted power spectrum inference. Previously seen `excess power' due to spectral structure in the gain solutions has markedly reduced but some excess power still remains with a spectral correlation distinct from thermal noise. This excess has a spectral coherence scale of $0.25 - 0.45$\,MHz and is partially correlated between nights, especially in the foreground wedge region. The correlation is stronger between nights covering similar local sidereal times. A best 2-$σ$ upper limit of $Δ^2_{21} < (73)^2\,\mathrm{mK^2}$ at $k = 0.075\,\mathrm{h\,cMpc^{-1}}$ is found, an improvement by a factor $\approx 8$ in power compared to the previously reported upper limit. The remaining excess power could be due to residual foreground emission from sources or diffuse emission far away from the phase centre, polarization leakage, chromatic calibration errors, ionosphere, or low-level radio-frequency interference. We discuss future improvements to the signal processing chain that can further reduce or even eliminate these causes of excess power.

preprint2020arXiv

Modelling and peeling extended sources with shapelets: a Fornax A case study

To make a power spectrum (PS) detection of the 21 cm signal from the Epoch of Reionisation (EoR), one must avoid/subtract bright foreground sources. Sources such as Fornax A present a modelling challenge due to spatial structures spanning from arc seconds up to a degree. We compare modelling with multi-scale (MS) CLEAN components to 'shapelets', an alternative set of basis functions. We introduce a new image-based shapelet modelling package, SHAMFI. We also introduce a new CUDA simulation code (WODEN) to generate point source, Gaussian, and shapelet components into visibilities. We test performance by modelling a simulation of Fornax A, peeling the model from simulated visibilities, and producing a residual PS. We find the shapelet method consistently subtracts large-angular-scale emission well, even when the angular-resolution of the data is changed. We find that when increasing the angular-resolution of the data, the MS CLEAN model worsens at large angular-scales. When testing on real MWA data, the expected improvement is not seen in real data because of the other dominating systematics still present. Through further simulation we find the expected differences to be lower than obtainable through current processing pipelines. We conclude shapelets are worthwhile for subtracting extended galaxies, and may prove essential for an EoR detection in the future, once other systematics have been addressed.

preprint2016arXiv

A High Reliability Survey of Discrete Epoch of Reionization Foreground Sources in the MWA EoR0 Field

Detection of the Epoch of Reionization HI signal requires a precise understanding of the intervening galaxies and AGN, both for instrumental calibration and foreground removal. We present a catalogue of 7394 extragalactic sources at 182 MHz detected in the RA=0 field of the Murchison Widefield Array Epoch of Reionization observation programme. Motivated by unprecedented requirements for precision and reliability we develop new methods for source finding and selection. We apply machine learning methods to self-consistently classify the relative reliability of 9490 source candidates. A subset of 7466 are selected based on reliability class and signal-to-noise ratio criteria. These are statistically cross-matched to four other radio surveys using both position and flux density information. We find 7369 sources to have confident matches, including 90 partially resolved sources that split into a total of 192 sub-components. An additional 25 unmatched sources are included as new radio detections. The catalogue sources have a median spectral index of -0.85. Spectral flattening is seen toward lower frequencies with a median of -0.71 predicted at 182 MHz. The astrometric error is 7 arcsec. compared to a 2.3 arcmin. beam FWHM. The resulting catalogue covers approximately 1400 sq. deg. and is complete to approximately 80 mJy within half beam power. This provides the most reliable discrete source sky model available to date in the MWA EoR0 field for precision foreground subtraction.

preprint2016arXiv

CHIPS: The Cosmological HI Power Spectrum Estimator

Detection of the cosmological neutral hydrogen signal from the Epoch of Reionization, and estimation of its basic physical parameters, is the principal scientific aim of many current low-frequency radio telescopes. Here we describe the Cosmological HI Power Spectrum Estimator (CHIPS), an algorithm developed and implemented with data from the Murchison Widefield Array (MWA), to compute the two-dimensional and spherically-averaged power spectrum of brightness temperature fluctuations. The principal motivations for CHIPS are the application of realistic instrumental and foreground models to form the optimal estimator, thereby maximising the likelihood of unbiased signal estimation, and allowing a full covariant understanding of the outputs. CHIPS employs an inverse-covariance weighting of the data through the maximum likelihood estimator, thereby allowing use of the full parameter space for signal estimation ("foreground suppression"). We describe the motivation for the algorithm, implementation, application to real and simulated data, and early outputs. Upon application to a set of 3 hours of data, we set a 2$σ$ upper limit on the EoR dimensionless power at $k=0.05$~h.Mpc$^{-1}$ of $Δ_k^2<7.6\times{10^4}$~mK$^2$ in the redshift range $z=[6.2-6.6]$, consistent with previous estimates.

preprint2016arXiv

Compression of interferometric radio-astronomical data

The volume of radio-astronomical data is a considerable burden in the processing and storing of radio observations with high time and frequency resolutions and large bandwidths. Lossy compression of interferometric radio-astronomical data is considered to reduce the volume of visibility data and to speed up processing. A new compression technique named "Dysco" is introduced that consists of two steps: a normalization step, in which grouped visibilities are normalized to have a similar distribution; and a quantization and encoding step, which rounds values to a given quantization scheme using a dithering scheme. Several non-linear quantization schemes are tested and combined with different methods for normalizing the data. Four data sets with observations from the LOFAR and MWA telescopes are processed with different processing strategies and different combinations of normalization and quantization. The effects of compression are measured in image plane. The noise added by the lossy compression technique acts like normal system noise. The accuracy of Dysco is depending on the signal-to-noise ratio of the data: noisy data can be compressed with a smaller loss of image quality. Data with typical correlator time and frequency resolutions can be compressed by a factor of 6.4 for LOFAR and 5.3 for MWA observations with less than 1% added system noise. An implementation of the compression technique is released that provides a Casacore storage manager and allows transparent encoding and decoding. Encoding and decoding is faster than the read/write speed of typical disks. The technique can be used for LOFAR and MWA to reduce the archival space requirements for storing observed data. Data from SKA-low will likely be compressible by the same amount as LOFAR. The same technique can be used to compress data from other telescopes, but a different bit-rate might be required.

preprint2016arXiv

Delay Spectrum with Phase-Tracking Arrays: Extracting the HI power spectrum from the Epoch of Reionization

The Detection of redshifted 21 cm emission from the epoch of reionization (EoR) is a challenging task owing to strong foregrounds that dominate the signal. In this paper, we propose a general method, based on the delay spectrum approach, to extract HI power spectra that is applicable to tracking observations using an imaging radio interferometer (Delay Spectrum with Imaging Arrays (DSIA)). Our method is based on modelling the HI signal taking into account the impact of wide field effects such as the $w$-term which are then used as appropriate weights in cross-correlating the measured visibilities. Our method is applicable to any radio interferometer that tracks a phase center and could be utilized for arrays such as MWA, LOFAR, GMRT, PAPER and HERA. In the literature the delay spectrum approach has been implemented for near-redundant baselines using drift scan observations. In this paper we explore the scheme for non-redundant tracking arrays, and this is the first application of delay spectrum methodology to such data to extract the HI signal. We analyze 3 hours of MWA tracking data on the EoR1 field. We present both 2-dimensional ($k_\parallel,k_\perp$) and 1-dimensional (k) power spectra from the analysis. Our results are in agreement with the findings of other pipelines developed to analyse the MWA EoR data.

preprint2016arXiv

First Limits on the 21 cm Power Spectrum during the Epoch of X-ray heating

We present first results from radio observations with the Murchison Widefield Array seeking to constrain the power spectrum of 21 cm brightness temperature fluctuations between the redshifts of 11.6 and 17.9 (113 and 75 MHz). Three hours of observations were conducted over two nights with significantly different levels of ionospheric activity. We use these data to assess the impact of systematic errors at low frequency, including the ionosphere and radio-frequency interference, on a power spectrum measurement. We find that after the 1-3 hours of integration presented here, our measurements at the Murchison Radio Observatory are not limited by RFI, even within the FM band, and that the ionosphere does not appear to affect the level of power in the modes that we expect to be sensitive to cosmology. Power spectrum detections, inconsistent with noise, due to fine spectral structure imprinted on the foregrounds by reflections in the signal-chain, occupy the spatial Fourier modes where we would otherwise be most sensitive to the cosmological signal. We are able to reduce this contamination using calibration solutions derived from autocorrelations so that we achieve an sensitivity of $10^4$ mK on comoving scales $k\lesssim 0.5 h$Mpc$^{-1}$. This represents the first upper limits on the $21$ cm power spectrum fluctuations at redshifts $12\lesssim z \lesssim 18$ but is still limited by calibration systematics. While calibration improvements may allow us to further remove this contamination, our results emphasize that future experiments should consider carefully the existence of and their ability to calibrate out any spectral structure within the EoR window.

preprint2016arXiv

First Season MWA EoR Power Spectrum Results at Redshift 7

The Murchison Widefield Array (MWA) has collected hundreds of hours of Epoch of Reionization (EoR) data and now faces the challenge of overcoming foreground and systematic contamination to reduce the data to a cosmological measurement. We introduce several novel analysis techniques such as cable reflection calibration, hyper-resolution gridding kernels, diffuse foreground model subtraction, and quality control methods. Each change to the analysis pipeline is tested against a two dimensional power spectrum figure of merit to demonstrate improvement. We incorporate the new techniques into a deep integration of 32 hours of MWA data. This data set is used to place a systematic-limited upper limit on the cosmological power spectrum of $Δ^2 \leq 2.7 \times 10^4$ mK$^2$ at $k=0.27$ h~Mpc$^{-1}$ and $z=7.1$, consistent with other published limits, and a modest improvement (factor of 1.4) over previous MWA results. From this deep analysis we have identified a list of improvements to be made to our EoR data analysis strategies. These improvements will be implemented in the future and detailed in upcoming publications.

preprint2016arXiv

High-energy sources at low radio frequency: the Murchison Widefield Array view of Fermi blazars

Low-frequency radio arrays are opening a new window for the study of the sky, both to study new phenomena and to better characterize known source classes. Being flat-spectrum sources, blazars are so far poorly studied at low radio frequencies. We characterize the spectral properties of the blazar population at low radio frequency compare the radio and high-energy properties of the gamma-ray blazar population, and search for radio counterparts of unidentified gamma-ray sources. We cross-correlated the 6,100 deg^2 Murchison Widefield Array Commissioning Survey catalogue with the Roma blazar catalogue, the third catalogue of active galactic nuclei detected by Fermi-LAT, and the unidentified members of the entire third catalogue of gamma-ray sources detected by \fermilat. When available, we also added high-frequency radio data from the Australia Telescope 20 GHz catalogue. We find low-frequency counterparts for 186 out of 517 (36%) blazars, 79 out of 174 (45%) gamma-ray blazars, and 8 out of 73 (11%) gamma-ray blazar candidates. The mean low-frequency (120--180 MHz) blazar spectral index is $\langle α_\mathrm{low} \rangle=0.57\pm0.02$: blazar spectra are flatter than the rest of the population of low-frequency sources, but are steeper than at $\sim$GHz frequencies. Low-frequency radio flux density and gamma-ray energy flux display a mildly significant and broadly scattered correlation. Ten unidentified gamma-ray sources have a (probably fortuitous) positional match with low radio frequency sources. Low-frequency radio astronomy provides important information about sources with a flat radio spectrum and high energy. However, the relatively low sensitivity of the present surveys still misses a significant fraction of these objects. Upcoming deeper surveys, such as the GaLactic and Extragalactic All-Sky MWA (GLEAM) survey, will provide further insight into this population.

preprint2016arXiv

Ionospheric Modelling using GPS to Calibrate the MWA. II: Regional ionospheric modelling using GPS and GLONASS to estimate ionospheric gradients

We estimate spatial gradients in the ionosphere using the Global Positioning System (GPS) and GLONASS (Russian global navigation system) observations, utilising data from multiple GPS stations in the vicinity of Murchison Radio-astronomy Observatory (MRO). In previous work the ionosphere was characterised using a single-station to model the ionosphere as a single layer of fixed height and this was compared with ionospheric data derived from radio astronomy observations obtained from the Murchison Widefield Array (MWA). Having made improvements to our data quality (via cycle slip detection and repair) and incorporating data from the GLONASS system, we now present a multi-station approach. These two developments significantly improve our modelling of the ionosphere. We also explore the effects of a variable-height model. We conclude that modelling the small-scale features in the ionosphere that have been observed with the MWA will require a much denser network of Global Navigation Satellite System (GNSS) stations than is currently available at the MRO.

preprint2016arXiv

Limits of noise and confusion in the MWA GLEAM year 1 survey

The GaLactic and Extragalactic All-sky MWA survey (GLEAM) is a new relatively low resolution, contiguous 72-231 MHz survey of the entire sky south of declination +25 deg. In this paper, we outline one approach to determine the relative contribution of system noise, classical confusion and sidelobe confusion in GLEAM images. An understanding of the noise and confusion properties of GLEAM is essential if we are to fully exploit GLEAM data and improve the design of future low-frequency surveys. Our early results indicate that sidelobe confusion dominates over the entire frequency range, implying that enhancements in data processing have the potential to further reduce the noise.

preprint2016arXiv

Limits on Fast Radio Bursts and other transient sources at 182 MHz using the Murchison Widefield Array

We present a survey for transient and variable sources, on timescales from 28 seconds to $\sim$1 year, using the Murchison Widefield Array (MWA) at 182 MHz. Down to a detection threshold of 0.285 Jy, no transient candidates were identified, making this the most constraining low-frequency survey to date and placing a limit on the surface density of transients of $<4.1 \times 10^{-7}$ deg$^{-2}$ for the shortest timescale considered. At these frequencies, emission from Fast Radio Bursts (FRBs) is expected to be detectable in the shortest timescale images without any corrections for interstellar or intergalactic dispersion. At an FRB limiting flux density of 7980 Jy, we find a rate of $<$82 FRBs per sky per day for dispersion measures $<$700 pc cm$^{-3}$. Assuming a cosmological population of standard candles, our rate limits are consistent with the FRB rates obtained by Thornton et al. (2013) if they have a flat spectral slope. Finally, we conduct an initial variability survey of sources in the field with flux densities $\gtrsim$0.5 Jy and identify no sources with significant variability in their lightcurves. However, we note that substantial further work is required to fully characterise both the short term and low level variability within this field.

preprint2016arXiv

Low frequency observations of linearly polarized structures in the interstellar medium near the south Galactic pole

We present deep polarimetric observations at 154 MHz with the Murchison Widefield Array (MWA), covering 625 deg^2 centered on RA=0 h, Dec=-27 deg. The sensitivity available in our deep observations allows an in-band, frequency-dependent analysis of polarized structure for the first time at long wavelengths. Our analysis suggests that the polarized structures are dominated by intrinsic emission but may also have a foreground Faraday screen component. At these wavelengths, the compactness of the MWA baseline distribution provides excellent snapshot sensitivity to large-scale structure. The observations are sensitive to diffuse polarized emission at ~54' resolution with a sensitivity of 5.9 mJy beam^-1 and compact polarized sources at ~2.4' resolution with a sensitivity of 2.3 mJy beam^-1 for a subset (400 deg^2) of this field. The sensitivity allows the effect of ionospheric Faraday rotation to be spatially and temporally measured directly from the diffuse polarized background. Our observations reveal large-scale structures (~1 deg - 8 deg in extent) in linear polarization clearly detectable in ~2 minute snapshots, which would remain undetectable by interferometers with minimum baseline lengths >110 m at 154 MHz. The brightness temperature of these structures is on average 4 K in polarized intensity, peaking at 11 K. Rotation measure synthesis reveals that the structures have Faraday depths ranging from -2 rad m^-2 to 10 rad m^-2 with a large fraction peaking at ~+1 rad m^-2. We estimate a distance of 51+/-20 pc to the polarized emission based on measurements of the in-field pulsar J2330-2005. We detect four extragalactic linearly polarized point sources within the field in our compact source survey. Based on the known polarized source population at 1.4 GHz and non-detections at 154 MHz, we estimate an upper limit on the depolarization ratio of 0.08 from 1.4 GHz to 154 MHz.

preprint2016arXiv

Low Radio Frequency Observations and Spectral Modelling of the Remnant of Supernova 1987A

We present Murchison Widefield Array observations of the supernova remnant (SNR) 1987A between 72 and 230 MHz, representing the lowest frequency observations of the source to date. This large lever arm in frequency space constrains the properties of the circumstellar medium created by the progenitor of SNR 1987A when it was in its red supergiant phase. As of late-2013, the radio spectrum of SNR 1987A between 72 MHz and 8.64 GHz does not show any deviation from a non-thermal power-law with a spectral index of $-0.74 \pm 0.02$. This spectral index is consistent with that derived at higher frequencies, beneath 100 GHz, and with a shock in its adiabatic phase. A spectral turnover due to free-free absorption by the circumstellar medium has to occur below 72 MHz, which places upper limits on the optical depth of $\leq$ 0.1 at a reference frequency of 72 MHz, emission measure of $\lesssim$ 13,000 cm$^{-6}$ pc, and an electron density of $\lesssim$ 110 cm$^{-3}$. This upper limit on the electron density is consistent with the detection of prompt radio emission and models of the X-ray emission from the supernova. The electron density upper limit implies that some hydrodynamic simulations derived a red supergiant mass loss rate that is too high, or a wind velocity that is too low. The mass loss rate of $\sim 5 \times 10^{-6}$ $M_{\odot}$ yr$^{-1}$ and wind velocity of 10 km s$^{-1}$ obtained from optical observations are consistent with our upper limits, predicting a current turnover frequency due to free-free absorption between 5 and 60 MHz.

preprint2016arXiv

Parametrising Epoch of Reionization foregrounds: A deep survey of low-frequency point-source spectra with the MWA

Experiments that pursue detection of signals from the Epoch of Reionization (EoR) are relying on spectral smoothness of source spectra at low frequencies. This article empirically explores the effect of foreground spectra on EoR experiments by measuring high-resolution full-polarization spectra for the 586 brightest unresolved sources in one of the MWA EoR fields using 45 h of observation. A novel peeling scheme is used to subtract 2500 sources from the visibilities with ionospheric and beam corrections, resulting in the deepest, confusion-limited MWA image so far. The resulting spectra are found to be affected by instrumental effects, which limit the constraints that can be set on source-intrinsic spectral structure. The sensitivity and power-spectrum of the spectra are analysed, and it is found that the spectra of residuals are dominated by PSF sidelobes from nearby undeconvolved sources. We release a catalogue describing the spectral parameters for each measured source.

preprint2016arXiv

Probing Ionospheric Structures using the LOFAR radio telescope

LOFAR is the LOw Frequency Radio interferometer ARray located at mid-latitude ($52^{\circ} 53'N$). Here, we present results on ionospheric structures derived from 29 LOFAR nighttime observations during the winters of 2012/2013 and 2013/2014. We show that LOFAR is able to determine differential ionospheric TEC values with an accuracy better than 1 mTECU over distances ranging between 1 and 100 km. For all observations the power law behavior of the phase structure function is confirmed over a long range of baseline lengths, between $1$ and $80$ km, with a slope that is in general larger than the $5/3$ expected for pure Kolmogorov turbulence. The measured average slope is $1.89$ with a one standard deviation spread of $0.1$. The diffractive scale, i.e. the length scale where the phase variance is $1\, \mathrm{rad^2}$, is shown to be an easily obtained single number that represents the ionospheric quality of a radio interferometric observation. A small diffractive scale is equivalent to high phase variability over the field of view as well as a short time coherence of the signal, which limits calibration and imaging quality. For the studied observations the diffractive scales at $150$ MHz vary between $3.5$ and $30\,$ km. A diffractive scale above $5$ km, pertinent to about $90 \%$ of the observations, is considered sufficient for the high dynamic range imaging needed for the LOFAR Epoch of Reionization project. For most nights the ionospheric irregularities were anisotropic, with the structures being aligned with the Earth magnetic field in about $60\%$ of the observations.

preprint2016arXiv

The 154 MHz radio sky observed by the Murchison Widefield Array: noise, confusion and first source count analyses

We analyse a 154 MHz image made from a 12 h observation with the Murchison Widefield Array (MWA) to determine the noise contribution and behaviour of the source counts down to 30 mJy. The MWA image has a bandwidth of 30.72 MHz, a field-of-view within the half-power contour of the primary beam of 570 deg^2, a resolution of 2.3 arcmin and contains 13,458 sources above 5 sigma. The rms noise in the centre of the image is 4-5 mJy/beam. The MWA counts are in excellent agreement with counts from other instruments and are the most precise ever derived in the flux density range 30-200 mJy due to the sky area covered. Using the deepest available source count data, we find that the MWA image is affected by sidelobe confusion noise at the ~3.5 mJy/beam level, due to incompletely-peeled and out-of-image sources, and classical confusion becomes apparent at ~1.7 mJy/beam. This work highlights that (i) further improvements in ionospheric calibration and deconvolution imaging techniques would be required to probe to the classical confusion limit and (ii) the shape of low-frequency source counts, including any flattening towards lower flux densities, must be determined from deeper ~150 MHz surveys as it cannot be directly inferred from higher frequency data.

preprint2016arXiv

The Importance of Wide-field Foreground Removal for 21 cm Cosmology: A Demonstration With Early MWA Epoch of Reionization Observations

In this paper we present observations, simulations, and analysis demonstrating the direct connection between the location of foreground emission on the sky and its location in cosmological power spectra from interferometric redshifted 21 cm experiments. We begin with a heuristic formalism for understanding the mapping of sky coordinates into the cylindrically averaged power spectra measurements used by 21 cm experiments, with a focus on the effects of the instrument beam response and the associated sidelobes. We then demonstrate this mapping by analyzing power spectra with both simulated and observed data from the Murchison Widefield Array. We find that removing a foreground model which includes sources in both the main field-of-view and the first sidelobes reduces the contamination in high k_parallel modes by several percent relative to a model which only includes sources in the main field-of-view, with the completeness of the foreground model setting the principal limitation on the amount of power removed. While small, a percent-level amount of foreground power is in itself more than enough to prevent recovery of any EoR signal from these modes. This result demonstrates that foreground subtraction for redshifted 21 cm experiments is truly a wide-field problem, and algorithms and simulations must extend beyond the main instrument field-of-view to potentially recover the full 21 cm power spectrum.

preprint2016arXiv

The Murchison Widefield Array 21 cm Power Spectrum Analysis Methodology

We present the 21 cm power spectrum analysis approach of the Murchison Widefield Array Epoch of Reionization project. In this paper, we compare the outputs of multiple pipelines for the purpose of validating statistical limits cosmological hydrogen at redshifts between 6 and 12. Multiple, independent, data calibration and reduction pipelines are used to make power spectrum limits on a fiducial night of data. Comparing the outputs of imaging and power spectrum stages highlights differences in calibration, foreground subtraction and power spectrum calculation. The power spectra found using these different methods span a space defined by the various tradeoffs between speed, accuracy, and systematic control. Lessons learned from comparing the pipelines range from the algorithmic to the prosaically mundane; all demonstrate the many pitfalls of neglecting reproducibility. We briefly discuss the way these different methods attempt to handle the question of evaluating a significant detection in the presence of foregrounds.

preprint2016arXiv

Time-domain and spectral properties of pulsars at 154 MHz

We present 154 MHz Murchison Widefield Array imaging observations and variability information for a sample of pulsars. Over the declination range $-80^{\circ} < δ < 10^{\circ}$ we detect 17 known pulsars with mean flux density greater than 0.3 Jy. We explore the variability properties of this sample on timescales of minutes to years. For three of these pulsars, PSR J0953+0755, PSR J0437-4715 and PSR J0630-2834 we observe interstellar scintillation and variability on timescales of greater than 2 minutes. One further pulsar, PSR J0034-0721, showed significant variability, the physical origins of which are difficult to determine. The dynamic spectra for PSR J0953+0755 and PSR J0437-4715 show discrete time and frequency structure consistent with diffractive interstellar scintillation and we present the scintillation bandwidth and timescales from these observations. The remaining pulsars within our sample were statistically non-variable. We also explore the spectral properties of this sample and find spectral curvature in pulsars PSR J0835-4510, PSR J1752-2806 and PSR J0437-4715.

preprint2015arXiv

Broadband Spectral Modeling of the Extreme Gigahertz-Peaked Spectrum Radio Source PKS B0008-421

We present broadband observations and spectral modeling of PKS B0008-421, and identify it as an extreme gigahertz-peaked spectrum (GPS) source. PKS B0008-421 is characterized by the steepest known spectral slope below the turnover, close to the theoretical limit of synchrotron self-absorption, and the smallest known spectral width of any GPS source. Spectral coverage of the source spans from 0.118 to 22 GHz, which includes data from the Murchison Widefield Array and the wide bandpass receivers on the Australia Telescope Compact Array. We have implemented a Bayesian inference model fitting routine to fit the data with various absorption models. We find that without the inclusion of a high-frequency exponential break the absorption models can not accurately fit the data, with significant deviations above and below the peak in the radio spectrum. The addition of a high-frequency break provides acceptable spectral fits for the inhomogeneous free-free absorption and double-component synchrotron self-absorption models, with the inhomogeneous free-free absorption model statistically favored. The requirement of a high-frequency spectral break implies that the source has ceased injecting fresh particles. Additional support for the inhomogeneous free-free absorption model as being responsible for the turnover in the spectrum is given by the consistency between the physical parameters derived from the model fit and the implications of the exponential spectral break, such as the necessity of the source being surrounded by a dense ambient medium to maintain the peak frequency near the gigahertz region. The discovery of PKS B0008-421 suggests that the next generation of low radio frequency surveys could reveal a large population of GPS sources that have ceased activity, and that a portion of the ultra-steep spectrum source population could be composed of these GPS sources in a relic phase.

preprint2015arXiv

Confirmation of Wide-Field Signatures in Redshifted 21 cm Power Spectra

We confirm our recent prediction of the "pitchfork" foreground signature in power spectra of high-redshift 21 cm measurements where the interferometer is sensitive to large-scale structure on all baselines. This is due to the inherent response of a wide-field instrument and is characterized by enhanced power from foreground emission in Fourier modes adjacent to those considered to be the most sensitive to the cosmological H I signal. In our recent paper, many signatures from the simulation that predicted this feature were validated against Murchison Widefield Array (MWA) data, but this key pitchfork signature was close to the noise level. In this paper, we improve the data sensitivity through the coherent averaging of 12 independent snapshots with identical instrument settings and provide the first confirmation of the prediction with a signal-to-noise ratio > 10. This wide-field effect can be mitigated by careful antenna designs that suppress sensitivity near the horizon. Simple models for antenna apertures that have been proposed for future instruments such as the Hydrogen Epoch of Reionization Array and the Square Kilometre Array indicate they should suppress foreground leakage from the pitchfork by ~40 dB relative to the MWA and significantly increase the likelihood of cosmological signal detection in these critical Fourier modes in the three-dimensional power spectrum.

preprint2015arXiv

Empirical Covariance Modeling for 21 cm Power Spectrum Estimation: A Method Demonstration and New Limits from Early Murchison Widefield Array 128-Tile Data

The separation of the faint cosmological background signal from bright astrophysical foregrounds remains one of the most daunting challenges of mapping the high-redshift intergalactic medium with the redshifted 21 cm line of neutral hydrogen. Advances in mapping and modeling of diffuse and point source foregrounds have improved subtraction accuracy, but no subtraction scheme is perfect. Precisely quantifying the errors and error correlations due to missubtracted foregrounds allows for both the rigorous analysis of the 21 cm power spectrum and for the maximal isolation of the "EoR window" from foreground contamination. We present a method to infer the covariance of foreground residuals from the data itself in contrast to previous attempts at a priori modeling. We demonstrate our method by setting limits on the power spectrum using a 3 h integration from the 128-tile Murchison Widefield Array. Observing between 167 and 198 MHz, we find at 95% confidence a best limit of Delta^2(k) < 3.7 x 10^4 mK^2 at comoving scale k = 0.18 hMpc^-1 and at z = 6.8, consistent with existing limits.

preprint2015arXiv

Foregrounds in Wide-Field Redshifted 21 cm Power Spectra

Detection of 21~cm emission of HI from the epoch of reionization, at redshifts z>6, is limited primarily by foreground emission. We investigate the signatures of wide-field measurements and an all-sky foreground model using the delay spectrum technique that maps the measurements to foreground object locations through signal delays between antenna pairs. We demonstrate interferometric measurements are inherently sensitive to all scales, including the largest angular scales, owing to the nature of wide-field measurements. These wide-field effects are generic to all observations but antenna shapes impact their amplitudes substantially. A dish-shaped antenna yields the most desirable features from a foreground contamination viewpoint, relative to a dipole or a phased array. Comparing data from recent Murchison Widefield Array observations, we demonstrate that the foreground signatures that have the largest impact on the HI signal arise from power received far away from the primary field of view. We identify diffuse emission near the horizon as a significant contributing factor, even on wide antenna spacings that usually represent structures on small scales. For signals entering through the primary field of view, compact emission dominates the foreground contamination. These two mechanisms imprint a characteristic "pitchfork" signature on the "foreground wedge" in Fourier delay space. Based on these results, we propose that selective down-weighting of data based on antenna spacing and time can mitigate foreground contamination substantially by a factor ~100 with negligible loss of sensitivity.

preprint2015arXiv

Ionospheric modelling using GPS to calibrate the MWA. 1: Comparison of first order ionospheric effects between GPS models and MWA observations

We compare first order (refractive) ionospheric effects seen by the Murchison Widefield Array (MWA) with the ionosphere as inferred from Global Positioning System (GPS) data. The first order ionosphere manifests itself as a bulk position shift of the observed sources across an MWA field of view. These effects can be computed from global ionosphere maps provided by GPS analysis centres, namely the Center for Orbit Determination in Europe (CODE), using data from globally distributed GPS receivers. However, for the more accurate local ionosphere estimates required for precision radio astronomy applications, data from local GPS networks needs to be incorporated into ionospheric modelling. For GPS observations, the ionospheric parameters are biased by GPS receiver instrument delays, among other effects, also known as receiver Differential Code Biases (DCBs). The receiver DCBs need to be estimated for any non-CODE GPS station used for ionosphere modelling, a requirement for establishing dense GPS networks in arbitrary locations in the vicinity of the MWA. In this work, single GPS station-based ionospheric modelling is performed at a time resolution of 10 minutes. Also the receiver DCBs are estimated for selected Geoscience Australia (GA) GPS receivers, located at Murchison Radio Observatory (MRO1), Yarragadee (YAR3), Mount Magnet (MTMA) and Wiluna (WILU). The ionospheric gradients estimated from GPS are compared with the ionospheric gradients inferred from radio source position shifts observed with the MWA. The ionospheric gradients at all the GPS stations show a correlation with the gradients observed with the MWA. The ionosphere estimates obtained using GPS measurements show promise in terms of providing calibration information for the MWA.

preprint2015arXiv

Linear polarization structures in LOFAR observations of the interstellar medium in the 3C196 field

This study aims to characterize linear polarization structures in LOFAR observations of the interstellar medium (ISM) in the 3C196 field, one of the primary fields of the LOFAR-Epoch of Reionization key science project. We have used the high band antennas (HBA) of LOFAR to image this region and Rotation Measure (RM) synthesis to unravel the distribution of polarized structures in Faraday depth. The brightness temperature of the detected Galactic emission is $5-15~{\rm K}$ in polarized intensity and covers the range from -3 to +8 ${\rm rad~m^{-2}}$ in Faraday depth. The most interesting morphological feature is a strikingly straight filament at a Faraday depth of $+0.5~{\rm rad~m^{-2}}$ running from north to south, right through the centre of the field and parallel to the Galactic plane. There is also an interesting system of linear depolarization canals conspicuous in an image showing the peaks of Faraday spectra. We used the Westerbork Synthesis Radio Telescope (WSRT) at 350 MHz to image the same region. For the first time, we see some common morphology in the RM cubes made at 150 and 350~{\rm MHz}. There is no indication of diffuse emission in total intensity in the interferometric data, in line with results at higher frequencies and previous LOFAR observations. Based on our results, we determined physical parameters of the ISM and proposed a simple model that may explain the observed distribution of the intervening magneto-ionic medium. The mean line-of-sight magnetic field component, $B_\parallel$, is determined to be $0.3\pm0.1~{\rm μG}$ and its spatial variation across the 3C196 field is $0.1~{\rm μG}$. The filamentary structure is probably an ionized filament in the ISM, located somewhere within the Local Bubble. This filamentary structure shows an excess in thermal electron density ($n_e B_\parallel>6.2~{\rm cm^{-3}μG}$) compared to its surroundings.

preprint2015arXiv

Polarization leakage in Epoch of Reionization windows: I. LOFAR observations of the 3C196 field

Detection of the 21-cm signal coming from the epoch of reionization (EoR) is challenging especially because, even after removing the foregrounds, the residual Stokes $I$ maps contain leakage from polarized emission that can mimic the signal. Here, we discuss the instrumental polarization of LOFAR and present realistic simulations of the leakages between Stokes parameters. From the LOFAR observations of polarized emission in the 3C196 field, we have quantified the level of polarization leakage caused by the nominal model beam of LOFAR, and compared it with the EoR signal using power spectrum analysis. We found that at 134--166 MHz, within the central 4$^\circ$ of the field the $(Q,U)\rightarrow I$ leakage power is lower than the EoR signal at $k<0.3$ Mpc$^{-1}$. The leakage was found to be localized around a Faraday depth of 0, and the rms of the leakage as a fraction of the rms of the polarized emission was shown to vary between 0.2-0.3\%, both of which could be utilized in the removal of leakage. Moreover, we could define an `EoR window' in terms of the polarization leakage in the cylindrical power spectrum above the PSF-induced wedge and below $k_\parallel\sim 0.5$ Mpc$^{-1}$, and the window extended up to $k_\parallel\sim 1$ Mpc$^{-1}$ at all $k_\perp$ when 70\% of the leakage had been removed. These LOFAR results show that even a modest polarimetric calibration over a field of view of $\lesssim 4^\circ$ in the future arrays like SKA will ensure that the polarization leakage remains well below the expected EoR signal at the scales of 0.02-1 Mpc$^{-1}$.

preprint2015arXiv

Power spectrum analysis of ionospheric fluctuations with the Murchison Widefield Array

Low-frequency, wide field-of-view (FoV) radio telescopes such as the Murchison Widefield Array (MWA) enable the ionosphere to be sampled at high spatial completeness. We present the results of the first power spectrum analysis of ionospheric fluctuations in MWA data, where we examined the position offsets of radio sources appearing in two datasets. The refractive shifts in the positions of celestial sources are proportional to spatial gradients in the electron column density transverse to the line of sight. These can be used to probe plasma structures and waves in the ionosphere. The regional (10-100 km) scales probed by the MWA, determined by the size of its FoV and the spatial density of radio sources (typically thousands in a single FoV), complement the global (100-1000 km) scales of GPS studies and local (0.01-1 km) scales of radar scattering measurements. Our data exhibit a range of complex structures and waves. Some fluctuations have the characteristics of travelling ionospheric disturbances (TIDs), while others take the form of narrow, slowly-drifting bands aligned along the Earth's magnetic field.

preprint2015arXiv

Simulating the 21cm forest detectable with LOFAR and SKA in the spectra of high-z GRBs

We investigate the feasibility of detecting 21cm absorption features in the afterglow spectra of high redshift long Gamma Ray Bursts (GRBs). This is done employing simulations of cosmic reionization, together with the instrumental characteristics of the LOw Frequency ARray (LOFAR). We find that absorption features could be marginally (with a S/N larger than a few) detected by LOFAR at z>7 if the GRB originated from PopIII stars, while the detection would be easier if the noise were reduced by one order of magnitude, i.e. similar to what is expected for the first phase of the Square Kilometer Array (SKA1-low). On the other hand, more standard GRBs are too dim to be detected even with ten times the sensitivity of SKA1-low, and only in the most optimistic case can a S/N larger than a few be reached at z>9.

preprint2015arXiv

The low-frequency environment of the Murchison Widefield Array: radio-frequency interference analysis and mitigation

The Murchison Widefield Array (MWA) is a new low-frequency interferometric radio telescope built in Western Australia at one of the locations of the future Square Kilometre Array (SKA). We describe the automated radio-frequency interference (RFI) detection strategy implemented for the MWA, which is based on the AOFlagger platform, and present 72-231-MHz RFI statistics from 10 observing nights. RFI detection removes 1.1% of the data. RFI from digital TV (DTV) is observed 3% of the time due to occasional ionospheric or atmospheric propagation. After RFI detection and excision, almost all data can be calibrated and imaged without further RFI mitigation efforts, including observations within the FM and DTV bands. The results are compared to a previously published Low-Frequency Array (LOFAR) RFI survey. The remote location of the MWA results in a substantially cleaner RFI environment compared to LOFAR's radio environment, but adequate detection of RFI is still required before data can be analysed. We include specific recommendations designed to make the SKA more robust to RFI, including: the availability of sufficient computing power for RFI detection; accounting for RFI in the receiver design; a smooth band-pass response; and the capability of RFI detection at high time and frequency resolution (second and kHz-scale respectively).

preprint2014arXiv

First Look Murchison Widefield Array observations of Abell 3667

The Murchison Widefield Array (MWA) is a new low frequency interferometric radio telescope, operating in the remote Murchison Radio Observatory in Western Australia. In this paper we present the first MWA observations of the well known radio relics in Abell 3667 (A3667) between 120 and 226 MHz. We clearly detect the radio relics in A3667 and present flux estimates and spectral indices for these features. The average spectral index of the north-west (NW) and south-east (SE) relics is -0.9 +/- 0.1 between 120 and 1400 MHz. We are able to resolve spatial variation in the spectral index of the NW relic from -1.7 to -0.4, which is consistent with results found at higher frequencies.

preprint2014arXiv

Initial LOFAR observations of Epoch of Reionization windows: II. Diffuse polarized emission in the ELAIS-N1 field

This study aims to characterise the polarized foreground emission in the ELAIS-N1 field and to address its possible implications for the extraction of the cosmological 21-cm signal from the Low-Frequency Array - Epoch of Reionization (LOFAR-EoR) data. We use the high band antennas of LOFAR to image this region and RM-synthesis to unravel structures of polarized emission at high Galactic latitudes. The brightness temperature of the detected Galactic emission is on average 4 K in polarized intensity and covers the range from -10 to +13rad m^-2 in Faraday depth. The total polarized intensity and polarization angle show a wide range of morphological features. We have also used the Westerbork Synthesis Radio Telescope (WSRT) at 350 MHz to image the same region. The LOFAR and WSRT images show a similar complex morphology, at comparable brightness levels, but their spatial correlation is very low. The fractional polarization at 150 MHz, expressed as a percentage of the total intensity, amounts to 1.5%. There is no indication of diffuse emission in total intensity in the interferometric data, in line with results at higher frequencies. The wide frequency range, good angular resolution and good sensitivity make LOFAR an exquisite instrument for studying Galactic polarized emission at a resolution of 1-2 rad m^-2 in Faraday depth. The different polarised patterns observed at 150 MHz and 350 MHz are consistent with different source distributions along the line of sight wring in a variety of Faraday thin regions of emission. The presence of polarised foregrounds is a serious complication for Epoch of Reionization experiments. To avoid the leakage of polarized emission into total intensity, which can depend on frequency, we need to calibrate the instrumental polarization across the field of view to a small fraction of 1%.

preprint2014arXiv

LOFAR low-band antenna observations of the 3C295 and Bootes fields: source counts and ultra-steep spectrum sources

We present LOFAR Low Band observations of the Bootes and 3C295 fields. Our images made at 34, 46, and 62 MHz reach noise levels of 12, 8, and 5 mJy beam$^{-1}$, making them the deepest images ever obtained in this frequency range. In total, we detect between 300 and 400 sources in each of these images, covering an area of 17 to 52 deg$^{2}$. From the observations we derive Euclidean-normalized differential source counts. The 62 MHz source counts agree with previous GMRT 153 MHz and VLA 74 MHz differential source counts, scaling with a spectral index of $-0.7$. We find that a spectral index scaling of $-0.5$ is required to match up the LOFAR 34 MHz source counts. This result is also in agreement with source counts from the 38 MHz 8C survey, indicating that the average spectral index of radio sources flattens towards lower frequencies. We also find evidence for spectral flattening using the individual flux measurements of sources between 34 and 1400 MHz and by calculating the spectral index averaged over the source population. To select ultra-steep spectrum ($α< -1.1$) radio sources, that could be associated with massive high redshift radio galaxies, we compute spectral indices between 62 MHz, 153 MHz and 1.4 GHz for sources in the Boötes field. We cross-correlate these radio sources with optical and infrared catalogues and fit the spectral energy distribution to obtain photometric redshifts. We find that most of these ultra-steep spectrum sources are located in the $ 0.7 \lesssim z \lesssim 2.5$ range.

preprint2014arXiv

Lunar occultation of the diffuse radio sky: LOFAR measurements between 35 and 80 MHz

We present radio observations of the Moon between $35$ and $80$ MHz to demonstrate a novel technique of interferometrically measuring large-scale diffuse emission extending far beyond the primary beam (global signal) for the first time. In particular, we show that (i) the Moon appears as a negative-flux source at frequencies $35<ν<80$ MHz since it is `colder' than the diffuse Galactic background it occults, (ii) using the (negative) flux of the lunar disc, we can reconstruct the spectrum of the diffuse Galactic emission with the lunar thermal emission as a reference, and (iii) that reflected RFI (radio-frequency interference) is concentrated at the center of the lunar disc due to specular nature of reflection, and can be independently measured. Our RFI measurements show that (i) Moon-based Cosmic Dawn experiments must design for an Earth-isolation of better than $80$ dB to achieve an RFI temperature $<1$ mK, (ii) Moon-reflected RFI contributes to a dipole temperature less than $20$ mK for Earth-based Cosmic Dawn experiments, (iii) man-made satellite-reflected RFI temperature exceeds $20$ mK if the aggregate cross section of visible satellites exceeds $80$ m$^2$ at $800$ km height, or $5$ m$^2$ at $400$ km height. Currently, our diffuse background spectrum is limited by sidelobe confusion on short baselines (10-15% level). Further refinement of our technique may yield constraints on the redshifted global $21$-cm signal from Cosmic Dawn ($40>z>12$) and the Epoch of Reionization ($12>z>5$).

preprint2014arXiv

Modelling of the Spectral Energy Distribution of Fornax A: Leptonic and Hadronic Production of High Energy Emission from the Radio Lobes

We present new low-frequency observations of the nearby radio galaxy Fornax A at 154 MHz with the Murchison Widefield Array, microwave flux-density measurements obtained from WMAP and Planck data, and gamma-ray flux densities obtained from Fermi data. We also compile a comprehensive list of previously published images and flux-density measurements at radio, microwave and X-ray energies. A detailed analysis of the spectrum of Fornax A between 154 MHz and 1510 MHz reveals that both radio lobes have a similar spatially-averaged spectral index, and that there exists a steep-spectrum bridge of diffuse emission between the lobes. Taking the spectral index of both lobes to be the same, we model the spectral energy distribution of Fornax A across an energy range spanning eighteen orders of magnitude, to investigate the origin of the X-ray and gamma-ray emission. A standard leptonic model for the production of both the X-rays and gamma-rays by inverse-Compton scattering does not fit the multi-wavelength observations. Our results best support a scenario where the X-rays are produced by inverse-Compton scattering and the gamma-rays are produced primarily by hadronic processes confined to the filamentary structures of the Fornax A lobes.

preprint2014arXiv

Observing the Sun with the Murchison Widefield Array

The Sun has remained a difficult source to image for radio telescopes, especially at the low radio frequencies. Its morphologically complex emission features span a large range of angular scales, emission mechanisms involved and brightness temperatures. In addition, time and frequency synthesis, the key tool used by most radio interferometers to build up information about the source being imaged is not effective for solar imaging, because many of the features of interest are short lived and change dramatically over small fractional bandwidths. Building on the advances in radio frequency technology, digital signal processing and computing, the kind of instruments needed to simultaneously capture the evolution of solar emission in time, frequency, morphology and polarization over a large spectral span with the requisite imaging fidelity, and time and frequency resolution have only recently begun to appear. Of this class of instruments, the Murchison Widefield Array (MWA) is best suited for solar observations. The MWA has now entered a routine observing phase and here we present some early examples from MWA observations.

preprint2014arXiv

The first Murchison Widefield Array low frequency radio observations of cluster scale non-thermal emission: the case of Abell 3667

We present the first Murchison Widefield Array observations of the well-known cluster of galaxies Abell 3667 (A3667) between 105 and 241 MHz. A3667 is one of the best known examples of a galaxy cluster hosting a double radio relic and has been reported to contain a faint radio halo and bridge. The origins of radio halos, relics and bridges is still unclear, however galaxy cluster mergers seems to be an important factor. We clearly detect the North-West (NW) and South-East (SE) radio relics in A3667 and find an integrated flux density at 149 MHz of 28.1 +/- 1.7 and 2.4 +/- 0.1 Jy, respectively, with an average spectral index, between 120 and 1400 MHz, of -0.9 +/- 0.1 for both relics. We find evidence of a spatial variation in the spectral index across the NW relic steepening towards the centre of the cluster, which indicates an ageing electron population. These properties are consistent with higher frequency observations. We detect emission that could be associated with a radio halo and bridge. How- ever, due to the presence of poorly sampled large-scale Galactic emission and blended point sources we are unable to verify the exact nature of these features.

preprint2014arXiv

The LOFAR long baseline snapshot calibrator survey

Aims. An efficient means of locating calibrator sources for International LOFAR is developed and used to determine the average density of usable calibrator sources on the sky for subarcsecond observations at 140 MHz. Methods. We used the multi-beaming capability of LOFAR to conduct a fast and computationally inexpensive survey with the full International LOFAR array. Sources were pre-selected on the basis of 325 MHz arcminute-scale flux density using existing catalogues. By observing 30 different sources in each of the 12 sets of pointings per hour, we were able to inspect 630 sources in two hours to determine if they possess a sufficiently bright compact component to be usable as LOFAR delay calibrators. Results. Over 40% of the observed sources are detected on multiple baselines between international stations and 86 are classified as satisfactory calibrators. We show that a flat low-frequency spectrum (from 74 to 325 MHz) is the best predictor of compactness at 140 MHz. We extrapolate from our sample to show that the density of calibrators on the sky that are sufficiently bright to calibrate dispersive and non-dispersive delays for the International LOFAR using existing methods is 1.0 per square degree. Conclusions. The observed density of satisfactory delay calibrator sources means that observations with International LOFAR should be possible at virtually any point in the sky, provided that a fast and efficient search using the methodology described here is conducted prior to the observation to identify the best calibrator.

preprint2013arXiv

Initial deep LOFAR observations of Epoch of Reionization windows: I. The North Celestial Pole

The aim of the LOFAR Epoch of Reionization (EoR) project is to detect the spectral fluctuations of the redshifted HI 21cm signal. This signal is weaker by several orders of magnitude than the astrophysical foreground signals and hence, in order to achieve this, very long integrations, accurate calibration for stations and ionosphere and reliable foreground removal are essential. One of the prospective observing windows for the LOFAR EoR project will be centered at the North Celestial Pole (NCP). We present results from observations of the NCP window using the LOFAR highband antenna (HBA) array in the frequency range 115 MHz to 163 MHz. The data were obtained in April 2011 during the commissioning phase of LOFAR. We used baselines up to about 30 km. With about 3 nights, of 6 hours each, effective integration we have achieved a noise level of about 100 microJy/PSF in the NCP window. Close to the NCP, the noise level increases to about 180 microJy/PSF, mainly due to additional contamination from unsubtracted nearby sources. We estimate that in our best night, we have reached a noise level only a factor of 1.4 above the thermal limit set by the noise from our Galaxy and the receivers. Our continuum images are several times deeper than have been achieved previously using the WSRT and GMRT arrays. We derive an analytical explanation for the excess noise that we believe to be mainly due to sources at large angular separation from the NCP.

preprint2013arXiv

LEDDB: LOFAR Epoch of Reionization Diagnostic Database

One of the key science projects of the Low-Frequency Array (LOFAR) is the detection of the cosmological signal coming from the Epoch of Reionization (EoR). Here we present the LOFAR EoR Diagnostic Database (LEDDB) that is used in the storage, management, processing and analysis of the LOFAR EoR observations. It stores referencing information of the observations and diagnostic parameters extracted from their calibration. This stored data is used to ease the pipeline processing, monitor the performance of the telescope and visualize the diagnostic parameters which facilitates the analysis of the several contamination effects on the signals. It is implemented with PostgreSQL and accessed through the psycopg2 python module. We have developed a very flexible query engine, which is used by a web user interface to access the database, and a very extensive set of tools for the visualization of the diagnostic parameters through all their multiple dimensions.

preprint2013arXiv

LOFAR: The LOw-Frequency ARray

LOFAR, the LOw-Frequency ARray, is a new-generation radio interferometer constructed in the north of the Netherlands and across europe. Utilizing a novel phased-array design, LOFAR covers the largely unexplored low-frequency range from 10-240 MHz and provides a number of unique observing capabilities. Spreading out from a core located near the village of Exloo in the northeast of the Netherlands, a total of 40 LOFAR stations are nearing completion. A further five stations have been deployed throughout Germany, and one station has been built in each of France, Sweden, and the UK. Digital beam-forming techniques make the LOFAR system agile and allow for rapid repointing of the telescope as well as the potential for multiple simultaneous observations. With its dense core array and long interferometric baselines, LOFAR achieves unparalleled sensitivity and angular resolution in the low-frequency radio regime. The LOFAR facilities are jointly operated by the International LOFAR Telescope (ILT) foundation, as an observatory open to the global astronomical community. LOFAR is one of the first radio observatories to feature automated processing pipelines to deliver fully calibrated science products to its user community. LOFAR's new capabilities, techniques and modus operandi make it an important pathfinder for the Square Kilometre Array (SKA). We give an overview of the LOFAR instrument, its major hardware and software components, and the core science objectives that have driven its design. In addition, we present a selection of new results from the commissioning phase of this new radio observatory.

preprint2013arXiv

Probing reionization with LOFAR using 21-cm redshift space distortions

One of the most promising ways to study the epoch of reionization (EoR) is through radio observations of the redshifted 21-cm line emission from neutral hydrogen. These observations are complicated by the fact that the mapping of redshifts to line-of-sight positions is distorted by the peculiar velocities of the gas. Such distortions can be a source of error if they are not properly understood, but they also encode information about cosmology and astrophysics. We study the effects of redshift space distortions on the power spectrum of 21-cm radiation from the EoR using large scale $N$-body and radiative transfer simulations. We quantify the anisotropy introduced in the 21-cm power spectrum by redshift space distortions and show how it evolves as reionization progresses and how it relates to the underlying physics. We go on to study the effects of redshift space distortions on LOFAR observations, taking instrument noise and foreground subtraction into account. We find that LOFAR should be able to directly observe the power spectrum anisotropy due to redshift space distortions at spatial scales around $k \sim 0.1$ Mpc$^{-1}$ after $\gtrsim$ 1000 hours of integration time. At larger scales, sample errors become a limiting factor, while at smaller scales detector noise and foregrounds make the extraction of the signal problematic. Finally, we show how the astrophysical information contained in the evolution of the anisotropy of the 21-cm power spectrum can be extracted from LOFAR observations, and how it can be used to distinguish between different reionization scenarios.

preprint2013arXiv

The brightness and spatial distributions of terrestrial radio sources

Faint undetected sources of radio-frequency interference (RFI) might become visible in long radio observations when they are consistently present over time. Thereby, they might obstruct the detection of the weak astronomical signals of interest. This issue is especially important for Epoch of Reionisation (EoR) projects that try to detect the faint redshifted HI signals from the time of the earliest structures in the Universe. We explore the RFI situation at 30-163 MHz by studying brightness histograms of visibility data observed with LOFAR, similar to radio-source-count analyses that are used in cosmology. An empirical RFI distribution model is derived that allows the simulation of RFI in radio observations. The brightness histograms show an RFI distribution that follows a power-law distribution with an estimated exponent around -1.5. With several assumptions, this can be explained with a uniform distribution of terrestrial radio sources whose radiation follows existing propagation models. Extrapolation of the power law implies that the current LOFAR EoR observations should be severely RFI limited if the strength of RFI sources remains strong after time integration. This is in contrast with actual observations, which almost reach the thermal noise and are thought not to be limited by RFI. Therefore, we conclude that it is unlikely that there are undetected RFI sources that will become visible in long observations. Consequently, there is no indication that RFI will prevent an EoR detection with LOFAR.

preprint2013arXiv

The giant lobes of Centaurus A observed at 118 MHz with the Murchison Widefield Array

We present new wide-field observations of Centaurus A (Cen A) and the surrounding region at 118 MHz with the Murchison Widefield Array (MWA) 32-tile prototype, with which we investigate the spectral-index distribution of Cen A's giant radio lobes. We compare our images to 1.4 GHz maps of Cen A and compute spectral indices using temperature-temperature plots and spectral tomography. We find that the morphologies at 118 MHz and 1.4 GHz match very closely apart from an extra peak in the southern lobe at 118 MHz, which provides tentative evidence for the existence of a southern counterpart to the northern middle lobe of Cen A. Our spatially-averaged spectral indices for both the northern and southern lobes are consistent with previous analyses, however we find significant spatial variation of the spectra across the extent of each lobe. Both the spectral-index distribution and the morphology at low radio frequencies support a scenario of multiple outbursts of activity from the central engine. Our results are consistent with inverse-Compton modelling of radio and gamma-ray data that supports a value for the lobe age of between 10 and 80 Myr.

preprint2012arXiv

A morphological algorithm for improving radio-frequency interference detection

A technique is described that is used to improve the detection of radio-frequency interference in astronomical radio observatories. It is applied on a two-dimensional interference mask after regular detection in the time-frequency domain with existing techniques. The scale-invariant rank (SIR) operator is defined, which is a one-dimensional mathematical morphology technique that can be used to find adjacent intervals in the time or frequency domain that are likely to be affected by RFI. The technique might also be applicable in other areas in which morphological scale-invariant behaviour is desired, such as source detection. A new algorithm is described, that is shown to perform quite well, has linear time complexity and is fast enough to be applied in modern high resolution observatories. It is used in the default pipeline of the LOFAR observatory.

preprint2012arXiv

First LOFAR observations at very low frequencies of cluster-scale non-thermal emission: the case of Abell 2256

Abell 2256 is one of the best known examples of a galaxy cluster hosting large-scale diffuse radio emission that is unrelated to individual galaxies. It contains both a giant radio halo and a relic, as well as a number of head-tail sources and smaller diffuse steep-spectrum radio sources. The origin of radio halos and relics is still being debated, but over the last years it has become clear that the presence of these radio sources is closely related to galaxy cluster merger events. Here we present the results from the first LOFAR Low band antenna (LBA) observations of Abell 2256 between 18 and 67 MHz. To our knowledge, the image presented in this paper at 63 MHz is the deepest ever obtained at frequencies below 100 MHz in general. Both the radio halo and the giant relic are detected in the image at 63 MHz, and the diffuse radio emission remains visible at frequencies as low as 20 MHz. The observations confirm the presence of a previously claimed ultra-steep spectrum source to the west of the cluster center with a spectral index of -2.3 \pm 0.4 between 63 and 153 MHz. The steep spectrum suggests that this source is an old part of a head-tail radio source in the cluster. For the radio relic we find an integrated spectral index of -0.81 \pm 0.03, after removing the flux contribution from the other sources. This is relatively flat which could indicate that the efficiency of particle acceleration at the shock substantially changed in the last \sim 0.1 Gyr due to an increase of the shock Mach number. In an alternative scenario, particles are re-accelerated by some mechanism in the downstream region of the shock, resulting in the relatively flat integrated radio spectrum. In the radio halo region we find indications of low-frequency spectral steepening which may suggest that relativistic particles are accelerated in a rather inhomogeneous turbulent region.

preprint2012arXiv

Imaging neutral hydrogen on large-scales during the Epoch of Reionization with LOFAR

The first generation of redshifted 21 cm detection experiments, carried out with arrays like LOFAR, MWA and GMRT, will have a very low signal-to-noise ratio per resolution element (\sim 0.2). In addition, whereas the variance of the cosmological signal decreases on scales larger than the typical size of ionization bubbles, the variance of the formidable galactic foregrounds increases, making it hard to disentangle the two on such large scales. The poor sensitivity on small scales on the one hand, and the foregrounds effect on large scales on the other hand, make direct imaging of the Epoch of Reionization of the Universe very difficult, and detection of the signal therefore is expected to be statistical.Despite these hurdles, in this paper we argue that for many reionization scenarios low resolution images could be obtained from the expected data. This is because at the later stages of the process one still finds very large pockets of neutral regions in the IGM, reflecting the clustering of the large-scale structure, which stays strong up to scales of \sim 120 comoving Mpc/h (\sim 1 degree). The coherence of the emission on those scales allows us to reach sufficient S/N (\sim 3) so as to obtain reionization 21 cm images. Such images will be extremely valuable for answering many cosmological questions but above all they will be a very powerful tool to test our control of the systematics in the data. The existence of this typical scale (\sim 120 comoving Mpc/h) also argues for designing future EoR experiments, e.g., with SKA, with a field of view of at least 4 degree.

preprint2012arXiv

Post-correlation filtering techniques for off-axis source and RFI removal

Techniques to improve the data quality of interferometric radio observations are considered. Fundaments of fringe frequencies in the uv-plane are discussed and filters are used to attenuate radio-frequency interference (RFI) and off-axis sources. Several new applications of filters are introduced and tested. A low-pass filter in time and frequency direction on single baseline data is successfully used to lower the noise in the area of interest and to remove sidelobes coming from unmodelled off-axis sources and RFI. Related side effects of data integration, averaging and gridding are analysed, and shown to be able to cause ghosts and an increase in noise, especially when using long baselines or interferometric elements that have a large field of view. A novel projected fringe low-pass filter is shown to be potentially useful for first order source separation. Initial tests show that the filters can be several factors faster compared to common source separation techniques such as peeling and a variant of peeling that is currently being tested on LOFAR observations called "demixed peeling". Further testing is required to support the performance of the filters.

preprint2012arXiv

Prospects for detecting the 21cm forest from the diffuse intergalactic medium with LOFAR

We discuss the feasibility of the detection of the 21cm forest in the diffuse IGM with the radio telescope LOFAR. The optical depth to the 21cm line has been derived using simulations of reionization which include detailed radiative transfer of ionizing photons. We find that the spectra from reionization models with similar total comoving hydrogen ionizing emissivity but different frequency distribution look remarkably similar. Thus, unless the reionization histories are very different from each other (e.g. a predominance of UV vs. x-ray heating) we do not expect to distinguish them by means of observations of the 21cm forest. Because the presence of a strong x-ray background would make the detection of 21cm line absorption impossible, the lack of absorption could be used as a probe of the presence/intensity of the x-ray background and the thermal history of the universe. Along a random line of sight LOFAR could detect a global suppression of the spectrum from z>12, when the IGM is still mostly neutral and cold, in contrast with the more well-defined, albeit broad, absorption features visible at lower redshift. Sharp, strong absorption features associated with rare, high density pockets of gas could be detected also at z~7 along preferential lines of sight.

preprint2012arXiv

The LOFAR radio environment

Aims: This paper discusses the spectral occupancy for performing radio astronomy with the Low-Frequency Array (LOFAR), with a focus on imaging observations. Methods: We have analysed the radio-frequency interference (RFI) situation in two 24-h surveys with Dutch LOFAR stations, covering 30-78 MHz with low-band antennas and 115-163 MHz with high-band antennas. This is a subset of the full frequency range of LOFAR. The surveys have been observed with a 0.76 kHz / 1 s resolution. Results: We measured the RFI occupancy in the low and high frequency sets to be 1.8% and 3.2% respectively. These values are found to be representative values for the LOFAR radio environment. Between day and night, there is no significant difference in the radio environment. We find that lowering the current observational time and frequency resolutions of LOFAR results in a slight loss of flagging accuracy. At LOFAR's nominal resolution of 0.76 kHz and 1 s, the false-positives rate is about 0.5%. This rate increases approximately linearly when decreasing the data frequency resolution. Conclusions: Currently, by using an automated RFI detection strategy, the LOFAR radio environment poses no perceivable problems for sensitive observing. It remains to be seen if this is still true for very deep observations that integrate over tens of nights, but the situation looks promising. Reasons for the low impact of RFI are the high spectral and time resolution of LOFAR; accurate detection methods; strong filters and high receiver linearity; and the proximity of the antennas to the ground. We discuss some strategies that can be used once low-level RFI starts to become apparent. It is important that the frequency range of LOFAR remains free of broadband interference, such as DAB stations and windmills.

preprint2010arXiv

A LOFAR RFI detection pipeline and its first results

Radio astronomy is entering a new era with new and future radio observatories such as the Low Frequency Array and the Square Kilometer Array. We describe in detail an automated flagging pipeline and evaluate its performance. With only a fraction of the computational cost of correlation and its use of the previously introduced SumThreshold method, it is found to be both fast and unrivalled in its high accuracy. The LOFAR radio environment is analysed with the help of this pipeline. The high time and spectral resolution of LOFAR have resulted in an observatory where only a few percent of the data is lost due to RFI.

preprint2010arXiv

Post-correlation radio frequency interference classification methods

We describe and compare several post-correlation radio frequency interference classification methods. As data sizes of observations grow with new and improved telescopes, the need for completely automated, robust methods for radio frequency interference mitigation is pressing. We investigated several classification methods and find that, for the data sets we used, the most accurate among them is the SumThreshold method. This is a new method formed from a combination of existing techniques, including a new way of thresholding. This iterative method estimates the astronomical signal by carrying out a surface fit in the time-frequency plane. With a theoretical accuracy of 95% recognition and an approximately 0.1% false probability rate in simple simulated cases, the method is in practice as good as the human eye in finding RFI. In addition it is fast, robust, does not need a data model before it can be executed and works in almost all configurations with its default parameters. The method has been compared using simulated data with several other mitigation techniques, including one based upon the singular value decomposition of the time-frequency matrix, and has shown better results than the rest.