Researcher profile

V. N. Pandey

V. N. Pandey contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
7works
0followers
4topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

7 published item(s)

preprint2022arXiv

Astronomical data organization, management and access in Scientific Data Lakes

The data volumes stored in telescope archives is constantly increasing due to the development and improvements in the instrumentation. Often the archives need to be stored over a distributed storage architecture, provided by independent compute centres. Such a distributed data archive requires overarching data management orchestration. Such orchestration comprises of tools which handle data storage and cataloguing, and steering transfers integrating different storage systems and protocols, while being aware of data policies and locality. In addition, it needs a common Authorisation and Authentication Infrastructure (AAI) layer which is perceived as a single entity by end users and provides transparent data access. The scientific domain of particle physics also uses complex and distributed data management systems. The experiments at the Large Hadron Collider\,(LHC) accelerator at CERN generate several hundred petabytes of data per year. This data is globally distributed to partner sites and users using national compute facilities. Several innovative tools were developed to successfully address the distributed computing challenges in the context of the Worldwide LHC Computing Grid (WLCG). The work being carried out in the ESCAPE project and in the Data Infrastructure for Open Science (DIOS) work package is to prototype a Scientific Data Lake using the tools developed in the context of the WLCG, harnessing different physics scientific disciplines addressing FAIR standards and Open Data. We present how the Scientific Data Lake prototype is applied to address astronomical data use cases. We introduce the software stack and also discuss some of the differences between the domains.

preprint2022arXiv

Degree-Scale Galactic Radio Emission at 122 MHz around the North Celestial Pole with LOFAR-AARTFAAC

Aims: Contamination from bright diffuse Galactic thermal and non-thermal radio emission poses crucial challenges in experiments aiming to measure the 21-cm signal of neutral hydrogen from the Cosmic Dawn and Epoch of Reionization. If not included in calibration, this diffuse emission can severely impact the analysis and signal extraction in 21-cm experiments. We examine large-scale diffuse Galactic emission at 122~MHz, around the North Celestial Pole, using the AARTFAAC-HBA system. Methods: In this pilot project, we present the first-ever wide-field image produced with a single sub-band of the data recorded with the AARTFAAC-HBA. We demonstrate two methods: multiscale CLEAN and shapelet decomposition, to model the diffuse emission revealed in the image. We use angular power spectrum metrics to quantify different components of the emission and compare the performance of the two diffuse structure modelling approaches. Results: We observe that the point sources dominate the angular power spectrum ($\ell(\ell+1)C_{\ell}/2π\equiv Δ^2(\ell)$) of the emission in the field on scales $\ell\gtrsim 60$ ($\lesssim 3$~degree). The angular power spectrum after subtraction of compact sources is flat within $20\lesssim \ell \lesssim200$ range, suggesting that the residual power is dominated by the diffuse emission on scales $\ell\lesssim200$. The residual diffuse emission has a brightness temperature variance of $Δ^2_{\ell=180} = (145.64 \pm 13.61)~{\rm K}^2$ at 122~MHz on angular scales of 1~degree, and is consistent with a power-law following $C_{\ell}\propto \ell^{-2.0}$ in $20\lesssim \ell \lesssim200$ range. We also find that, in the current setup, the multiscale CLEAN is suitable to model the compact and diffuse structures on a wide range of angular scales, whereas the shapelet decomposition method better models the large scales, which are of the order of a few degrees and wider.

preprint2022arXiv

Statistical analysis of the causes of excess variance in the 21 cm signal power spectra obtained with the Low-Frequency Array

The detection of the 21 cm signal of neutral hydrogen from the Epoch of Reionization (EoR) is challenging due to bright foreground sources, radio frequency interference (RFI), the ionosphere, and instrumental effects. Even after correcting for these effects in the calibration step and applying foreground removal techniques, the remaining residuals in the observed 21 cm power spectra are still above the thermal noise, which is referred to as the "excess variance." We study potential causes of this excess variance based on 13 nights of data obtained with the Low-Frequency Array (LOFAR). We focused on the impact of gain errors, the sky model, and ionospheric effects on the excess variance by correlating the relevant parameters such as the gain variance over time or frequency, local sidereal time (LST), diffractive scale, and phase structure-function slope with the level of excess variance. Our analysis shows that excess variance has an LST dependence, which is related to the power from the sky. And the simulated Stokes I power spectra from bright sources and the excess variance show a similar progression over LST with the minimum power appearing at LST bin 6h to 9h. This LST dependence is also present in sky images of the residual Stokes I of the observations. In very-wide sky images, we demonstrate that the extra power comes exactly from the direction of bright and distant sources Cassiopeia A and Cygnus A with the array beam patterns. These results suggest that the level of excess variance in the 21 cm signal power spectra is related to sky effects and, hence, it depends on LST. In particular, very bright and distant sources such as Cassiopeia A and Cygnus A can dominate the effect. This is in line with earlier studies and offers a path forward toward a solution since the correlation between the sky-related effects and the excess variance is non-negligible.

preprint2021arXiv

Sub-arcsecond imaging with the International LOFAR Telescope I. Foundational calibration strategy and pipeline

[abridged] The International LOFAR Telescope is an interferometer with stations spread across Europe. With baselines of up to ~2,000 km, LOFAR has the unique capability of achieving sub-arcsecond resolution at frequencies below 200 MHz, although this is technically and logistically challenging. Here we present a calibration strategy that builds on previous high-resolution work with LOFAR. We give an overview of the calibration strategy and discuss the special challenges inherent to enacting high-resolution imaging with LOFAR, and describe the pipeline, which is publicly available, in detail. We demonstrate the calibration strategy by using the pipeline on P205+55, a typical LOFAR Two-metre Sky Survey (LoTSS) pointing. We perform in-field delay calibration, solution referencing to other calibrators, self-calibration, and imaging of example directions of interest in the field. For this specific field and these ionospheric conditions, dispersive delay solutions can be transferred between calibrators up to ~1.5 degrees away, while phase solution transferral works well over 1 degree. We demonstrate a check of the astrometry and flux density scale. Imaging in 17 directions, the restoring beam is typically 0.3" x 0.2" although this varies slightly over the entire 5 square degree field of view. We achieve ~80 to 300 $μ$Jy/bm image rms noise, which is dependent on the distance from the phase centre; typical values are ~90 $μ$Jy/bm for the 8 hour observation with 48 MHz of bandwidth. Seventy percent of processed sources are detected, and from this we estimate that we should be able to image ~900 sources per LoTSS pointing. This equates to ~3 million sources in the northern sky, which LoTSS will entirely cover in the next several years. Future optimisation of the calibration strategy for efficient post-processing of LoTSS at high resolution (LoTSS-HR) makes this estimate a lower limit.

preprint2021arXiv

Sub-arcsecond imaging with the International LOFAR Telescope: II. Completion of the LOFAR Long-Baseline Calibrator Survey

The Low-Frequency Array (LOFAR) Long-Baseline Calibrator Survey (LBCS) was conducted between 2014 and 2019 in order to obtain a set of suitable calibrators for the LOFAR array. In this paper we present the complete survey, building on the preliminary analysis published in 2016 which covered approximately half the survey area. The final catalogue consists of 30006 observations of 24713 sources in the northern sky, selected for a combination of high low-frequency radio flux density and flat spectral index using existing surveys (WENSS, NVSS, VLSS, and MSSS). Approximately one calibrator per square degree, suitable for calibration of $\geq$ 200 km baselines is identified by the detection of compact flux density, for declinations north of 30 degrees and away from the Galactic plane, with a considerably lower density south of this point due to relative difficulty in selecting flat-spectrum candidate sources in this area of the sky. Use of the VLBA calibrator list, together with statistical arguments by comparison with flux densities from lower-resolution catalogues, allow us to establish a rough flux density scale for the LBCS observations, so that LBCS statistics can be used to estimate compact flux densities on scales between 300 mas and 2 arcsec, for sources observed in the survey. The LBCS can be used to assess the structures of point sources in lower-resolution surveys, with significant reductions in the degree of coherence in these sources on scales between 2 arcsec and 300 mas. The LBCS survey sources show a greater incidence of compact flux density in quasars than in radio galaxies, consistent with unified schemes of radio sources. Comparison with samples of sources from interplanetary scintillation (IPS) studies with the Murchison Widefield Array (MWA) shows consistent patterns of detection of compact structure in sources observed both interferometrically with LOFAR and using IPS.

preprint2020arXiv

Constraining the intergalactic medium at $z\approx$ 9.1 using LOFAR Epoch of Reionization observations

We derive constraints on the thermal and ionization states of the intergalactic medium (IGM) at redshift $\approx$ 9.1 using new upper limits on the 21-cm power spectrum measured by the LOFAR radio-telescope and a prior on the ionized fraction at that redshift estimated from recent cosmic microwave background (CMB) observations. We have used results from the reionization simulation code GRIZZLY and a Bayesian inference framework to constrain the parameters which describe the physical state of the IGM. We find that, if the gas heating remains negligible, an IGM with ionized fraction $\gtrsim 0.13$ and a distribution of the ionized regions with a characteristic size $\gtrsim 8 ~h^{-1}$ comoving megaparsec (Mpc) and a full width at the half maximum (FWHM) $\gtrsim 16 ~h^{-1}$ Mpc is ruled out. For an IGM with a uniform spin temperature $T_{\rm S} \gtrsim 3$ K, no constraints on the ionized component can be computed. If the large-scale fluctuations of the signal are driven by spin temperature fluctuations, an IGM with a volume fraction $\lesssim 0.34$ of heated regions with a temperature larger than CMB, average gas temperature 7-160 K and a distribution of the heated regions with characteristic size 3.5-70 $h^{-1}$ Mpc and FWHM of $\lesssim 110$ $h^{-1}$ Mpc is ruled out. These constraints are within the 95 per cent credible intervals. With more stringent future upper limits from LOFAR at multiple redshifts, the constraints will become tighter and will exclude an increasingly large region of the parameter space.

preprint2020arXiv

Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\boldsymbol{z \approx 9.1}$ from LOFAR

A new upper limit on the 21-cm signal power spectrum at a redshift of $z \approx 9.1$ is presented, based on 141 hours of data obtained with the Low-Frequency Array (LOFAR). The analysis includes significant improvements in spectrally-smooth gain-calibration, Gaussian Process Regression (GPR) foreground mitigation and optimally-weighted power spectrum inference. Previously seen `excess power&#39; due to spectral structure in the gain solutions has markedly reduced but some excess power still remains with a spectral correlation distinct from thermal noise. This excess has a spectral coherence scale of $0.25 - 0.45$\,MHz and is partially correlated between nights, especially in the foreground wedge region. The correlation is stronger between nights covering similar local sidereal times. A best 2-$σ$ upper limit of $Δ^2_{21} < (73)^2\,\mathrm{mK^2}$ at $k = 0.075\,\mathrm{h\,cMpc^{-1}}$ is found, an improvement by a factor $\approx 8$ in power compared to the previously reported upper limit. The remaining excess power could be due to residual foreground emission from sources or diffuse emission far away from the phase centre, polarization leakage, chromatic calibration errors, ionosphere, or low-level radio-frequency interference. We discuss future improvements to the signal processing chain that can further reduce or even eliminate these causes of excess power.