Researcher profile

Jeff Gardner

Jeff Gardner contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

astro-ph astro-ph.CO Distributed, Parallel, and Cluster Computing

Trust snapshot

Quick read

Trust 15 - Baseline

3works

0followers

3topics

4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2011arXiv

Haloes gone MAD: The Halo-Finder Comparison Project

[abridged] We present a detailed comparison of fundamental dark matter halo properties retrieved by a substantial number of different halo finders. These codes span a wide range of techniques including friends-of-friends (FOF), spherical-overdensity (SO) and phase-space based algorithms. We further introduce a robust (and publicly available) suite of test scenarios that allows halo finder developers to compare the performance of their codes against those presented here. This set includes mock haloes containing various levels and distributions of substructure at a range of resolutions as well as a cosmological simulation of the large-scale structure of the universe. All the halo finding codes tested could successfully recover the spatial location of our mock haloes. They further returned lists of particles (potentially) belonging to the object that led to coinciding values for the maximum of the circular velocity profile and the radius where it is reached. All the finders based in configuration space struggled to recover substructure that was located close to the centre of the host halo and the radial dependence of the mass recovered varies from finder to finder. Those finders based in phase space could resolve central substructure although they found difficulties in accurately recovering its properties. Via a resolution study we found that most of the finders could not reliably recover substructure containing fewer than 30-40 particles. However, also here the phase space finders excelled by resolving substructure down to 10-20 particles. By comparing the halo finders using a high resolution cosmological volume we found that they agree remarkably well on fundamental properties of astrophysical significance (e.g. mass, position, velocity, and peak of the rotation curve).

preprint2010arXiv

Astronomy in the Cloud: Using MapReduce for Image Coaddition

In the coming decade, astronomical surveys of the sky will generate tens of terabytes of images and detect hundreds of millions of sources every night. The study of these sources will involve computation challenges such as anomaly detection and classification, and moving object tracking. Since such studies benefit from the highest quality data, methods such as image coaddition (stacking) will be a critical preprocessing step prior to scientific investigation. With a requirement that these images be analyzed on a nightly basis to identify moving sources or transient objects, these data streams present many computational challenges. Given the quantity of data involved, the computational load of these problems can only be addressed by distributing the workload over a large number of nodes. However, the high data throughput demanded by these applications may present scalability challenges for certain storage architectures. One scalable data-processing method that has emerged in recent years is MapReduce, and in this paper we focus on its popular open-source implementation called Hadoop. In the Hadoop framework, the data is partitioned among storage attached directly to worker nodes, and the processing workload is scheduled in parallel on the nodes that contain the required input data. A further motivation for using Hadoop is that it allows us to exploit cloud computing resources, e.g., Amazon's EC2. We report on our experience implementing a scalable image-processing pipeline for the SDSS imaging database using Hadoop. This multi-terabyte imaging dataset provides a good testbed for algorithm development since its scope and structure approximate future surveys. First, we describe MapReduce and how we adapted image coaddition to the MapReduce framework. Then we describe a number of optimizations to our basic approach and report experimental results comparing their performance.

preprint2004arXiv

Three-point Correlation Functions of SDSS Galaxies in Redshift Space: Morphology, Color, and Luminosity Dependence

We present measurements of the redshift--space three-point correlation function of galaxies in the Sloan Digital Sky Survey (SDSS). For the first time, we analyze the dependence of this statistic on galaxy morphology, color and luminosity. In order to control systematics due to selection effects, we used $r$--band, volume-limited samples of galaxies, constructed from the magnitude-limited SDSS data ($14.5<r<17.5$), and further divided the samples into two morphological types (early and late) or two color populations (red and blue). The three-point correlation function of SDSS galaxies follow the hierarchical relation well and the reduced three-point amplitudes in redshift--space are almost scale-independent ($Q_z=0.5\sim1.0$). In addition, their dependence on the morphology, color and luminosity is not statistically significant. Given the robust morphological, color and luminosity dependences of the two-point correlation function, this implies that galaxy biasing is complex on weakly non-linear to non-linear scales. We show that simple deterministic linear relation with the underlying mass could not explain our measurements on these scales.