Source author record

Alexander S. Szalay

Alexander S. Szalay appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

55works
16topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

55 published item(s)

preprint2021arXiv

Wireless sensor network for in situ soil moisture monitoring

We discuss the history and lessons learned from a series of deployments of environmental sensors measuring soil parameters and CO2 fluxes over the last fifteen years, in an outdoor environment. We present the hardware and software architecture of our current Gen-3 system, and then discuss how we are simplifying the user facing part of the software, to make it easier and friendlier for the environmental scientist to be in full control of the system. Finally, we describe the current effort to build a large-scale Gen-4 sensing platform consisting of hundreds of nodes to track the environmental parameters for urban green spaces in Baltimore, Maryland.

preprint2020arXiv

Halo Spin from Primordial Inner Motions

The standard explanation for galaxy spin starts with the tidal-torque theory (TTT), in which an ellipsoidal dark-matter protohalo, which comes to host the galaxy, is torqued up by the tidal gravitational field around it. We discuss a complementary picture, using the relatively familiar velocity field, instead of the tidal field, whose intuitive connection to the surrounding, possibly faraway matter arrangement is more obscure. In this 'spin from primordial inner motions' (SPIM) concept, implicit in TTT derivations but not previously emphasized, the angular momentum from the gravity-sourced velocity field inside a protohalo largely cancels out, but has some excess from the aspherical outskirts. At first, the net spin scales according to linear theory, a sort of comoving conservation of familiar angular momentum. Then, at collapse, it is conserved in physical coordinates. Small haloes are then typically subject to secondary exchanges of angular momentum. The TTT is useful for analytic estimates. But a literal interpretation of the TTT is inaccurate in detail, without some implicit concepts about smoothing of the velocity and tidal fields. This could lead to misconceptions, for those first learning about how galaxies come to spin. Protohaloes are not perfectly ellipsoidal and do not uniformly torque up, as in a naive interpretation of the TTT; their inner velocity fields retain substantial dispersion. Furthermore, quantitatively, given initial conditions and protohalo boundaries, SPIM is more direct and accurate than the TTT to predict halo spins. We also discuss how SPIM applies to rotating filaments, and the relation between halo mass and spin, in which the total spin of a halo can be thought of as a sum of random contributions.

preprint2020arXiv

SciServer: a Science Platform for Astronomy and Beyond

We present SciServer, a science platform built and supported by the Institute for Data Intensive Engineering and Science at the Johns Hopkins University. SciServer builds upon and extends the SkyServer system of server-side tools that introduced the astronomical community to SQL (Structured Query Language) and has been serving the Sloan Digital Sky Survey catalog data to the public. SciServer uses a Docker/VM based architecture to provide interactive and batch mode server-side analysis with scripting languages like Python and R in various environments including Jupyter (notebooks), RStudio and command-line in addition to traditional SQL-based data analysis. Users have access to private file storage as well as personal SQL database space. A flexible resource access control system allows users to share their resources with collaborators, a feature that has also been very useful in classroom environments. All these services, wrapped in a layer of REST APIs, constitute a scalable collaborative data-driven science platform that is attractive to science disciplines beyond astronomy.

preprint2016arXiv

An SSD-based eigensolver for spectral analysis on billion-node graphs

Many eigensolvers such as ARPACK and Anasazi have been developed to compute eigenvalues of a large sparse matrix. These eigensolvers are limited by the capacity of RAM. They run in memory of a single machine for smaller eigenvalue problems and require the distributed memory for larger problems. In contrast, we develop an SSD-based eigensolver framework called FlashEigen, which extends Anasazi eigensolvers to SSDs, to compute eigenvalues of a graph with hundreds of millions or even billions of vertices in a single machine. FlashEigen performs sparse matrix multiplication in a semi-external memory fashion, i.e., we keep the sparse matrix on SSDs and the dense matrix in memory. We store the entire vector subspace on SSDs and reduce I/O to improve performance through caching the most recent dense matrix. Our result shows that FlashEigen is able to achieve 40%-60% performance of its in-memory implementation and has performance comparable to the Anasazi eigensolvers on a machine with 48 CPU cores. Furthermore, it is capable of scaling to a graph with 3.4 billion vertices and 129 billion edges. It takes about four hours to compute eight eigenvalues of the billion-node graph using 120 GB memory.

preprint2016arXiv

Dispersal of tidal debris in a Milky-Way-sized dark matter halo

We simulate the tidal disruption of a collisionless N-body globular star cluster in a total of 300 different orbits selected to have galactocentric radii between 10 and 30 kpc in four dark matter halos: (a) a spherical halo with no subhalos, (b) a spherical halo with subhalos, (c) a realistic halo with no subhalos, and (d) a realistic halo with subhalos. This allows us to isolate and study how the halo's (lack of) dynamical symmetry and substructures affect the dispersal of tidal debris. The realistic halos are constructed from the snapshot of the Via Lactea II simulation at redshift zero. We find that the overall halo's lack of dynamical symmetry disperses tidal debris to make the streams fluffier, consistent with previous studies of tidal debris of dwarf galaxies in larger orbits than ours in this study. On the other hand, subhalos in realistic potentials can locally enhance the densities along streams, making streams denser than their counterparts in smooth potentials. We show that many long and thin streams can survive in a realistic and lumpy halo for a Hubble time. This suggests that upcoming stellar surveys will likely uncover more thin streams which may contain density gaps that have been shown to be promising probes for dark matter substructures.

preprint2016arXiv

Doppler term in the galaxy two-point correlation function: wide-angle, velocity, Doppler lensing and cosmic acceleration effects

We study the parity-odd part (that we shall call Doppler term) of the linear galaxy two-point correlation function that arises from wide-angle, velocity, Doppler lensing and cosmic acceleration effects. As it is important at low redshift and at large angular separations, the Doppler term is usually neglected in the current generation of galaxy surveys. For future wide-angle galaxy surveys such as Euclid, SPHEREx and SKA, however, we show that the Doppler term must be included. The effect of these terms is dominated by the magnification due to relativistic aberration effects and the slope of the galaxy redshift distribution and it generally mimics the effect of the local type primordial non-Gaussianity with the effective nonlinearity parameter $f_{\rm NL}^{\rm eff}$ of a few, we show that this would affect forecasts on measurements of $f_{\rm NL}$ at low-redshift. Our results show that a survey at low redshift with large number density over a wide area of the sky could detect the Doppler term with a signal-to-noise ratio of $\sim 1-20$, depending on survey specifications.

preprint2016arXiv

Photometric redshifts for the SDSS Data Release 12

We present the methodology and data behind the photometric redshift database of the Sloan Digital Sky Survey Data Release 12 (SDSS DR12). We adopt a hybrid technique, empirically estimating the redshift via local regression on a spectroscopic training set, then fitting a spectrum template to obtain K-corrections and absolute magnitudes. The SDSS spectroscopic catalog was augmented with data from other, publicly available spectroscopic surveys to mitigate target selection effects. The training set is comprised of $1,976,978$ galaxies, and extends up to redshift $z\approx 0.8$, with a useful coverage of up to $z\approx 0.6$. We provide photometric redshifts and realistic error estimates for the $208,474,076$ galaxies of the SDSS primary photometric catalog. We achieve an average bias of $\overline{Δz_{\mathrm{norm}}} = 5.84 \times 10^{-5}$, a standard deviation of $σ\left(Δz_{\mathrm{norm}}\right)=0.0205$, and a $3σ$ outlier rate of $P_o=4.11\%$ when cross-validating on our training set. The published redshift error estimates and photometric error classes enable the selection of galaxies with high quality photometric redshifts. We also provide a supplementary error map that allows additional, sophisticated filtering of the data.

preprint2016arXiv

Quantifying correlations between galaxy emission lines and stellar continua

We analyse the correlations between continuum properties and emission line equivalent widths of star-forming and active galaxies from the Sloan Digital Sky Survey. Since upcoming large sky surveys will make broad-band observations only, including strong emission lines into theoretical modelling of spectra will be essential to estimate physical properties of photometric galaxies. We show that emission line equivalent widths can be fairly well reconstructed from the stellar continuum using local multiple linear regression in the continuum principal component analysis (PCA) space. Line reconstruction is good for star-forming galaxies and reasonable for galaxies with active nuclei. We propose a practical method to combine stellar population synthesis models with empirical modelling of emission lines. The technique will help generate more accurate model spectra and mock catalogues of galaxies to fit observations of the new surveys. More accurate modelling of emission lines is also expected to improve template-based photometric redshift estimation methods. We also show that, by combining PCA coefficients from the pure continuum and the emission lines, automatic distinction between hosts of weak active galactic nuclei (AGNs) and quiescent star-forming galaxies can be made. The classification method is based on a training set consisting of high-confidence starburst galaxies and AGNs, and allows for the similar separation of active and star-forming galaxies as the empirical curve found by Kauffmann et al. We demonstrate the use of three important machine learning algorithms in the paper: k-nearest neighbour finding, k-means clustering and support vector machines.

preprint2015arXiv

FlashGraph: Processing Billion-Node Graphs on an Array of Commodity SSDs

Graph analysis performs many random reads and writes, thus, these workloads are typically performed in memory. Traditionally, analyzing large graphs requires a cluster of machines so the aggregate memory exceeds the graph size. We demonstrate that a multicore server can process graphs with billions of vertices and hundreds of billions of edges, utilizing commodity SSDs with minimal performance loss. We do so by implementing a graph-processing engine on top of a user-space SSD file system designed for high IOPS and extreme parallelism. Our semi-external memory graph engine called FlashGraph stores vertex state in memory and edge lists on SSDs. It hides latency by overlapping computation with I/O. To save I/O bandwidth, FlashGraph only accesses edge lists requested by applications from SSDs; to increase I/O throughput and reduce CPU overhead for I/O, it conservatively merges I/O requests. These designs maximize performance for applications with different I/O characteristics. FlashGraph exposes a general and flexible vertex-centric programming interface that can express a wide variety of graph algorithms and their optimizations. We demonstrate that FlashGraph in semi-external memory performs many algorithms with performance up to 80% of its in-memory implementation and significantly outperforms PowerGraph, a popular distributed in-memory graph engine.

preprint2015arXiv

Optimize Unsynchronized Garbage Collection in an SSD Array

Solid state disks (SSDs) have advanced to outperform traditional hard drives significantly in both random reads and writes. However, heavy random writes trigger fre- quent garbage collection and decrease the performance of SSDs. In an SSD array, garbage collection of individ- ual SSDs is not synchronized, leading to underutilization of some of the SSDs. We propose a software solution to tackle the unsyn- chronized garbage collection in an SSD array installed in a host bus adaptor (HBA), where individual SSDs are exposed to an operating system. We maintain a long I/O queue for each SSD and flush dirty pages intelligently to fill the long I/O queues so that we hide the performance imbalance among SSDs even when there are few parallel application writes. We further define a policy of select- ing dirty pages to flush and a policy of taking out stale flush requests to reduce the amount of data written to SSDs. We evaluate our solution in a real system. Experi- ments show that our solution fully utilizes all SSDs in an array under random write-heavy workloads. It improves I/O throughput by up to 62% under random workloads of mixed reads and writes when SSDs are under active garbage collection. It causes little extra data writeback and increases the cache hit rate.

preprint2015arXiv

Simulating Deep Hubble Images With Semi-empirical Models of Galaxy Formation

We simulate deep images from the Hubble Space Telescope (HST) using semi-empirical models of galaxy formation with only a few basic assumptions and parameters. We project our simulations all the way to the observational domain, adding cosmological and instrumental effects to the images, and analyze them in the same way as real HST images ("forward modeling"). This is a powerful tool for testing and comparing galaxy evolution models, since it allows us to make unbiased comparisons between the predicted and observed distributions of galaxy properties, while automatically taking into account all relevant selection effects. Our semi-empirical models populate each dark matter halo with a galaxy of determined stellar mass and scale radius. We compute the luminosity and spectrum of each simulated galaxy from its evolving stellar mass using stellar population synthesis models. We calculate the intrinsic scatter in the stellar mass-halo mass relation that naturally results from enforcing a monotonically increasing stellar mass along the merger history of each halo. The simulated galaxy images are drawn from cutouts of real galaxies from the Sloan Digital Sky Survey, with sizes and fluxes rescaled to match those of the model galaxies. The distributions of galaxy luminosities, sizes, and surface brightnesses depend on the adjustable parameters in the models, and they agree well with observations for reasonable values of those parameters. Measured galaxy magnitudes and sizes have significant magnitude-dependent biases, with both being underestimated near the magnitude detection limit. The fraction of galaxies detected and fraction of light detected also depend sensitively on the details of the model.

preprint2015arXiv

Simulating tidal streams in a high resolution dark matter halo

We simulate tidal streams in the presence and absence of substructures inside the zero redshift snapshot of the Via Lactea II (VL-2) simulation. A halo finder is used to remove and isolate the subhalos found inside the high resolution dark matter halo of VL-2, and the potentials for both the main halo and all the subhalos are constructed individually using the self-consistent field (SCF) method. This allows us to make direct comparison of tidal streams between a smooth halo and a lumpy halo without assuming idealized profiles or triaxial fits. We simulate the kinematics of a star cluster starting with the same orbital position but two different velocities. Although these two orbits are only moderately eccentric and have similar apo- and pericentric distances, we find that the two streams have very different morphologies. We conclude that our model of the potential of VL-2 can provide insights about tidal streams that have not been explored by previous studies using idealized or axisymmetric models.

preprint2015arXiv

Toward Accurate Modeling of the Nonlinear Matter Bispectrum: Standard Perturbation Theory and Transients from Initial Conditions

Accurate modeling of nonlinearities in the galaxy bispectrum, the Fourier transform of the galaxy three-point correlation function, is essential to fully exploit it as a cosmological probe. In this paper, we present numerical and theoretical challenges in modeling the nonlinear bispectrum. First, we test the robustness of the matter bispectrum measured from N-body simulations using different initial conditions generators. We run a suite of N-body simulations using the Zel'dovich approximation and second-order Lagrangian perturbation theory (2LPT) at different starting redshifts, and find that transients from initial decaying modes systematically reduce the nonlinearities in the matter bispectrum. To achieve 1% accuracy in the matter bispectrum for $z\le3$ on scales $k<1$ $h$/Mpc, 2LPT initial conditions generator with initial redshift of $z\gtrsim100$ is required. We then compare various analytical formulas and empirical fitting functions for modeling the nonlinear matter bispectrum, and discuss the regimes for which each is valid. We find that the next-to-leading order (one-loop) correction from standard perturbation theory matches with N-body results on quasi-linear scales for $z\ge1$. We find that the fitting formula in Gil-Mar\'ın et al. (2012) accurately predicts the matter bispectrum for $z\le1$ on a wide range of scales, but at higher redshifts, the fitting formula given in Scoccimarro & Couchman (2001) gives the best agreement with measurements from N-body simulations.

preprint2014arXiv

CANDELS/GOODS-S, CDFS, ECDFS: Photometric Redshifts For Normal and for X-Ray-Detected Galaxies

We present photometric redshifts and associated probability distributions for all detected sources in the Extended Chandra Deep Field South (ECDFS). The work makes use of the most up-to-date data from the Cosmic Assembly Near-IR Deep Legacy Survey (CANDELS) and the Taiwan ECDFS Near-Infrared Survey (TENIS) in addition to other data. We also revisit multi-wavelength counterparts for published X-ray sources from the 4Ms-CDFS and 250ks-ECDFS surveys, finding reliable counterparts for 1207 out of 1259 sources ($\sim 96\%$). Data used for photometric redshifts include intermediate-band photometry deblended using the TFIT method, which is used for the first time in this work. Photometric redshifts for X-ray source counterparts are based on a new library of AGN/galaxy hybrid templates appropriate for the faint X-ray population in the CDFS. Photometric redshift accuracy for normal galaxies is 0.010 and for X-ray sources is 0.014, and outlier fractions are $4\%$ and $5.4\%$ respectively. The results within the CANDELS coverage area are even better as demonstrated both by spectroscopic comparison and by galaxy-pair statistics. Intermediate-band photometry, even if shallow, is valuable when combined with deep broad-band photometry. For best accuracy, templates must include emission lines.

preprint2014arXiv

Efficient Catalog Matching with Dropout Detection

Not only source catalogs are extracted from astronomy observations. Their sky coverage is always carefully recorded and used in statistical analyses, such as correlation and luminosity function studies. Here we present a novel method for catalog matching, which inherently builds on the coverage information for better performance and completeness. A modified version of the Zones Algorithm is introduced for matching partially overlapping observations, where irrelevant parts of the data are excluded up front for efficiency. Our design enables searches to focus on specific areas on the sky to further speed up the process. Another important advantage of the new method over traditional techniques is its ability to quickly detect dropouts, i.e., the missing components that are in the observed regions of the celestial sphere but did not reach the detection limit in some observations. These often provide invaluable insight into the spectral energy distribution of the matched sources but rarely available in traditional associations.

preprint2014arXiv

Efficient classification of billions of points into complex geographic regions using hierarchical triangular mesh

We present a case study about the spatial indexing and regional classification of billions of geographic coordinates from geo-tagged social network data using Hierarchical Triangular Mesh (HTM) implemented for Microsoft SQL Server. Due to the lack of certain features of the HTM library, we use it in conjunction with the GIS functions of SQL Server to significantly increase the efficiency of pre-filtering of spatial filter and join queries. For example, we implemented a new algorithm to compute the HTM tessellation of complex geographic regions and precomputed the intersections of HTM triangles and geographic regions for faster false-positive filtering. With full control over the index structure, HTM-based pre-filtering of simple containment searches outperforms SQL Server spatial indices by a factor of ten and HTM-based spatial joins run about a hundred times faster.

preprint2014arXiv

Nonlinear Behavior of Baryon Acoustic Oscillations in Redshift Space from the Zel'dovich Approximation

Baryon acoustic oscillations (BAO) are a powerful probe of the expansion history of the universe, which can tell us about the nature of dark energy. In order to accurately characterize the dark energy equation of state using BAO, we must understand the effects of both nonlinearities and redshift space distortions on the location and shape of the acoustic peak. In a previous paper we introduced a novel approach to 2nd order perturbation theory in configuration space using the Zel'dovich approximation, and presented a simple result for the first nonlinear term of the correlation function. In this paper, we extend this approach to redshift space. We show how perform the computation, and present the analytic result for the first nonlinear term in the correlation function. Finally, we validate our result through comparison to numerical simulations.

preprint2014arXiv

The Dark Matter Contribution to Galactic Diffuse Gamma Ray Emission

Observations of diffuse Galactic gamma ray emission (DGE) by the Fermi Large Area Telescope (LAT) allow a detailed study of cosmic rays and the interstellar medium. However, diffuse emission models of the inner Galaxy underpredict the Fermi-LAT data at energies above a few GeV and hint at possible non-astrophysical sources including dark matter (DM) annihilations or decays. We present a study of the possible emission components from DM using the high-resolution Via Lactea II N-body simulation of a Milky Way-sized DM halo. We generate full-sky maps of DM annihilation and decay signals that include modeling of the adiabatic contraction of the host density profile, Sommerfeld enhanced DM annihilations, $p$-wave annihilations, and decaying DM. We compare our results with the DGE models produced by the Fermi-LAT team over different sky regions, including the Galactic center, high Galactic latitudes, and the Galactic anti-center. This work provides possible templates to fit the observational data that includes the contribution of the subhalo population to DM gamma-ray emission, with the significance depending on the annihilation/decay channels and the Galactic regions being considered.

preprint2014arXiv

The redshift-space galaxy two-point correlation function and baryon acoustic oscillations

Future galaxy surveys will measure baryon acoustic oscillations (BAOs) with high significance, and a complete understanding of the anisotropies of BAOs in redshift space will be important to exploit the cosmological information in BAOs. Here we describe the anisotropies that arise in the redshift-space galaxy two-point correlation function (2PCF) and elucidate the origin of features that arise in the dependence of the BAOs on the angle between the orientation of the galaxy pair and the line of sight. We do so with a derivation of the configuration-space 2PCF using streaming model. We find that, contrary to common belief, the locations of BAO peaks in the redshift-space 2PCF are anisotropic even in the linear theory. Anisotropies in BAO depend strongly on the method of extracting the peak, showing maximum 3 % angular variation. We also find that extracting the BAO peak of $r^2ξ(r,μ)$ significantly reduces the anisotropy to sub-percent level angular variation. When subtracting the tilt due to the broadband behavior of the 2PCF, the BAO bump is enhanced along the line of sight because of local infall velocities toward the BAO bump. Precise measurement of the angular dependence of the redshift-space 2PCF will allow new geometrical tests of dark energy beyond the BAO.

preprint2013arXiv

Galaxy Zoo: Motivations of Citizen Scientists

Citizen science, in which volunteers work with professional scientists to conduct research, is expanding due to large online datasets. To plan projects, it is important to understand volunteers' motivations for participating. This paper analyzes results from an online survey of nearly 11,000 volunteers in Galaxy Zoo, an astronomy citizen science project. Results show that volunteers' primary motivation is a desire to contribute to scientific research. We encourage other citizen science projects to study the motivations of their volunteers, to see whether and how these results may be generalized to inform the field of citizen science.

preprint2013arXiv

Graywulf: A platform for federated scientific databases and services

Many fields of science rely on relational database management systems to analyze, publish and share data. Since RDBMS are originally designed for, and their development directions are primarily driven by, business use cases they often lack features very important for scientific applications. Horizontal scalability is probably the most important missing feature which makes it challenging to adapt traditional relational database systems to the ever growing data sizes. Due to the limited support of array data types and metadata management, successful application of RDBMS in science usually requires the development of custom extensions. While some of these extensions are specific to the field of science, the majority of them could easily be generalized and reused in other disciplines. With the Graywulf project we intend to target several goals. We are building a generic platform that offers reusable components for efficient storage, transformation, statistical analysis and presentation of scientific data stored in Microsoft SQL Server. Graywulf also addresses the distributed computational issues arising from current RDBMS technologies. The current version supports load balancing of simple queries and parallel execution of partitioned queries over a set of mirrored databases. Uniform user access to the data is provided through a web based query interface and a data surface for software clients. Queries are formulated in a slightly modified syntax of SQL that offers a transparent view of the distributed data. The software library consists of several components that can be reused to develop complex scientific data warehouses: a system registry, administration tools to manage entire database server clusters, a sophisticated workflow execution framework, and a SQL parser library.

preprint2013arXiv

The Open Connectome Project Data Cluster: Scalable Analysis and Vision for High-Throughput Neuroscience

We describe a scalable database cluster for the spatial analysis and annotation of high-throughput brain imaging data, initially for 3-d electron microscopy image stacks, but for time-series and multi-channel data as well. The system was designed primarily for workloads that build connectomes---neural connectivity maps of the brain---using the parallel execution of computer vision algorithms on high-performance compute clusters. These services and open-science data sets are publicly available at http://openconnecto.me. The system design inherits much from NoSQL scale-out and data-intensive computing architectures. We distribute data to cluster nodes by partitioning a spatial index. We direct I/O to different systems---reads to parallel disk arrays and writes to solid-state storage---to avoid I/O interference and maximize throughput. All programming interfaces are RESTful Web services, which are simple and stateless, improving scalability and usability. We include a performance evaluation of the production system, highlighting the effectiveness of spatial data organization.

preprint2012arXiv

A method to extract the redshift distortions beta parameter in configuration space from minimal cosmological assumptions

We present a method to extract the redshift-space distortions beta parameter in configuration space with a minimal set of cosmological assumptions. We show that a novel combination of the observed monopole and quadrupole correlation functions can remove efficiently the impact of mild non linearities and redshift errors. The method offers a series of convenient properties: it does not depend on the theoretical linear correlation function, the mean galaxy density is irrelevant, only convolutions are used, there is no explicit dependence on linear bias. Analyses based on dark matter N-body simulations and Fisher matrix demonstrate that errors of a few percent on beta are possible with a full sky, 1(Gpc/h)^3 survey centered at a redshift of unity and with negligible shot noise. We also find a baryonic feature in the normalized quadrupole in configuration space that should complicate the extraction of the growth parameter from the linear theory asymptote, but that does not have a major impact with our method.

preprint2012arXiv

Nonlinear Behavior of Baryon Acoustic Oscillations from the Zel'dovich Approximation Using a Non-Fourier Perturbation Approach

Baryon acoustic oscillations are an excellent technique to constrain the properties of dark energy in the Universe. In order to accurately characterize the dark energy equation of state, we must understand the effects of both the nonlinearities and redshift space distortions on the location and shape of the acoustic peak. In this paper, we consider these effects using the Zel'dovich approximation and a novel approach to 2nd order perturbation theory. The second order term of the Zel'dovich power spectrum is built from convolutions of the linear power spectrum with polynomial kernels in Fourier space, suggesting that the corresponding term of the the Zel'dovich correlation function can be written as a sum of quadratic products of a broader class of correlation functions, expressed through simple spherical Bessel transforms of the linear power spectrum. We show how to systematically perform such a computation. We explicitly prove that our result is the Fourier transform of the Zel'dovich power spectrum, and compare our expressions to numerical simulations. Finally, we highlight the advantages of writing the nonlinear expansion in configuration space, as this calculation is easily extended to redshift space, and the higher order terms are mathematically simpler than their Fourier counterparts.

preprint2012arXiv

ORIGAMI: Delineating Halos using Phase-Space Folds

We present the ORIGAMI method of identifying structures, particularly halos, in cosmological N-body simulations. Structure formation can be thought of as the folding of an initially flat three-dimensional manifold in six-dimensional phase space. ORIGAMI finds the outer folds that delineate these structures. Halo particles are identified as those that have undergone shell-crossing along 3 orthogonal axes, providing a dynamical definition of halo regions that is independent of density. ORIGAMI also identifies other morphological structures: particles that have undergone shell-crossing along 2, 1, or 0 orthogonal axes correspond to filaments, walls, and voids respectively. We compare this method to a standard Friends-of-Friends halo-finding algorithm and find that ORIGAMI halos are somewhat larger, more diffuse, and less spherical, though the global properties of ORIGAMI halos are in good agreement with other modern halo-finding algorithms.

preprint2012arXiv

Removing BAO-peak Shifts with Local Density Transforms

Large-scale bulk flows in the Universe distort the initial density field, broadening the baryon-acoustic-oscillation (BAO) feature that was imprinted when baryons were strongly coupled to photons. Additionally, there is a small shift inward in the peak of the conventional overdensity correlation function, a mass-weighted statistic. This shift occurs when high density peaks move toward each other. We explore whether this shift can be removed by applying to the density field a transform (such as a logarithm) that gives fairer statistical weight to fluctuations in underdense regions. Using configuration-space perturbation theory in the Zel'dovich approximation, we find that the log-density correlation function shows a much smaller inward shift in the position of the BAO peak at low redshift than is seen in the overdensity correlation function. We also show that if the initial, Lagrangian density of matter parcels could be estimated at their Eulerian positions, giving a displaced-initial-density field, its peak shift would be even smaller. In fact, a transformed field that accentuates underdensities, such as the reciprocal of the density, pushes the peak the other way, outward. In our model, these shifts in the peak position can be attributed to shift terms, involving the derivative of the linear correlation function, that entirely vanish in this displaced-initial-density field.

preprint2012arXiv

SkyQuery: An Implementation of a Parallel Probabilistic Join Engine for Cross-Identification of Multiple Astronomical Databases

Multi-wavelength astronomical studies require cross-identification of detections of the same celestial objects in multiple catalogs based on spherical coordinates and other properties. Because of the large data volumes and spherical geometry, the symmetric N-way association of astronomical detections is a computationally intensive problem, even when sophisticated indexing schemes are used to exclude obviously false candidates. Legacy astronomical catalogs already contain detections of more than a hundred million objects while the ongoing and future surveys will produce catalogs of billions of objects with multiple detections of each at different times. The varying statistical error of position measurements, moving and extended objects, and other physical properties make it necessary to perform the cross-identification using a mathematically correct, proper Bayesian probabilistic algorithm, capable of including various priors. One time, pair-wise cross-identification of these large catalogs is not sufficient for many astronomical scenarios. Consequently, a novel system is necessary that can cross-identify multiple catalogs on-demand, efficiently and reliably. In this paper, we present our solution based on a cluster of commodity servers and ordinary relational databases. The cross-identification problems are formulated in a language based on SQL, but extended with special clauses. These special queries are partitioned spatially by coordinate ranges and compiled into a complex workflow of ordinary SQL queries. Workflows are then executed in a parallel framework using a cluster of servers hosting identical mirrors of the same data sets.

preprint2011arXiv

A High Resolution Atlas of Composite SDSS Galaxy Spectra

In this work we present an atlas of composite spectra of galaxies based on the data of the Sloan Digital Sky Survey Data Release 7 (SDSS DR7). Galaxies are classified by colour, nuclear activity and star-formation activity to calculate average spectra of high signal-to-noise ratio and resolution (S/N = 132 - 4760 at {Dlambda = 1 A), using an algorithm that is robust against outliers. Besides composite spectra, we also compute the first five principal components of the distributions in each galaxy class to characterize the nature of variations of individual spectra around the averages. The continua of the composite spectra are fitted with BC03 stellar population synthesis models to extend the wavelength coverage beyond the coverage of the SDSS spectrographs. Common derived parameters of the composites are also calculated: integrated colours in the most popular filter systems, line strength measurements, and continuum absorption indices (including Lick indices). These derived parameters are compared with the distributions of parameters of individual galaxies and it is shown on many examples that the composites of the atlas cover much of the parameter space spanned by SDSS galaxies. By co-adding thousands of spectra, a total integration time of several months can be reached, which results in extremely low noise composites. The variations in redshift not only allow for extending the spectral coverage bluewards to the original wavelength limit of the SDSS spectrographs, but also make higher spectral resolution achievable. The composite spectrum atlas is available online at http://www.vo.elte.hu/compositeatlas.

preprint2011arXiv

Correlations between Nebular Emission and the Continuum Spectral Shape in SDSS Galaxies

We present a statistical study of the correlations and dimensionality of emission lines carried out on a sample of over 40,000 Sloan Digital Sky Survey (SDSS) galaxies. Using principal component analysis, we found that the equivalent widths of the 11 strongest lines can be well represented using three parameters. We also explore correlations of the emission pattern with the eigenspace representation of the continuum spectrum. The observed relations are used to provide an empirical prescription for expectation values and variances of emission-line strengths as a function of spectral shape. We show that this estimation of emission lines has a sufficient accuracy to make it suitable for photometric applications. The method has already proved useful in SDSS photometric redshift estimation.

preprint2011arXiv

Rejuvenating Power Spectra II: the Gaussianized galaxy density field

We find that, even in the presence of discreteness noise, a Gaussianizing transform (producing a more-Gaussian one-point distribution) reduces nonlinearities in the power spectra of cosmological matter and galaxy density fields, in many cases drastically. Although Gaussianization does increase the effective shot noise, it also increases the power spectrum's fidelity to the linear power spectrum on scales where the shot noise is negligible. Gaussianizing also increases the Fisher information in the power spectrum in all cases and resolutions, although the gains are smaller in redshift space than in real space. We also find that the gain in cumulative Fisher information from Gaussianizing peaks at a particular grid resolution that depends on the sampling level.

preprint2011arXiv

Straightening the Density-Displacement Relation with a Logarithmic Transform

We investigate the use of a logarithmic density variable in estimating the Lagrangian displacement field, motivated by the success of a logarithmic transformation in restoring information to the matter power spectrum. The logarithmic relation is an extension of the linear relation, motivated by the continuity equation, in which the density field is assumed to be proportional to the divergence of the displacement field; we compare the linear and logarithmic relations by measuring both of these fields directly in a cosmological N-body simulation. The relative success of the logarithmic and linear relations depends on the scale at which the density field is smoothed. Thus we explore several ways of measuring the density field, including Cloud-In-Cell smoothing, adaptive smoothing, and the (scale-independent) Delaunay tessellation, and we use both a Fourier space and a geometrical tessellation approach to measuring the divergence. We find that the relation between the divergence of the displacement field and the density is significantly tighter with a logarithmic density variable, especially at low redshifts and for very small (~2 Mpc/h) smoothing scales. We find that the grid-based methods are more reliable than the tessellation-based method of calculating both the density and the divergence fields, though in both cases the logarithmic relation works better in the appropriate regime, which corresponds to nonlinear scales for the grid-based methods and low densities for the tessellation-based method.

preprint2011arXiv

The Eighth Data Release of the Sloan Digital Sky Survey: First Data from SDSS-III

The Sloan Digital Sky Survey (SDSS) started a new phase in August 2008, with new instrumentation and new surveys focused on Galactic structure and chemical evolution, measurements of the baryon oscillation feature in the clustering of galaxies and the quasar Ly alpha forest, and a radial velocity search for planets around ~8000 stars. This paper describes the first data release of SDSS-III (and the eighth counting from the beginning of the SDSS). The release includes five-band imaging of roughly 5200 deg^2 in the Southern Galactic Cap, bringing the total footprint of the SDSS imaging to 14,555 deg^2, or over a third of the Celestial Sphere. All the imaging data have been reprocessed with an improved sky-subtraction algorithm and a final, self-consistent photometric recalibration and flat-field determination. This release also includes all data from the second phase of the Sloan Extension for Galactic Understanding and Evolution (SEGUE-2), consisting of spectroscopy of approximately 118,000 stars at both high and low Galactic latitudes. All the more than half a million stellar spectra obtained with the SDSS spectrograph have been reprocessed through an improved stellar parameters pipeline, which has better determination of metallicity for high metallicity stars.

preprint2010arXiv

Cross-Identification of Stars with Unknown Proper Motions

The cross-identification of sources in separate catalogs is one of the most basic tasks in observational astronomy. It is, however, surprisingly difficult and generally ill-defined. Recently Budavári & Szalay (2008) formulated the problem in the realm of probability theory, and laid down the statistical foundations of an extensible methodology. In this paper, we apply their Bayesian approach to stars that, we know, can move measurably on the sky, with detectable proper motion, and show how to associate their observations. We study models on a sample of stars in the Sloan Digital Sky Survey, which allow for an unknown proper motion per object, and demonstrate the improvements over the analytic static model. Our models and conclusions are directly applicable to upcoming surveys such as PanSTARRS, the Dark Energy Survey, Sky Mapper, and the LSST, whose data sets will contain hundreds of millions of stars observed multiple times over several years.

preprint2010arXiv

Galaxy Zoo: Dust in Spirals

We investigate the effect of dust on spiral galaxies by measuring the inclination-dependence of optical colours for 24,276 well-resolved SDSS galaxies visually classified in Galaxy Zoo. We find clear trends of reddening with inclination which imply a total extinction from face-on to edge-on of 0.7, 0.6, 0.5 and 0.4 magnitudes for the ugri passbands. We split the sample into "bulgy" (early-type) and "disky" (late-type) spirals using the SDSS fracdeV (or f_DeV) parameter and show that the average face-on colour of "bulgy" spirals is redder than the average edge-on colour of "disky" spirals. This shows that the observed optical colour of a spiral galaxy is determined almost equally by the spiral type (via the bulge-disk ratio and stellar populations), and reddening due to dust. We find that both luminosity and spiral type affect the total amount of extinction, with "disky" spirals at M_r ~ -21.5 mags having the most reddening. This decrease of reddening for the most luminous spirals has not been observed before and may be related to their lower levels of recent star formation. We compare our results with the latest dust attenuation models of Tuffs et al. We find that the model reproduces the observed trends reasonably well but overpredicts the amount of u-band attenuation in edge-on galaxies. We end by discussing the effects of dust on large galaxy surveys and emphasize that these effects will become important as we push to higher precision measurements of galaxy properties and their clustering.

preprint2010arXiv

Galaxy Zoo: Passive Red Spirals

We study the spectroscopic properties and environments of red spiral galaxies found by the Galaxy Zoo project. By carefully selecting face-on, disk dominated spirals we construct a sample of truly passive disks (not dust reddened, nor dominated by old stellar populations in a bulge). As such, our red spirals represent an interesting set of possible transition objects between normal blue spirals and red early types. We use SDSS data to investigate the physical processes which could have turned these objects red without disturbing their morphology. Red spirals prefer intermediate density regimes, however there are no obvious correlations between red spiral properties and environment - environment alone is not sufficient to determine if a spiral will become red. Red spirals are a small fraction of spirals at low masses, but are a significant fraction at large stellar masses - massive galaxies are red independent of morphology. We confirm that red spirals have older stellar popns and less recent star formation than the main spiral population. While the presence of spiral arms suggests that major star formation cannot have ceased long ago, we show that these are not recent post-starbursts, so star formation must have ceased gradually. Intriguingly, red spirals are ~4 times more likely than normal spirals to host optically identified Seyfert or LINER, with most of the difference coming from LINERs. We find a curiously large bar fraction in the red spirals suggesting that the cessation of star formation and bar instabilities are strongly correlated. We conclude by discussing the possible origins. We suggest they may represent the very oldest spiral galaxies which have already used up their reserves of gas - probably aided by strangulation, and perhaps bar instabilities moving material around in the disk.

preprint2010arXiv

Redshift-Space Enhancement of Line-of-Sight Baryon Acoustic Oscillations in the SDSS Main-Galaxy Sample

We show that redshift-space distortions of galaxy correlations have a strong effect on correlation functions with distinct, localized features, like the signature of the baryon acoustic oscillations (BAO). Near the line of sight, the features become sharper as a result of redshift-space distortions. We demonstrate this effect by measuring the correlation function in Gaussian simulations and the Millennium Simulation. We also analyze the SDSS DR7 main-galaxy sample (MGS), splitting the sample into slices 2.5 degrees on the sky in various rotations. Measuring 2D correlation functions in each slice, we do see a sharp bump along the line of sight. Using Mexican-hat wavelets, we localize it to (110 +/- 10) Mpc/h. Averaging only along the line of sight, we estimate its significance at a particular wavelet scale and location at 2.2 sigma. In a flat angular weighting in the (pi,r_p) coordinate system, the noise level is suppressed, pushing the bump's significance to 4 sigma. We estimate that there is about a 0.2% chance of getting such a signal anywhere in the vicinity of the BAO scale from a power spectrum lacking a BAO feature. However, these estimates of the significances make some use of idealized Gaussian simulations, and thus are likely a bit optimistic.

preprint2010arXiv

The Sloan Digital Sky Survey Quasar Catalog V. Seventh Data Release

We present the fifth edition of the Sloan Digital Sky Survey (SDSS) Quasar Catalog, which is based upon the SDSS Seventh Data Release. The catalog, which contains 105,783 spectroscopically confirmed quasars, represents the conclusion of the SDSS-I and SDSS-II quasar survey. The catalog consists of the SDSS objects that have luminosities larger than M_i = -22.0 (in a cosmology with H_0 = 70 km/s/Mpc Omega_M = 0.3, and Omega_Lambda = 0.7) have at least one emission line with FWHM larger than 1000 km/s or have interesting/complex absorption features, are fainter than i > 15.0 and have highly reliable redshifts. The catalog covers an area of 9380 deg^2. The quasar redshifts range from 0.065 to 5.46, with a median value of 1.49; the catalog includes 1248 quasars at redshifts greater than four, of which 56 are at redshifts greater than five. The catalog contains 9210 quasars with i < 18; slightly over half of the entries have i< 19. For each object the catalog presents positions accurate to better than 0.1" rms per coordinate, five-band (ugriz) CCD-based photometry with typical accuracy of 0.03 mag, and information on the morphology and selection method. The catalog also contains radio, near-infrared, and X-ray emission properties of the quasars, when available, from other large-area surveys. The calibrated digital spectra cover the wavelength region 3800-9200 Ang. at a spectral resolution R = 2000 the spectra can be retrieved from the SDSS public database using the information provided in the catalog. Over 96% of the objects in the catalog were discovered by the SDSS. We also include a supplemental list of an additional 207 quasars with SDSS spectra whose archive photometric information is incomplete.

preprint2010arXiv

The Spine of the Cosmic Web

We present the SpineWeb framework for the topological analysis of the Cosmic Web and the identification of its walls, filaments and cluster nodes. Based on the watershed segmentation of the cosmic density field, the SpineWeb method invokes the local adjacency properties of the boundaries between the watershed basins to trace the critical points in the density field and the separatrices defined by them. The separatrices are classified into walls and the spine, the network of filaments and nodes in the matter distribution. Testing the method with a heuristic Voronoi model yields outstanding results. Following the discussion of the test results, we apply the SpineWeb method to a set of cosmological N-body simulations. The latter illustrates the potential for studying the structure and dynamics of the Cosmic Web.

preprint2009arXiv

Baryon Acoustic Oscillations in the Sloan Digital Sky Survey Data Release 7 Galaxy Sample

The spectroscopic Sloan Digital Sky Survey (SDSS) Data Release 7 (DR7) galaxy sample represents the final set of galaxies observed using the original SDSS target selection criteria. We analyse the clustering of galaxies within this sample, including both the Luminous Red Galaxy (LRG) and Main samples, and also include the 2-degree Field Galaxy Redshift Survey (2dFGRS) data. Baryon Acoustic Oscillations are observed in power spectra measured for different slices in redshift; this allows us to constrain the distance--redshift relation at multiple epochs. We achieve a distance measure at redshift z=0.275, of r_s(z_d)/D_V(0.275)=0.1390+/-0.0037 (2.7% accuracy), where r_s(z_d) is the comoving sound horizon at the baryon drag epoch, D_V(z)=[(1+z)^2D_A^2cz/H(z)]^(1/3), D_A(z) is the angular diameter distance and H(z) is the Hubble parameter. We find an almost independent constraint on the ratio of distances D_V(0.35)/D_V(0.2)=1.736+/-0.065, which is consistent at the 1.1sigma level with the best fit Lambda-CDM model obtained when combining our z=0.275 distance constraint with the WMAP 5-year data. The offset is similar to that found in previous analyses of the SDSS DR5 sample, but the discrepancy is now of lower significance, a change caused by a revised error analysis and a change in the methodology adopted, as well as the addition of more data. Using WMAP5 constraints on Omega_bh^2 and Omega_ch^2, and combining our BAO distance measurements with those from the Union Supernova sample, places a tight constraint on Omega_m=0.286+/-0.018 and H_0 = 68.2+/-2.2km/s/Mpc that is robust to allowing curvature and non-Lambda dark energy. This result is independent of the behaviour of dark energy at redshifts greater than those probed by the BAO and supernova measurements. (abridged)

preprint2009arXiv

Cosmological Constraints from the Clustering of the Sloan Digital Sky Survey DR7 Luminous Red Galaxies

We present the power spectrum of the reconstructed halo density field derived from a sample of Luminous Red Galaxies (LRGs) from the Sloan Digital Sky Survey Seventh Data Release (DR7). The halo power spectrum has a direct connection to the underlying dark matter power for k <= 0.2 h/Mpc, well into the quasi-linear regime. This enables us to use a factor of ~8 more modes in the cosmological analysis than an analysis with kmax = 0.1 h/Mpc, as was adopted in the SDSS team analysis of the DR4 LRG sample (Tegmark et al. 2006). The observed halo power spectrum for 0.02 < k < 0.2 h/Mpc is well-fit by our model: chi^2 = 39.6 for 40 degrees of freedom for the best fit LCDM model. We find Ω_m h^2 * (n_s/0.96)^0.13 = 0.141^{+0.009}_{-0.012} for a power law primordial power spectrum with spectral index n_s and Ω_b h^2 = 0.02265 fixed, consistent with CMB measurements. The halo power spectrum also constrains the ratio of the comoving sound horizon at the baryon-drag epoch to an effective distance to z=0.35: r_s/D_V(0.35) = 0.1097^{+0.0039}_{-0.0042}. Combining the halo power spectrum measurement with the WMAP 5 year results, for the flat LCDM model we find Ω_m = 0.289 +/- 0.019 and H_0 = 69.4 +/- 1.6 km/s/Mpc. Allowing for massive neutrinos in LCDM, we find \sum m_ν < 0.62 eV at the 95% confidence level. If we instead consider the effective number of relativistic species Neff as a free parameter, we find Neff = 4.8^{+1.8}_{-1.7}. Combining also with the Kowalski et al. (2008) supernova sample, we find Ω_{tot} = 1.011 +/- 0.009 and w = -0.99 +/- 0.11 for an open cosmology with constant dark energy equation of state w.

preprint2009arXiv

Cross-Identification Performance from Simulated Detections: GALEX and SDSS

We investigate the quality of associations of astronomical sources from multi-wavelength observations using simulated detections that are realistic in terms of their astrometric accuracy, small-scale clustering properties and selection functions. We present a general method to build such mock catalogs for studying associations, and compare the statistics of cross-identifications based on angular separation and Bayesian probability criteria. In particular, we focus on the highly relevant problem of cross-correlating the ultraviolet Galaxy Evolution Explorer (GALEX) and optical Sloan Digital Sky Survey (SDSS) surveys. Using refined simulations of the relevant catalogs, we find that the probability thresholds yield lower contamination of false associations, and are more efficient than angular separation. Our study presents a set of recommended criteria to construct reliable cross-match catalogs between SDSS and GALEX with minimal artifacts.

preprint2009arXiv

Eight-Dimensional Mid-Infrared/Optical Bayesian Quasar Selection

We explore the multidimensional, multiwavelength selection of quasars from mid-IR (MIR) plus optical data, specifically from Spitzer-IRAC and the Sloan Digital Sky Survey (SDSS). We apply modern statistical techniques to combined Spitzer MIR and SDSS optical data, allowing up to 8-D color selection of quasars. Using a Bayesian selection method, we catalog 5546 quasar candidates to an 8.0 um depth of 56 uJy over an area of ~24 sq. deg; ~70% of these candidates are not identified by applying the same Bayesian algorithm to 4-color SDSS optical data alone. Our selection recovers 97.7% of known type 1 quasars in this area and greatly improves the effectiveness of identifying 3.5<z<5 quasars. Even using only the two shortest wavelength IRAC bandpasses, it is possible to use our Bayesian techniques to select quasars with 97% completeness and as little as 10% contamination. This sample has a photometric redshift accuracy of 93.6% (Delta Z +/-0.3), remaining roughly constant when the two reddest MIR bands are excluded. While our methods are designed to find type 1 (unobscured) quasars, as many as 1200 of the objects are type 2 (obscured) quasar candidates. Coupling deep optical imaging data with deep mid-IR data could enable selection of quasars in significant numbers past the peak of the quasar luminosity function (QLF) to at least z~4. Such a sample would constrain the shape of the QLF and enable quasar clustering studies over the largest range of redshift and luminosity to date, yielding significant gains in our understanding of quasars and the evolution of galaxies.

preprint2009arXiv

Galaxy Zoo: Disentangling the Environmental Dependence of Morphology and Colour

We analyze the environmental dependence of galaxy morphology and colour with two-point clustering statistics, using data from the Galaxy Zoo, the largest sample of visually classified morphologies yet compiled, extracted from the Sloan Digital Sky Survey. We present two-point correlation functions of spiral and early-type galaxies, and we quantify the correlation between morphology and environment with marked correlation functions. These yield clear and precise environmental trends across a wide range of scales, analogous to similar measurements with galaxy colours, indicating that the Galaxy Zoo classifications themselves are very precise. We measure morphology marked correlation functions at fixed colour and find that they are relatively weak, with the only residual correlation being that of red galaxies at small scales, indicating a morphology gradient within haloes for red galaxies. At fixed morphology, we find that the environmental dependence of colour remains strong, and these correlations remain for fixed morphology \textit{and} luminosity. An implication of this is that much of the morphology--density relation is due to the relation between colour and density. Our results also have implications for galaxy evolution: the morphological transformation of galaxies is usually accompanied by a colour transformation, but not necessarily vice versa. A spiral galaxy may move onto the red sequence of the colour-magnitude diagram without quickly becoming an early-type. We analyze the significant population of red spiral galaxies, and present evidence that they tend to be located in moderately dense environments and are often satellite galaxies in the outskirts of haloes. Finally, we combine our results to argue that central and satellite galaxies tend to follow different evolutionary paths.

preprint2009arXiv

Galaxy Zoo: Exploring the Motivations of Citizen Science Volunteers

The Galaxy Zoo citizen science website invites anyone with an Internet connection to participate in research by classifying galaxies from the Sloan Digital Sky Survey. As of April 2009, more than 200,000 volunteers had made more than 100 million galaxy classifications. In this paper, we present results of a pilot study into the motivations and demographics of Galaxy Zoo volunteers, and define a technique to determine motivations from free responses that can be used in larger multiple-choice surveys with similar populations. Our categories form the basis for a future survey, with the goal of determining the prevalence of each motivation.

preprint2009arXiv

Rejuvenating the matter power spectrum: restoring information with a logarithmic density mapping

We find that nonlinearities in the dark-matter power spectrum are dramatically smaller if the density field first undergoes a logarithmic mapping. In the Millennium simulation, this procedure produces a power spectrum with a shape hardly departing from the linear power spectrum for k <~ 1 h/Mpc at all redshifts. Also, this procedure unveils pristine Fisher information on a range of scales reaching a factor of 2-3 smaller than in the standard power spectrum, yielding 10 times more cumulative signal-to-noise at z=0.

preprint2009arXiv

The Baryonic Acoustic Feature and Large-Scale Clustering in the SDSS LRG Sample

We examine the correlation function ξof the Sloan Digital Sky Survey (SDSS) Luminous Red Galaxy sample (LRG) at large scales (60<s<400 Mpc/h) using the final data release (DR7; 105,831 LRGs between 0.16<z<0.47). Using mock catalogs, we demonstrate that the observed baryonic acoustic peak and larger scale signal are consistent with LCDM at the 1.5σlevel. The signal at 155<s<200 Mpc/h tends to be high relative to theoretical expectations; this slight deviation can be attributed to a bright subsample of the LRGs. Fitting data to a non-linear, redshift-space, template based-model, we constrain the peak position at s_p=103.6+3.6-2.4 Mpc/h when fitting the range 60<s<150 Mpc/h (1σuncertainties measured from the mocks. This redshift-space distance s_p is related to the comoving sound horizon scale r_s after taking into account matter clustering non-linearities, redshift distortions and galaxy clustering bias. Mock catalogs show that the probability that a DR7-sized sample would not have an identifiable peak is at least 10%. As a consistency check of a fiducial cosmology, we use the observed s_p to obtain the distance D_V=[(1+z)^2D_A^2cz/H(z)]^(1/3) relative to the acoustic scale. We find r_s/D_V(z=0.278)=0.1394+-0.0049. This result is in excellent agreement with Percival et. al (2009), who examine roughly the same data set, but using the power spectrum. Comparison with other determinations in the literature are also in very good agreement. We have tested our results against a battery of possible systematic effects, finding all effects are smaller than our estimated sample variance.

preprint2008arXiv

Efficient Photometric Selection of Quasars from the Sloan Digital Sky Survey: II. ~1,000,000 Quasars from Data Release Six

We present a catalog of 1,172,157 quasar candidates selected from the photometric imaging data of the Sloan Digital Sky Survey (SDSS). The objects are all point sources to a limiting magnitude of i=21.3 from 8417 sq. deg. of imaging from SDSS Data Release 6 (DR6). This sample extends our previous catalog by using the latest SDSS public release data and probing both UV-excess and high-redshift quasars. While the addition of high-redshift candidates reduces the overall efficiency (quasars:quasar candidates) of the catalog to ~80%, it is expected to contain no fewer than 850,000 bona fide quasars -- ~8 times the number of our previous sample, and ~10 times the size of the largest spectroscopic quasar catalog. Cross-matching between our photometric catalog and spectroscopic quasar catalogs from both the SDSS and 2dF Surveys, yields 88,879 spectroscopically confirmed quasars. For judicious selection of the most robust UV-excess sources (~500,000 objects in all), the efficiency is nearly 97% -- more than sufficient for detailed statistical analyses. The catalog's completeness to type 1 (broad-line) quasars is expected to be no worse than 70%, with most missing objects occurring at z<0.7 and 2.5<z<3.0. In addition to classification information, we provide photometric redshift estimates (typically good to Delta z +/- 0.3 [2 sigma]) and cross-matching with radio, X-ray, and proper motion catalogs. Finally, we consider the catalog's utility for determining the optical luminosity function of quasars and are able to confirm the flattening of the bright-end slope of the quasar luminosity function at z~4 as compared to z~2.

preprint2005arXiv

Fourier Phase Analysis of SDSS Galaxies

We present a first analysis of the clustering of SDSS galaxies using the distribution function of the sum of Fourier phases. This statistic was recently proposed by one of authors as a new method to probe phase correlations of cosmological density fields. Since the Fourier phases are statistically independent of Fourier amplitudes, the phase statistic plays a complementary role to the conventional two-point statistics of galaxy clustering. In particular, we focus on the distribution functions of phase sum over three closed wavevectors as a function of the configurations of triangle wavevectors. We find that the observed distribution functions of phase sum are in good agreement with the lowest-order approximation from perturbation theory. For direct comparison with observations, we construct mock catalogs from N-body simulations taking account of several observational effects such as the survey geometry, the redshift distortion, and the discreteness due to the limited number of data. Indeed the observed phase correlations for the galaxies in the range of absolute magnitude -22<Mr<-18 agree well with those for Lambda CDM predictions with sigma8=0.9 evolved from Gaussian initial condition. This agreement implies that the galaxy biasing is approximately linear in redshift space. Instead, assuming that the galaxy biasing is described by a quadratic deterministic function at scale larger than 30Mpc/h, we can constrain the ratio of the quadratic biasing parameter b2 to the linear biasing parameter b1. We find that resulting b2/b1 is mainly dependent on sigma8 and that it is well fitted by b2/b1=0.54(+-0.06)-0.62(+-0.08)sigma8 in CDM models. Indeed, b2/b1 is nearly zero when sigma8=0.9.

preprint2005arXiv

Large Scale Clustering of Sloan Digital Sky Survey Quasars: Impact of the Baryon Density and the Cosmological Constant

We report the first result of the clustering analysis of Sloan Digital Sky Survey (SDSS) quasars. We compute the two-point correlation function (2PCF) of SDSS quasars in redshift space at $8h^{-1}{\rm Mpc} < s < 500h^{-1}{\rm Mpc}$, with particular attention to its baryonic signature. Our sample consists of 19986 quasars extracted from the SDSS Data Release 4 (DR4). The redshift range of the sample is $0.72 \le z \le 2.24$ (the mean redshift is $\bar z = 1.46$) and the reddening-corrected $i$-band apparent magnitude range is $15.0 \le m_{i,{\rm rc}} \le 19.1$. Due to the relatively low number density of the quasar sample, the bump in the power spectrum due to the baryon density, $Ω_{\rm b}$, is not clearly visible. The effect of the baryon density is, however, to distort the overall shape of the 2PCF.The degree of distortion makes it an interesting alternate measure of the baryonic signature. Assuming a scale-independent linear bias and the spatially flat universe, i.e., $Ω_{\rm b} + Ω_{\rm d} + Ω_Λ=1$, where $Ω_{\rm d}$ and $Ω_Λ$ denote the density parameters of dark matter and the cosmological constant, we combine the observed quasar 2PCF and the predicted matter 2PCF to put constraints on $Ω_{\rm b}$ and $Ω_Λ$. Our result is fitted as $0.80- 2.8Ω_{\rm b} < Ω_Λ< 0.90 - 1.4Ω_{\rm b}$ at the 2$σ$ confidence level, which is consistent with results from other cosmological observations such as WMAP. (abridged)

preprint2004arXiv

SDSS J1335+0118: A New Two-Image Gravitational Lens

We report the discovery of the two-image gravitationally lensed quasar SDSS J1335+0118. The object was selected as a lens candidate from the Sloan Digital Sky Survey. The imaging and spectroscopic follow-up observations confirm that the system exhibits two gravitationally lensed images of a quasar at z=1.57. The image separation is 1.56''. We also detect an extended component between the two quasar images, likely the lensing galaxy. Preliminary mass modeling predicts the differential time delay Δt ~ 30 h^{-1} day assuming the redshift of the lens galaxy is 0.5.

preprint2004arXiv

Three-point Correlation Functions of SDSS Galaxies in Redshift Space: Morphology, Color, and Luminosity Dependence

We present measurements of the redshift--space three-point correlation function of galaxies in the Sloan Digital Sky Survey (SDSS). For the first time, we analyze the dependence of this statistic on galaxy morphology, color and luminosity. In order to control systematics due to selection effects, we used $r$--band, volume-limited samples of galaxies, constructed from the magnitude-limited SDSS data ($14.5<r<17.5$), and further divided the samples into two morphological types (early and late) or two color populations (red and blue). The three-point correlation function of SDSS galaxies follow the hierarchical relation well and the reduced three-point amplitudes in redshift--space are almost scale-independent ($Q_z=0.5\sim1.0$). In addition, their dependence on the morphology, color and luminosity is not statistically significant. Given the robust morphological, color and luminosity dependences of the two-point correlation function, this implies that galaxy biasing is complex on weakly non-linear to non-linear scales. We show that simple deterministic linear relation with the underlying mass could not explain our measurements on these scales.

preprint2002arXiv

Online Scientific Data Curation, Publication, and Archiving

Science projects are data publishers. The scale and complexity of current and future science data changes the nature of the publication process. Publication is becoming a major project component. At a minimum, a project must preserve the ephemeral data it gathers. Derived data can be reconstructed from metadata, but metadata is ephemeral. Longer term, a project should expect some archive to preserve the data. We observe that pub-lished scientific data needs to be available forever ? this gives rise to the data pyramid of versions and to data inflation where the derived data volumes explode. As an example, this article describes the Sloan Digital Sky Survey (SDSS) strategies for data publication, data access, curation, and preservation.

preprint2002arXiv

Web Services for the Virtual Observatory

Web Services form a new, emerging paradigm to handle distributed access to resources over the Internet. There are platform independent standards (SOAP, WSDL), which make the developers? task considerably easier. This article discusses how web services could be used in the context of the Virtual Observatory. We envisage a multi-layer architecture, with interoperating services. A well-designed lower layer consisting of simple, standard services implemented by most data providers will go a long way towards establishing a modular architecture. More complex applications can be built upon this core layer. We present two prototype applications, the SdssCutout and the SkyQuery as examples of this layered architecture.

preprint1999arXiv

Designing and Mining Multi-Terabyte Astronomy Archives: The Sloan Digital Sky Survey

The next-generation astronomy digital archives will cover most of the universe at fine resolution in many wave-lengths, from X-rays to ultraviolet, optical, and infrared. The archives will be stored at diverse geographical locations. One of the first of these projects, the Sloan Digital Sky Survey (SDSS) will create a 5-wavelength catalog over 10,000 square degrees of the sky (see http://www.sdss.org/). The 200 million objects in the multi-terabyte database will have mostly numerical attributes, defining a space of 100+ dimensions. Points in this space have highly correlated distributions. The archive will enable astronomers to explore the data interactively. Data access will be aided by a multidimensional spatial index and other indices. The data will be partitioned in many ways. Small tag objects consisting of the most popular attributes speed up frequent searches. Splitting the data among multiple servers enables parallel, scalable I/O and applies parallel processing to the data. Hashing techniques allow efficient clustering and pair-wise comparison algorithms that parallelize nicely. Randomly sampled subsets allow debugging otherwise large queries at the desktop. Central servers will operate a data pump that supports sweeping searches that touch most of the data. The anticipated queries require special operators related to angular distances and complex similarity tests of object properties, like shapes, colors, velocity vectors, or temporal behaviors. These issues pose interesting data management challenges.

preprint1999arXiv

The Sloan Digital Sky Survey and its Archive

The next-generation astronomy archives will cover most of the universe at fine resolution in many wavelengths. One of the first of these projects, the Sloan Digital Sky Survey (SDSS) will create a 5-wavelength catalog over 10,000 square degrees of the sky. The 200 million objects in the multi-terabyte database will have mostly numerical attributes, defining a space of 100+ dimensions. Points in this space have highly correlated distributions. The archive will enable astronomers to explore the data interactively. Data access will be aided by multidimensional spatial indices. The data will be partitioned in many ways. Small tag objects consisting of the most popular attributes speed up frequent searches. Splitting the data among multiple servers enables parallel, scalable I/O. Hashing techniques allow efficient clustering and pairwise comparison algorithms. Randomly sampled subsets allow debugging otherwise large queries at the desktop. Central servers will operate a data pump that supports sweeping searches that touch most of the data.