Source author record

Jeffrey D. Scargle

Jeffrey D. Scargle appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

16works
12topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

16 published item(s)

preprint2026arXiv

Studies in Astronomical Time Series Analysis: The Double Lomb-Scargle Periodogram and Super Resolution

Multiple-frequency periodograms -- based on time series models consisting of two or more independent sinusoids -- have long been discussed. What is new here is the presentation of a practical, simple-to-use computational framework implementing this concept. Our algorithms have super resolution that evades the Rayleigh criterion, as well as provision for statistical weighting and tapering. They can be used for essentially any time series (e.g. time-tagged events or point measurements) with arbitrary sampling -- even or uneven. Examples of super resolution of synthetic data, sunspot numbers, and the rich pulsations of white dwarf J0135+5722, demonstrate practical applications. Appendices derive generalized periodograms using an arbitrary number of arbitrary basis functions (following Bretthorst, 1988)and define several examples of non-sinusoidal bases for these ``omnigrams.'' Application beyond the frequency domain is demonstrated with an autoregressive model exhibiting super resolution in the time domain. A GitHub repository containing omnigram code, and symbolic algebra scripts for generating it, will soon be available.

preprint2024arXiv

Detection of the Permanent Strain Offset Component of Gravitational-Wave Memory in Black Hole Mergers

We propose a novel approach to detecting the elusive gravitational-wave memory predicted by general relativity to accompany black hole mergers: direct measurement of the permanent space-time strain offset. Compared to previous techniques modeling and disentangling both the "chirp" and memory signals, this approach has several advantages: it targets the feature of the signal carrying nearly all its Shannon information, has great simplicity, circumvents the need for precise modeling of the time evolution of all components of the gravitational wave signal, and uses only data largely free of the more complicated chirp signal. The frequency spectrum of the predicted memory signal is roughly similar to that of the chirp signal. However its inclusion of lower frequencies, where noise and data calibration are problematic, makes detection difficult but not impossible. We applied this novel analysis, implemented with a template-like algorithm, to a selection of 67 observations of 41 black hole mergers in the LIGO/Virgo Gravitational Wave Transient Catalog. Statistical significance was assessed by analyzing many time-shifted intervals. The result: a few possible detections ($2σ-4σ$) and many upper limits. The probability that a random ensemble of 67 strain time series, with the same noise but no memory signals, will yield a particular figure-of-merit computed for the actual data is approximately 0.1. Several validation checks proved useless, partly due to large measurement and theoretical uncertainties, so these results should be viewed with reservation. Appendices contain MatLab code for various operations, including an algorithm for the complex Fourier transform of arbitrarily spaced data.

preprint2022arXiv

Large-scale Volcanism and the Heat Death of Terrestrial Worlds

Large-scale volcanism has played a critical role in the long-term habitability of Earth. Contrary to widely held belief, volcanism, rather than impactors, has had the greatest influence on and bears most of the responsibility for large-scale mass extinction events throughout Earth's history. We examine the timing of large igneous provinces (LIPs) throughout Earth's history to estimate the likelihood of nearly simultaneous events that could drive a planet into an extreme moist or runaway greenhouse, leading to the end of volatile cycling and causing the heat death of formerly temperate terrestrial worlds. In one approach, we make a conservative estimate of the rate at which sets of near-simultaneous LIPs (pairs, triplets, and quartets) occur in a random history statistically the same as Earth's. We find that LIPs closer in time than 0.1-1 million yr are likely; significantly, this is less than the time over which terrestrial LIP environmental effects are known to persist. In another approach, we assess the cumulative effects with simulated time series consisting of randomly occurring LIP events with realistic time profiles. Both approaches support the conjecture that environmental impacts of LIPs, while narrowly avoiding grave effects on the climate history of Earth, could have been responsible for the heat death of our sister world Venus.

preprint2020arXiv

Characterizing the Gamma-Ray Variability of the Brightest Flat Spectrum Radio Quasars Observed with the Fermi LAT

Almost 10 yr of $γ$-ray observations with the Fermi Large Area Telescope (LAT) have revealed extreme $γ$-ray outbursts from flat spectrum radio quasars (FSRQs), temporarily making these objects the brightest $γ$-ray emitters in the sky. Yet, the location and mechanisms of the $γ$-ray emission remain elusive. We characterize long-term $γ$-ray variability and the brightest $γ$-ray flares of six FSRQs. Consecutively zooming in on the brightest flares, which we identify in an objective way through Bayesian blocks and a hill-climbing algorithm, we find variability on subhour time scales and as short as minutes for two sources in our sample (3C279, CTA102) and weak evidence for variability at time scales less than the Fermi satellite's orbit of 95 minutes for PKS1510-089 and 3C454.3. This suggests extremely compact emission regions in the jet. We do not find any signs for $γ$-ray absorption in the broad-line region (BLR), which indicates that $γ$-rays are produced at distances greater than hundreds of gravitational radii from the central black hole. This is further supported by a cross-correlation analysis between $γ$-ray and radio/millimeter light curves, which is consistent with $γ$-ray production at the same location as the millimeter core for 3C273, CTA102, and 3C454.3. The inferred locations of the $γ$-ray production zones are still consistent with the observed decay times of the brightest flares if the decay is caused by external Compton scattering with BLR photons. However, the minute-scale variability is challenging to explain in such scenarios.

preprint2020arXiv

Ornstein-Uhlenbeck parameter extraction from light curves of Fermi-LAT observed blazars

Context. Monthly-binned gamma-ray light curves of 236 bright gamma-ray sources, particularly blazars, selected from a sample of 2278 high-galactic latitude objects observed with Fermi-LAT, show flux variability characterized by power spectral densities consisting of a single power-law component, ranging from Brownian to white noise. Aims. The main goal here is to assess the Ornstein-Uhlenbeck (OU) model by studying the range of its three parameters that reproduces these statistical properties. Methods. We develop procedures for extracting values of the three OU model parameters (mean flux, correlation length, and random amplitude) from time series data, and apply them to compare numerical integrations of the OU process with the Fermi-LAT data. Results. The OU process fully describes the statistical properties of the flux variations of the 236 blazars. The distributions of the extracted OU parameters are narrowly peaked about well-defined values (sigma, mu, theta) = (0.2, -8.4, 0.5) with variances (0.004, 0.07, 0.13). The distributions of rise and decay time scales of flares in the numerical simulations, i.e. major flux variations fulfilling pre-defined criteria, are in agreement with the observed ones. The power spectral densities of the synthetic light curves are statistically indistinguishable from those of the measured light curves. Conclusions. Long-term gamma-ray flux variability of blazars on monthly time scales is well described by a stochastic model involving only three parameters. The methods described here are powerful tools to study randomness in light curves and thereby constrain the physical mechanisms responsible for the observed flux variations.

preprint2020arXiv

Studies in Astronomical Time Series Analysis: VII. An Enquiry Concerning Non-Linearity, the RMS-Mean Flux Relation, and log-Normal Flux Distributions

A broad and widely used class of stationary, linear, additive time series models can have statistical properties which many authors have asserted imply that the underlying process must be non-linear, non-stationary, multiplicative, or inconsistent with shot noise. This result is demonstrated with exact and numerical evaluation of the model flux distribution function and dependence of flux standard deviation on mean flux (here and in the literature called the \emph{rms-flux relation}). These models can: (1) exhibit normal, log-normal or other flux distributions; (2) show linear or slightly non-linear rms-mean flux dependencies; as well as (3) match arbitrary second order statistics of the time series data. Accordingly the above assertions cannot be made on the basis of statistical time series analysis alone. Also discussed are ambiguities in the meaning of terms relevant to this study -- \emph{linear}, \emph{stationary} and \emph{multiplicative} -- and functions that can transform observed fluxes to a normal distribution as well or better than the logarithm.

preprint2015arXiv

Correlations of atmospheric water ice and dust in the Martian Polar regions

We report on the interannual variability of the atmospheric ice/dust cycle in the Martian polar regions for Mars Years 28-30. We used CRISM emission phase function measurements to derive atmospheric dust optical depths and data from the MARCI instrument to derive atmospheric water ice optical depths. We have used autocorrelation and cross correlation functions in order to quantify the degree to which dust and ice are correlated throughout both polar regions during Mars Years 28-29. We find that in the south polar region, dust has the tendency to "self clear", demonstrated by negative autocorrelation around the central peak. This does not occur in the north polar region. In the south polar region, dust and ice are temporally and spatially anti correlated. In the north polar region, this relationship is reversed, however temporal correlation of northern dust and ice clouds is weak - 6 times weaker than the anticorrelation in the south polar region. Our latitudinal autocorrelation functions allow us to put average spatial sizes of event cores and halos. Dust events in the south are largest, affecting almost the entire pole, whereas dust storms are smaller in the north. Ice clouds in north are similar in latitudinal extent to those in the south (both have halos < 10°). Using cross-correlation functions of water ice and dust, we find that dust events temporally lag ice events by 35-80 degrees of solar longitude in the north and south poles, which is likely due to seasonality of dust and ice events.

preprint2014arXiv

Structure in the 3D Galaxy Distribution: II. Voids and Watersheds of Local Maxima and Minima

The major uncertainties in studies of the multi-scale structure of the Universe arise not from observational errors but from the variety of legitimate definitions and detection methods for individual structures. To facilitate the study of these methodological dependencies we have carried out 12 different analyses defining structures in various ways. This has been done in a purely geometrical way by utilizing the HOP algorithm as a unique parameter-free method of assigning groups of galaxies to local density maxima or minima. From three density estimation techniques (smoothing kernels, Bayesian Blocks and self organizing maps) applied to three data sets (the Sloan Digital Sky Survey Data Release 7, the Millennium Simulation and randomly distributed points) we tabulate information that can be used to construct catalogs of structures connected to local density maxima and minima. The resulting sizes follow continuous multi-scale distributions with no indication of the presence of a discrete hierarchy. We also introduce a novel void finder that utilizes a method to assemble Delaunay tetrahedra into connected structures and characterizes regions very nearly empty of galaxies in the source catalog.

preprint2012arXiv

Studies in Astronomical Time Series Analysis. VI. Bayesian Block Representations

This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time suppressing the inevitable corrupting observational errors. We present a simple nonparametric modeling technique and an algorithm implementing it - an improved and generalized version of Bayesian Blocks (Scargle 1998) - that finds the optimal segmentation of the data in the observation interval. The structure of the algorithm allows it to be used in either a real-time trigger mode, or a retrospective mode. Maximum likelihood or marginal posterior functions to measure model fitness are presented for events, binned counts, and measurements at arbitrary times with known error distributions. Problems addressed include those connected with data gaps, variable exposure, extension to piecewise linear and piecewise exponential representations, multi-variate time series data, analysis of variance, data on the circle, other data modes, and dispersed data. Simulations provide evidence that the detection efficiency for weak signals is close to a theoretical asymptotic limit derived by (Arias-Castro, Donoho and Huo 2003). In the spirit of Reproducible Research (Donoho et al. 2008) all of the code and data necessary to reproduce all of the figures in this paper are included as auxiliary material.

preprint2011arXiv

Heterogeneity in Short Gamma-ray Bursts

We analyze the Swift/BAT sample of short gamma-ray bursts, using an objective Bayesian Block procedure to extract temporal descriptors of the bursts' initial pulse complexes (IPCs). The sample comprises 12 and 41 bursts with and without extended emission (EE) components, respectively. IPCs of non-EE bursts are dominated by single pulse structures, while EE bursts tend to have two or more pulse structures. The medians of characteristic timescales - durations, pulse structure widths, and peak intervals - for EE bursts are factors of ~ 2-3 longer than for non-EE bursts. A trend previously reported by Hakkila and colleagues unifying long and short bursts - the anti-correlation of pulse intensity and width - continues in the two short burst groups, with non-EE bursts extending to more intense, narrower pulses. In addition we find that preceding and succeeding pulse intensities are anti-correlated with pulse interval. We also examine the short burst X-ray afterglows as observed by the Swift/XRT. The median flux of the initial XRT detections for EE bursts (~ 6 x 10^-10 erg cm^-2 s^-1) is ~> 20 x brighter than for non-EE bursts, and the median X-ray afterglow duration for EE bursts (~ 60,000 s) is ~ 30 x longer than for non-EE bursts. The tendency for EE bursts toward longer prompt-emission timescales and higher initial X-ray afterglow fluxes implies larger energy injections powering the afterglows. The longer-lasting X-ray afterglows of EE bursts may suggest that a significant fraction explode into more dense environments than non-EE bursts, or that the sometimes-dominant EE component efficiently powers the afterglow. Combined, these results favor different progenitors for EE and non-EE short bursts.

preprint2010arXiv

Cross-Analyzing Radio and $γ$-Ray Time Series Data: Fermi Marries Jansky

A key goal of radio and $γ-$ray observations of active galactic nuclei is to characterize their time variability in order to elucidate physical processes responsible for the radiation. I describe algorithms for relevant time series analysis tools -- correlation functions, Fourier and wavelet amplitude and phase spectra, structure functions, and time-frequency distributions, all for arbitrary data modes and sampling schemes. For example radio measurements can be cross-analyzed with data streams consisting of time-tagged gamma-ray photons. Underlying these methods is the Bayesian block scheme, useful in its own right to characterize local structure in the light curves, and also prepare raw data for input to the other analysis algorithms. One goal of this presentation is to stimulate discussion of these methods during the workshop.

preprint2010arXiv

False-alarm probability in relation to over-sampled power spectra, with application to Super-Kamiokande solar neutrino data

The term "false-alarm probability" denotes the probability that at least one out of M independent power values in a prescribed search band of a power spectrum computed from a white-noise time series is expected to be as large as or larger than a given value. The usual formula is based on the assumption that powers are distributed exponentially, as one expects for power measurements of normally distributed random noise. However, in practice one typically examines peaks in an over-sampled power spectrum. It is therefore more appropriate to compare the strength of a particular peak with the distribution of peaks in over-sampled power spectra derived from normally distributed random noise. We show that this leads to a formula for the false-alarm probability that is more conservative than the familiar formula. We also show how to combine these results with a Bayesian method for estimating the probability of the null hypothesis (that there is no oscillation in the time series), and we discuss as an example the application of these procedures to Super-Kamiokande solar neutrino data.

preprint2010arXiv

Structure in the 3D Galaxy Distribution: I. Methods and Example Results

Three methods for detecting and characterizing structure in point data, such as that generated by redshift surveys, are described: classification using self-organizing maps, segmentation using Bayesian blocks, and density estimation using adaptive kernels. The first two methods are new, and allow detection and characterization of structures of arbitrary shape and at a wide range of spatial scales. These methods should elucidate not only clusters, but also the more distributed, wide-ranging filaments and sheets, and further allow the possibility of detecting and characterizing an even broader class of shapes. The methods are demonstrated and compared in application to three data sets: a carefully selected volume-limited sample from the Sloan Digital Sky Survey redshift data, a similarly selected sample from the Millennium Simulation, and a set of points independently drawn from a uniform probability distribution -- a so-called Poisson distribution. We demonstrate a few of the many ways in which these methods elucidate large scale structure in the distribution of galaxies in the nearby Universe.

preprint2010arXiv

Threshold for Extended Emission in Short Gamma-Ray Bursts

The initial pulse complex (IPC) in short gamma-ray bursts is sometimes accompanied by a softer, low-intensity extended emission (EE) component. In cases where such a component is not observed, it is not clear if it is present but below the detection threshold. Using Bayesian Block (BB) methods, we measure the EE component and show that it is present in one quarter of a Swift/BAT sample of 51 short bursts, as was found for the Compton/BATSE sample. We simulate bursts with EE to calibrate the BAT threshold for EE detection and show that this component would have been detected in nearly half of BAT short bursts if it were present, to intensities ~ 10^-2 counts cm^-2 s^-1, a factor of five lower than actually observed in short bursts. In the BAT sample the ratio of average EE intensity to IPC peak intensity, Rint, ranges over a factor of 25, Rint ~ 3 x 10^-3 to 8 x 10^-2. In comparison, for the average of the 39 bursts without an EE component, the 2-sigma upper limit is Rint < 8 x 10^-4. These results suggest that a physical threshold effect operates near Rint ~ few x 10^-3, below which the EE component is not manifest.

preprint1998arXiv

Bayesian Blocks, A New Method to Analyze Structure in Photon Counting Data

I describe a new time-domain algorithm for detecting localized structures (bursts), revealing pulse shapes, and generally characterizing intensity variations. The input is raw counting data, in any of three forms: time-tagged photon events (TTE), binned counts, or time-to-spill (TTS) data. The output is the most likely segmentation of the observation into time intervals during which the photon arrival rate is perceptibly constant -- i.e. has a fixed intensity without statistically significant variations. Since the analysis is based on Bayesian statistics, I call the resulting structures Bayesian Blocks. Unlike most, this method does not stipulate time bins -- instead the data themselves determine a piecewise constant representation. Therefore the analysis procedure itself does not impose a lower limit to the time scale on which variability can be detected. Locations, amplitudes, and rise and decay times of pulses within a time series can be estimated, independent of any pulse-shape model -- but only if they do not overlap too much, as deconvolution is not incorporated. The Bayesian Blocks method is demonstrated by analyzing pulse structure in BATSE $γ$-ray data. The MatLab scripts and sample data can be found on the WWW at: http://george.arc.nasa.gov/~scargle/papers.html