Source author record

Erik Schnetter

Erik Schnetter appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

44works
16topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

44 published item(s)

preprint2022arXiv

Curvature Invariants and the Geometric Horizon Conjecture in a Binary Black Hole Merger

We study curvature invariants in a binary black hole merger. It has been conjectured that one could define a quasi-local and foliation independent black hole horizon by finding the level--$0$ set of a suitable curvature invariant of the Riemann tensor. The conjecture is the geometric horizon conjecture and the associated horizon is the geometric horizon. We study this conjecture by tracing the level--$0$ set of the complex scalar polynomial invariant, $\mathcal{D}$, through a quasi-circular binary black hole merger. We approximate these level--$0$ sets of $\mathcal{D}$ with level--$\varepsilon$ sets of $|\mathcal{D}|$ for small $\varepsilon$. We locate the local minima of $|\mathcal{D}|$ and find that the positions of these local minima correspond closely to the level--$\varepsilon$ sets of $|\mathcal{D}|$ and we also compare with the level--$0$ sets of $\text{Re}(\mathcal{D})$. The analysis provides evidence that the level--$\varepsilon$ sets track a unique geometric horizon. By studying the behaviour of the zero sets of $\text{Re}(\mathcal{D})$ and $\text{Im}(\mathcal{D})$ and also by studying the MOTSs and apparent horizons of the initial black holes, we observe that the level--$\varepsilon$ set that best approximates the geometric horizon is given by $\varepsilon = 10^{-3}$.

preprint2022arXiv

Quasinormal modes and their overtones at the common horizon in a binary black hole merger

It is expected that all astrophysical black holes in equilibrium are well described by the Kerr solution. Moreover, any black hole far away from equilibrium, such as one initially formed in a compact binary merger or by the collapse of a massive star, will eventually reach a final equilibrium Kerr state. At sufficiently late times in this process of reaching equilibrium, we expect that the black hole is modeled as a perturbation around the final state. The emitted gravitational waves will then be damped sinusoids with frequencies and damping times given by the quasinormal mode spectrum of the final Kerr black hole. An observational test of this scenario, often referred to as black hole spectroscopy, is one of the major goals of gravitational wave astronomy. It was recently suggested that the quasinormal mode description including the higher overtones might hold even right after the remnant black hole is first formed. At these times, the black hole is expected to be highly dynamical and nonlinear effects are likely to be important. In this paper we investigate this remarkable scenario in terms of the horizon dynamics. Working with high accuracy simulations of a simple configuration, namely the head-on collision of two nonspinning black holes with unequal masses, we study the dynamics of the final common horizon in terms of its shear and its multipole moments. We show that they are indeed well described by a superposition of ringdown modes as long as a sufficiently large number of higher overtones are included. This description holds even for the highly dynamical final black hole shortly after its formation. We discuss the implications and caveats of this result for black hole spectroscopy and for our understanding of the approach to equilibrium.

preprint2020arXiv

Horizons in a binary black hole merger I: Geometry and area increase

Recent advances in numerical relativity have revealed how marginally trapped surfaces behave when black holes merge. It is now known that interesting topological features emerge during the merger, and marginally trapped surfaces can have self-intersections. This paper presents the most detailed study yet of the physical and geometric aspects of this scenario. For the case of a head-on collision of non-spinning black holes, we study in detail the world tube formed by the evolution of marginally trapped surfaces. In the first of this two-part study, we focus on geometrical properties of the dynamical horizons, i.e. the world tube traced out by the time evolution of marginally outer trapped surfaces. We show that even the simple case of a head-on collision of non-spinning black holes contains a rich variety of geometric and topological properties and is generally more complex than considered previously in the literature. The dynamical horizons are shown to have mixed signature and are not future marginally trapped everywhere. We analyze the area increase of the marginal surfaces along a sequence which connects the two initially disjoint horizons with the final common horizon. While the area does increase overall along this sequence, it is not monotonic. We find short durations of anomalous area change which, given the connection of area with entropy, might have interesting physical consequences. We investigate the possible reasons for this effect and show that it is consistent with existing proofs of the area increase law.

preprint2020arXiv

Horizons in a binary black hole merger II: Fluxes, multipole moments and stability

We study in detail the dynamics and stability of marginally trapped surfaces during a binary black hole merger. This is the second in a two-part study. The first part studied the basic geometric aspects of the world tubes traced out by the marginal surfaces and the status of the area increase law. Here we continue and study the dynamics of the horizons during the merger, again for the head-on collision of two non-spinning black holes. In particular we follow the spectrum of the stability operator during the course of the merger for all the horizons present in the problem and implement systematic spectrum statistics for its analysis. We also study more physical aspects of the merger, namely the fluxes of energy which cross the horizon and cause the area to change. We construct a natural coordinate system on the horizon and decompose the various fields appearing in the flux, primarily the shear of the outgoing null normal, in spin weighted spherical harmonics. For each of the modes we extract the decay rates as the final black hole approaches equilibrium. The late part of the decay is consistent with the expected quasi-normal mode frequencies, while the early part displays a much steeper fall-off. Similarly, we calculate the decay of the horizon multipole moments, again finding two different regimes. Finally, seeking an explanation for this behavior, motivated by the membrane paradigm interpretation, we attempt to identify the different dynamical timescales of the area increase. This leads to the definition of a ``slowness parameter'' for predicting the onset of transition from a faster to a slower decay.

preprint2020arXiv

News from horizons in binary black hole mergers

In a binary black hole merger, it is known that the inspiral portion of the waveform corresponds to two distinct horizons orbiting each other, and the merger and ringdown signals correspond to the final horizon being formed and settling down to equilibrium. However, we still lack a detailed understanding of the relation between the horizon geometry in these three regimes and the observed waveform. Here we show that the well known inspiral chirp waveform has a clear counterpart on black hole horizons, namely, the shear of the outgoing null rays at the horizon. We demonstrate that the shear behaves very much like a compact binary coalescence waveform with increasing frequency and amplitude. Furthermore, the parameters of the system estimated from the horizon agree with those estimated from the waveform. This implies that even though black hole horizons are causally disconnected from us, assuming general relativity to be true, we can potentially infer some of their detailed properties from gravitational wave observations.

preprint2016arXiv

A Survey of High Level Frameworks in Block-Structured Adaptive Mesh Refinement Packages

Over the last decade block-structured adaptive mesh refinement (SAMR) has found increasing use in large, publicly available codes and frameworks. SAMR frameworks have evolved along different paths. Some have stayed focused on specific domain areas, others have pursued a more general functionality, providing the building blocks for a larger variety of applications. In this survey paper we examine a representative set of SAMR packages and SAMR-based codes that have been in existence for half a decade or more, have a reasonably sized and active user base outside of their home institutions, and are publicly available. The set consists of a mix of SAMR packages and application codes that cover a broad range of scientific domains. We look at their high-level frameworks, and their approach to dealing with the advent of radical changes in hardware architecture. The codes included in this survey are BoxLib, Cactus, Chombo, Enzo, FLASH, and Uintah.

preprint2016arXiv

Neutrino-Driven Convection in Core-Collapse Supernovae: High-Resolution Simulations

We present results from high-resolution semi-global simulations of neutrino-driven convection in core-collapse supernovae. We employ an idealized setup with parametrized neutrino heating/cooling and nuclear dissociation at the shock front. We study the internal dynamics of neutrino-driven convection and its role in re-distributing energy and momentum through the gain region. We find that even if buoyant plumes are able to locally transfer heat up to the shock, convection is not able to create a net positive energy flux and overcome the downwards transport of energy from the accretion flow. Turbulent convection does, however, provide a significant effective pressure support to the accretion flow as it favors the accumulation of energy, mass and momentum in the gain region. We derive an approximate equation that is able to explain and predict the shock evolution in terms of integrals of quantities such as the turbulent pressure in the gain region or the effects of non-radial motion of the fluid. We use this relation as a way to quantify the role of turbulence in the dynamics of the accretion shock. Finally, we investigate the effects of grid resolution, which we change by a factor 20 between the lowest and highest resolution. Our results show that the shallow slopes of the turbulent kinetic energy spectra reported in previous studies are a numerical artefact. Kolmogorov scaling is progressively recovered as the resolution is increased.

preprint2016arXiv

pocl: A Performance-Portable OpenCL Implementation

OpenCL is a standard for parallel programming of heterogeneous systems. The benefits of a common programming standard are clear; multiple vendors can provide support for application descriptions written according to the standard, thus reducing the program porting effort. While the standard brings the obvious benefits of platform portability, the performance portability aspects are largely left to the programmer. The situation is made worse due to multiple proprietary vendor implementations with different characteristics, and, thus, required optimization strategies. In this paper, we propose an OpenCL implementation that is both portable and performance portable. At its core is a kernel compiler that can be used to exploit the data parallelism of OpenCL programs on multiple platforms with different parallel hardware styles. The kernel compiler is modularized to perform target-independent parallel region formation separately from the target-specific parallel mapping of the regions to enable support for various styles of fine-grained parallel resources such as subword SIMD extensions, SIMD datapaths and static multi-issue. Unlike previous similar techniques that work on the source level, the parallel region formation retains the information of the data parallelism using the LLVM IR and its metadata infrastructure. This data can be exploited by the later generic compiler passes for efficient parallelization. The proposed open source implementation of OpenCL is also platform portable, enabling OpenCL on a wide range of architectures, both already commercialized and on those that are still under research. The paper describes how the portability of the implementation is achieved. Our results show that most of the benchmarked applications when compiled using pocl were faster or close to as fast as the best proprietary OpenCL implementation for the platform at hand.

preprint2015arXiv

Ab initio holography

We apply the quantum renormalization group to construct a holographic dual for the U(N) vector model for complex bosons defined on a lattice. The bulk geometry becomes dynamical as the hopping amplitudes which determine connectivity of space are promoted to quantum variables. In the large N limit, the full bulk equations of motion for the dynamical hopping fields are numerically solved for finite systems. From finite size scaling, we show that different phases exhibit distinct geometric features in the bulk. In the insulating phase, the space gets fragmented into isolated islands deep inside the bulk, exhibiting ultra-locality. In the superfluid phase, the bulk exhibits a horizon beyond which the geometry becomes non-local. Right at the horizon, the hopping fields decay with a universal power-law in coordinate distance between sites, while they decay in slower power-laws with continuously varying exponents inside the horizon. At the critical point, the bulk exhibits a local geometry whose characteristic length scale diverges asymptotically in the IR limit.

preprint2014arXiv

Chemora: A PDE Solving Framework for Modern HPC Architectures

Modern HPC architectures consist of heterogeneous multi-core, many-node systems with deep memory hierarchies. Modern applications employ ever more advanced discretisation methods to study multi-physics problems. Developing such applications that explore cutting-edge physics on cutting-edge HPC systems has become a complex task that requires significant HPC knowledge and experience. Unfortunately, this combined knowledge is currently out of reach for all but a few groups of application developers. Chemora is a framework for solving systems of Partial Differential Equations (PDEs) that targets modern HPC architectures. Chemora is based on Cactus, which sees prominent usage in the computational relativistic astrophysics community. In Chemora, PDEs are expressed either in a high-level \LaTeX-like language or in Mathematica. Discretisation stencils are defined separately from equations, and can include Finite Differences, Discontinuous Galerkin Finite Elements (DGFE), Adaptive Mesh Refinement (AMR), and multi-block systems. We use Chemora in the Einstein Toolkit to implement the Einstein Equations on CPUs and on accelerators, and study astrophysical systems such as black hole binaries, neutron stars, and core-collapse supernovae.

preprint2013arXiv

Cactus: Issues for Sustainable Simulation Software

The Cactus Framework is an open-source, modular, portable programming environment for the collaborative development and deployment of scientific applications using high-performance computing. Its roots reach back to 1996 at the National Center for Supercomputer Applications and the Albert Einstein Institute in Germany, where its development jumpstarted. Since then, the Cactus framework has witnessed major changes in hardware infrastructure as well as its own community. This paper describes its endurance through these past changes and, drawing upon lessons from its past, also discusses future

preprint2013arXiv

Coarse graining of spin net models: dynamics of intertwiners

Spin foams are models of quantum gravity and therefore quantum space time. A key open issue is to determine the possible continuum phases of these models. Progress on this issue has been prohibited by the complexity of the full four--dimensional models. We consider here simplified analogue models, so called spin nets, that retain the main dynamical ingredient of spin foams, the simplicity constraints. For a certain class of these spin net models we determine the phase diagram and therefore the continuum phases via a coarse graining procedure based on tensor network renormalization. This procedure will also reveal an unexpected fixed point, which turns out to define a new triangulation invariant vertex model.

preprint2013arXiv

Error-analysis and comparison to analytical models of numerical waveforms produced by the NRAR Collaboration

The Numerical-Relativity-Analytical-Relativity (NRAR) collaboration is a joint effort between members of the numerical relativity, analytical relativity and gravitational-wave data analysis communities. The goal of the NRAR collaboration is to produce numerical-relativity simulations of compact binaries and use them to develop accurate analytical templates for the LIGO/Virgo Collaboration to use in detecting gravitational-wave signals and extracting astrophysical information from them. We describe the results of the first stage of the NRAR project, which focused on producing an initial set of numerical waveforms from binary black holes with moderate mass ratios and spins, as well as one non-spinning binary configuration which has a mass ratio of 10. All of the numerical waveforms are analysed in a uniform and consistent manner, with numerical errors evaluated using an analysis code created by members of the NRAR collaboration. We compare previously-calibrated, non-precessing analytical waveforms, notably the effective-one-body (EOB) and phenomenological template families, to the newly-produced numerical waveforms. We find that when the binary's total mass is ~100-200 solar masses, current EOB and phenomenological models of spinning, non-precessing binary waveforms have overlaps above 99% (for advanced LIGO) with all of the non-precessing-binary numerical waveforms with mass ratios <= 4, when maximizing over binary parameters. This implies that the loss of event rate due to modelling error is below 3%. Moreover, the non-spinning EOB waveforms previously calibrated to five non-spinning waveforms with mass ratio smaller than 6 have overlaps above 99.7% with the numerical waveform with a mass ratio of 10, without even maximizing on the binary parameters.

preprint2013arXiv

From Physics Model to Results: An Optimizing Framework for Cross-Architecture Code Generation

Starting from a high-level problem description in terms of partial differential equations using abstract tensor notation, the Chemora framework discretizes, optimizes, and generates complete high performance codes for a wide range of compute architectures. Chemora extends the capabilities of Cactus, facilitating the usage of large-scale CPU/GPU systems in an efficient manner for complex applications, without low-level code tuning. Chemora achieves parallelism through MPI and multi-threading, combining OpenMP and CUDA. Optimizations include high-level code transformations, efficient loop traversal strategies, dynamically selected data and instruction cache usage strategies, and JIT compilation of GPU code tailored to the problem characteristics. The discretization is based on higher-order finite differences on multi-block domains. Chemora's capabilities are demonstrated by simulations of black hole collisions. This problem provides an acid test of the framework, as the Einstein equations contain hundreds of variables and thousands of terms.

preprint2013arXiv

GRHydro: A new open source general-relativistic magnetohydrodynamics code for the Einstein Toolkit

We present the new general-relativistic magnetohydrodynamics (GRMHD) capabilities of the Einstein Toolkit, an open-source community-driven numerical relativity and computational relativistic astrophysics code. The GRMHD extension of the Toolkit builds upon previous releases and implements the evolution of relativistic magnetised fluids in the ideal MHD limit in fully dynamical spacetimes using the same shock-capturing techniques previously applied to hydrodynamical evolution. In order to maintain the divergence-free character of the magnetic field, the code implements both hyperbolic divergence cleaning and constrained transport schemes. We present test results for a number of MHD tests in Minkowski and curved spacetimes. Minkowski tests include aligned and oblique planar shocks, cylindrical explosions, magnetic rotors, Alfvén waves and advected loops, as well as a set of tests designed to study the response of the divergence cleaning scheme to numerically generated monopoles. We study the code's performance in curved spacetimes with spherical accretion onto a black hole on a fixed background spacetime and in fully dynamical spacetimes by evolutions of a magnetised polytropic neutron star and of the collapse of a magnetised stellar core. Our results agree well with exact solutions where these are available and we demonstrate convergence. All code and input files used to generate the results are available on http://einsteintoolkit.org. This makes our work fully reproducible and provides new users with an introduction to applications of the code.

preprint2013arXiv

Performance and Optimization Abstractions for Large Scale Heterogeneous Systems in the Cactus/Chemora Framework

We describe a set of lower-level abstractions to improve performance on modern large scale heterogeneous systems. These provide portable access to system- and hardware-dependent features, automatically apply dynamic optimizations at run time, and target stencil-based codes used in finite differencing, finite volume, or block-structured adaptive mesh refinement codes. These abstractions include a novel data structure to manage refinement information for block-structured adaptive mesh refinement, an iterator mechanism to efficiently traverse multi-dimensional arrays in stencil-based codes, and a portable API and implementation for explicit SIMD vectorization. These abstractions can either be employed manually, or be targeted by automated code generation, or be used via support libraries by compilers during code generation. The implementations described below are available in the Cactus framework, and are used e.g. in the Einstein Toolkit for relativistic astrophysics simulations.

preprint2013arXiv

The Transient Gravitational-Wave Sky

Interferometric detectors will very soon give us an unprecedented view of the gravitational-wave sky, and in particular of the explosive and transient Universe. Now is the time to challenge our theoretical understanding of short-duration gravitational-wave signatures from cataclysmic events, their connection to more traditional electromagnetic and particle astrophysics, and the data analysis techniques that will make the observations a reality. This paper summarizes the state of the art, future science opportunities, and current challenges in understanding gravitational-wave transients.

preprint2012arXiv

A Massive Data Parallel Computational Framework for Petascale/Exascale Hybrid Computer Systems

Heterogeneous systems are becoming more common on High Performance Computing (HPC) systems. Even using tools like CUDA and OpenCL it is a non-trivial task to obtain optimal performance on the GPU. Approaches to simplifying this task include Merge (a library based framework for heterogeneous multi-core systems), Zippy (a framework for parallel execution of codes on multiple GPUs), BSGP (a new programming language for general purpose computation on the GPU) and CUDA-lite (an enhancement to CUDA that transforms code based on annotations). In addition, efforts are underway to improve compiler tools for automatic parallelization and optimization of affine loop nests for GPUs and for automatic translation of OpenMP parallelized codes to CUDA. In this paper we present an alternative approach: a new computational framework for the development of massively data parallel scientific codes applications suitable for use on such petascale/exascale hybrid systems built upon the highly scalable Cactus framework. As the first non-trivial demonstration of its usefulness, we successfully developed a new 3D CFD code that achieves improved performance.

preprint2012arXiv

A New Monte Carlo Method for Time-Dependent Neutrino Radiation Transport

Monte Carlo approaches to radiation transport have several attractive properties such as simplicity of implementation, high accuracy, and good parallel scaling. Moreover, Monte Carlo methods can handle complicated geometries and are relatively easy to extend to multiple spatial dimensions, which makes them potentially interesting in modeling complex multi-dimensional astrophysical phenomena such as core-collapse supernovae. The aim of this paper is to explore Monte Carlo methods for modeling neutrino transport in core-collapse supernovae. We generalize the Implicit Monte Carlo photon transport scheme of Fleck & Cummings and gray discrete-diffusion scheme of Densmore et al. to energy-, time-, and velocity-dependent neutrino transport. Using our 1D spherically-symmetric implementation, we show that, similar to the photon transport case, the implicit scheme enables significantly larger timesteps compared with explicit time discretization, without sacrificing accuracy, while the discrete-diffusion method leads to significant speed-ups at high optical depth. Our results suggest that a combination of spectral, velocity-dependent, Implicit Monte Carlo and discrete-diffusion Monte Carlo methods represents a robust approach for use in neutrino transport calculations in core-collapse supernovae. Our velocity-dependent scheme can easily be adapted to photon transport.

preprint2012arXiv

Numerical simulations with a first order BSSN formulation of Einstein's field equations

We present a new fully first order strongly hyperbolic representation of the BSSN formulation of Einstein's equations with optional constraint damping terms. We describe the characteristic fields of the system, discuss its hyperbolicity properties, and present two numerical implementations and simulations: one using finite differences, adaptive mesh refinement and in particular binary black holes, and another one using the discontinuous Galerkin method in spherical symmetry. The results of this paper constitute a first step in an effort to combine the robustness of BSSN evolutions with very high accuracy numerical techniques, such as spectral collocation multi-domain or discontinuous Galerkin methods.

preprint2011arXiv

Ensuring Correctness at the Application Level: a Software Framework Approach

As scientific applications extend to the simulation of more and more complex systems, they involve an increasing number of abstraction levels, at each of which errors can emerge and across which they can propagate; tools for correctness evaluation and enforcement at every level (from the code level to the application level) are therefore necessary. Whilst code-level debugging tools are already a well established standard, application-level tools are lagging behind, possibly due to their stronger dependence on the application's details. In this paper, we describe the programming model introduced by the Cactus framework, review the High Performance Computing (HPC) challenges that Cactus is designed to address, and illustrate the correctness strategies that are currently available in Cactus at the code, component, and application level.

preprint2011arXiv

Extreme black hole simulations: collisions of unequal mass black holes and the point particle limit

Numerical relativity has seen incredible progress in the last years, and is being applied with success to a variety of physical phenomena, from gravitational-wave research and relativistic astrophysics to cosmology and high-energy physics. Here we probe the limits of current numerical setups, by studying collisions of unequal mass, non-rotating black holes of mass-ratios up to 1:100 and making contact with a classical calculation in General Relativity: the infall of a point-like particle into a massive black hole. Our results agree well with the predictions coming from linearized calculations of the infall of point-like particles into non-rotating black holes. In particular, in the limit that one hole is much smaller than the other, and the infall starts from an infinite initial separation, we recover the point-particle limit. Thus, numerical relativity is able to bridge the gap between fully non-linear dynamics and linearized approximations, which may have important applications. Finally, we also comment on the "spurious" radiation content in the initial data and the linearized predictions.

preprint2011arXiv

Gravitational Wave Extraction in Simulations of Rotating Stellar Core Collapse

We perform simulations of general relativistic rotating stellar core collapse and compute the gravitational waves (GWs) emitted in the core bounce phase of three representative models via multiple techniques. The simplest technique, the quadrupole formula (QF), estimates the GW content in the spacetime from the mass quadrupole tensor. It is strictly valid only in the weak-field and slow-motion approximation. For the first time, we apply GW extraction methods in core collapse that are fully curvature-based and valid for strongly radiating and highly relativistic sources. We employ three extraction methods computing (i) the Newman-Penrose (NP) scalar Psi_4, (ii) Regge-Wheeler-Zerilli-Moncrief (RWZM) master functions, and (iii) Cauchy-Characteristic Extraction (CCE) allowing for the extraction of GWs at future null infinity, where the spacetime is asymptotically flat and the GW content is unambiguously defined. The latter technique is the only one not suffering from residual gauge and finite-radius effects. All curvature-based methods suffer from strong non-linear drifts. We employ the fixed-frequency integration technique as a high-pass waveform filter. Using the CCE results as a benchmark, we find that finite-radius NP extraction yields results that agree nearly perfectly in phase, but differ in amplitude by ~1-7% at core bounce, depending on the model. RWZM waveforms, while in general agreeing in phase, contain spurious high-frequency noise of comparable amplitudes to those of the relatively weak GWs emitted in core collapse. We also find remarkably good agreement of the waveforms obtained from the QF with those obtained from CCE. They agree very well in phase but systematically underpredict peak amplitudes by ~5-11% which is comparable to the NP results and is within the uncertainties associated with core collapse physics. (abridged)

preprint2011arXiv

The Einstein Toolkit: A Community Computational Infrastructure for Relativistic Astrophysics

We describe the Einstein Toolkit, a community-driven, freely accessible computational infrastructure intended for use in numerical relativity, relativistic astrophysics, and other applications. The Toolkit, developed by a collaboration involving researchers from multiple institutions around the world, combines a core set of components needed to simulate astrophysical objects such as black holes, compact objects, and collapsing stars, as well as a full suite of analysis tools. The Einstein Toolkit is currently based on the Cactus Framework for high-performance computing and the Carpet adaptive mesh refinement driver. It implements spacetime evolution via the BSSN evolution system and general-relativistic hydrodynamics in a finite-volume discretization. The toolkit is under continuous development and contains many new code components that have been publicly released for the first time and are described in this article. We discuss the motivation behind the release of the toolkit, the philosophy underlying its development, and the goals of the project. A summary of the implemented numerical techniques is included, as are results of numerical test covering a variety of sample astrophysical problems.

preprint2010arXiv

Component Specification in the Cactus Framework: The Cactus Configuration Language

Component frameworks are complex systems that rely on many layers of abstraction to function properly. One essential requirement is a consistent means of describing each individual component and how it relates to both other components and the whole framework. As component frameworks are designed to be flexible by nature, the description method should be simultaneously powerful, lead to efficient code, and be easy to use, so that new users can quickly adapt their own code to work with the framework. In this paper, we discuss the Cactus Configuration Language (CCL) which is used to describe components ("thorns'') in the Cactus Framework. The CCL provides a description language for the variables, parameters, functions, scheduling and compilation of a component and includes concepts such as interface and implementation which allow thorns providing the same capabilities to be easily interchanged. We include several application examples which illustrate how community toolkits use the CCL and Cactus and identify needed additions to the language.

preprint2010arXiv

On the frequency band of the f-mode CFS instability

Rapidly rotating neutron stars can be unstable to the gravitational-wave-driven CFS mechanism if they have a neutral point in the spectrum of nonaxisymmetric f-modes. We investigate the frequencies of these modes in two sequences of uniformly rotating polytropes using nonlinear simulations in full general relativity, determine the approximate locations of the neutral points, and derive limits on the observable frequency band available to the instability in these sequences. We find that general relativity enhances the detectability of a CFS-unstable neutron star substantially, both by widening the instability window and enlarging the band into the optimal range for interferometric detectors like LIGO, VIRGO, and GEO-600.

preprint2010arXiv

Simplifying Complex Software Assembly: The Component Retrieval Language and Implementation

Assembling simulation software along with the associated tools and utilities is a challenging endeavor, particularly when the components are distributed across multiple source code versioning systems. It is problematic for researchers compiling and running the software across many different supercomputers, as well as for novices in a field who are often presented with a bewildering list of software to collect and install. In this paper, we describe a language (CRL) for specifying software components with the details needed to obtain them from source code repositories. The language supports public and private access. We describe a tool called GetComponents which implements CRL and can be used to assemble software. We demonstrate the tool for application scenarios with the Cactus Framework on the NSF TeraGrid resources. The tool itself is distributed with an open source license and freely available from our web page.

preprint2010arXiv

Simulation Factory: Taming Application Configuration and Workflow on High-End Resources

Computational Science on large high performance computing resources is hampered by the complexity of these systems. Much of this complexity is due to low-level details on these resources that are exposed to the application and the end user. This includes (but is not limited to) mechanisms for remote access, configuring and building applications from source code, and managing simulations and their output files via batch queue systems. These challenges multiply in a modern research environment, where a research collaboration spans multiple groups, often in loosely defined international collaborations, where there is a constant influx of new students into multi-year projects, and where simulations are performed on several different resources. The Simulation Factory addresses these challenges by significantly simplifying remote access, building executables, and managing simulations. By abstracting out the low-level differences between different resources, it offers a uniform interface to these resources. At the same time, it can enforce certain standards for performing simulations that encapsulate best practices from experienced users. Furthermore, SimFactory's automation avoids many possible user errors that can in the worst case render month-long simulations worthless.

preprint2010arXiv

Stability of general-relativistic accretion disks

Self-gravitating relativistic disks around black holes can form as transient structures in a number of astrophysical scenarios such as binary neutron star and black hole-neutron star coalescences, as well as the core-collapse of massive stars. We explore the stability of such disks against runaway and non-axisymmetric instabilities using three-dimensional hydrodynamics simulations in full general relativity using the THOR code. We model the disk matter using the ideal fluid approximation with a $Γ$-law equation of state with $Γ=4/3$. We explore three disk models around non-rotating black holes with disk-to-black hole mass ratios of 0.24, 0.17 and 0.11. Due to metric blending in our initial data, all of our initial models contain an initial axisymmetric perturbation which induces radial disk oscillations. Despite these oscillations, our models do not develop the runaway instability during the first several orbital periods. Instead, all of the models develop unstable non-axisymmetric modes on a dynamical timescale. We observe two distinct types of instabilities: the Papaloizou-Pringle and the so-called intermediate type instabilities. The development of the non-axisymmetric mode with azimuthal number m = 1 is accompanied by an outspiraling motion of the black hole, which significantly amplifies the growth rate of the m = 1 mode in some cases. Overall, our simulations show that the properties of the unstable non-axisymmetric modes in our disk models are qualitatively similar to those in Newtonian theory.

preprint2010arXiv

The slicing dependence of non-spherically symmetric quasi-local horizons in Vaidya Spacetimes

It is well known that quasi-local black hole horizons depend on the choice of a time coordinate in a spacetime. This has implications for notions such as the surface of the black hole and also on quasi-local physical quantities such as horizon measures of mass and angular momentum. In this paper, we compare different horizons on non-spherically symmetric slicings of Vaidya spacetimes. The spacetimes we investigate include both accreting and evaporating black holes. For some simple choices of the Vaidya mass function function corresponding to collapse of a hollow shell, we compare the area for the numerically found axisymmetric trapping horizons with the area of the spherically symmetric trapping horizon and event horizon. We find that as expected, both the location and area are dependent on the choice of foliation. However, the area variation is not large, of order $0.035\%$ for a slowly evolving horizon with $\dot{m}=0.02$. We also calculate analytically the difference in area between the spherically symmetric quasi-local horizon and event horizon for a slowly accreting black hole. We find that the difference can be many orders of magnitude larger than the Planck area for sufficiently large black holes.

preprint2010arXiv

Time Step Size Limitation Introduced by the BSSN Gamma Driver

Many mesh refinement simulations currently performed in numerical relativity counteract instabilities near the outer boundary of the simulation domain either by changes to the mesh refinement scheme or by changes to the gauge condition. We point out that the BSSN Gamma Driver gauge condition introduces a time step size limitation in a similar manner as a CFL condition, but which is independent of the spatial resolution. We give a didactic explanation of this issue, show why especially mesh refinement simulations suffer from it, and point to a simple remedy.

preprint2009arXiv

High accuracy binary black hole simulations with an extended wave zone

We present results from a new code for binary black hole evolutions using the moving-puncture approach, implementing finite differences in generalised coordinates, and allowing the spacetime to be covered with multiple communicating non-singular coordinate patches. Here we consider a regular Cartesian near zone, with adapted spherical grids covering the wave zone. The efficiencies resulting from the use of adapted coordinates allow us to maintain sufficient grid resolution to an artificial outer boundary location which is causally disconnected from the measurement. For the well-studied test-case of the inspiral of an equal-mass non-spinning binary (evolved for more than 8 orbits before merger), we determine the phase and amplitude to numerical accuracies better than 0.010% and 0.090% during inspiral, respectively, and 0.003% and 0.153% during merger. The waveforms, including the resolved higher harmonics, are convergent and can be consistently extrapolated to $r\to\infty$ throughout the simulation, including the merger and ringdown. Ringdown frequencies for these modes (to $(\ell,m)=(6,6)$) match perturbative calculations to within 0.01%, providing a strong confirmation that the remnant settles to a Kerr black hole with irreducible mass $M_{\rm irr} = 0.884355\pm20\times10^{-6}$ and spin $S_f/M_f^2 = 0.686923 \pm 10\times10^{-6}$

preprint2009arXiv

Status of NINJA: the Numerical INJection Analysis project

The 2008 NRDA conference introduced the Numerical INJection Analysis project (NINJA), a new collaborative effort between the numerical relativity community and the data analysis community. NINJA focuses on modeling and searching for gravitational wave signatures from the coalescence of binary system of compact objects. We review the scope of this collaboration and the components of the first NINJA project, where numerical relativity groups shared waveforms and data analysis teams applied various techniques to detect them when embedded in colored Gaussian noise.

preprint2009arXiv

Testing gravitational-wave searches with numerical relativity waveforms: Results from the first Numerical INJection Analysis (NINJA) project

The Numerical INJection Analysis (NINJA) project is a collaborative effort between members of the numerical relativity and gravitational-wave data analysis communities. The purpose of NINJA is to study the sensitivity of existing gravitational-wave search algorithms using numerically generated waveforms and to foster closer collaboration between the numerical relativity and data analysis communities. We describe the results of the first NINJA analysis which focused on gravitational waveforms from binary black hole coalescence. Ten numerical relativity groups contributed numerical data which were used to generate a set of gravitational-wave signals. These signals were injected into a simulated data set, designed to mimic the response of the Initial LIGO and Virgo gravitational-wave detectors. Nine groups analysed this data using search and parameter-estimation pipelines. Matched filter algorithms, un-modelled-burst searches and Bayesian parameter-estimation and model-selection algorithms were applied to the data. We report the efficiency of these search methods in detecting the numerical waveforms and measuring their parameters. We describe preliminary comparisons between the different search methods and suggest improvements for future NINJA analyses.

preprint2009arXiv

Turduckening black holes: an analytical and computational study

We provide a detailed analysis of several aspects of the turduckening technique for evolving black holes. At the analytical level we study the constraint propagation for a general family of BSSN-type formulation of Einstein's field equations and identify under what conditions the turducken procedure is rigorously justified and under what conditions constraint violations will propagate to the outside of the black holes. We present high-resolution spherically symmetric studies which verify our analytical predictions. Then we present three dimensional simulations of single distorted black holes using different variations of the turduckening method and also the puncture method. We study the effect that these different methods have on the coordinate conditions, constraint violations, and extracted gravitational waves. We find that the waves agree up to small but non-vanishing differences, caused by escaping superluminal gauge modes. These differences become smaller with increasing detector location.

preprint2008arXiv

Spin Diagrams for Equal-Mass Black-Hole Binaries with Aligned Spins

Binary black-hole systems with spins aligned with the orbital angular momentum are of special interest as they may be the preferred end-state of the inspiral of generic supermassive binary black-hole systems. In view of this, we have computed the inspiral and merger of a large set of binary systems of equal-mass black holes with spins aligned with the orbital angular momentum but otherwise arbitrary. By least-square fitting the results of these simulations we have constructed two "spin diagrams" which provide straightforward information about the recoil velocity |v_kick| and the final black-hole spin a_fin in terms of the dimensionless spins a_1 and a_2 of the two initial black holes. Overall they suggest a maximum recoil velocity of |v_kick|=441.94 km/s, and minimum and maximum final spins a_fin=0.3471 and a_fin=0.9591, respectively.

preprint2007arXiv

Fragmentation of general relativistic quasi-toroidal polytropes

We investigate the role of rotational instabilities in the context of black hole formation in relativistic stars. In addition to the standard scenario - an axially symmetric dynamical instability forming a horizon at the star's center - the recently found low-$T/|W|$ instabilities are shown to lead to fragmentation and off-center horizon formation in differentially rotating stars. This process might be an alternative pathway to produce SMBHs from supermassive stars with inefficient angular momentum transport.

preprint2007arXiv

Multi-patch methods in general relativistic astrophysics - I. Hydrodynamical flows on fixed backgrounds

Many systems of interest in general relativistic astrophysics, including neutron stars, accreting compact objects in X-ray binaries and active galactic nuclei, core collapse, and collapsars, are assumed to be approximately spherically symmetric or axisymmetric. In Newtonian or fixed-background relativistic approximations it is common practice to use spherical polar coordinates for computational grids; however, these coordinates have singularities and are difficult to use in fully relativistic models. We present, in this series of papers, a numerical technique which is able to use effectively spherical grids by employing multiple patches. We provide detailed instructions on how to implement such a scheme, and present a number of code tests for the fixed background case, including an accretion torus around a black hole.

preprint2007arXiv

Recoil Velocities from Equal-Mass Binary-Black-Hole Mergers

The final evolution of a binary black-hole system gives rise to a recoil velocity if an asymmetry is present in the emitted gravitational radiation. Measurements of this effect for non-spinning binaries with unequal masses have pointed out that kick velocities $\sim~175$ km/s can be reached for a mass ratio $\simeq 0.36$. However, a larger recoil can be obtained for equal-mass binaries if the asymmetry is provided by the spins. Using two independent methods we show that the merger of such binaries yields velocities as large as $\sim 440$ km/s for black holes having unequal spins that are antialigned and parallel to the orbital angular momentum.

preprint2006arXiv

A multi-block infrastructure for three-dimensional time-dependent numerical relativity

We describe a generic infrastructure for time evolution simulations in numerical relativity using multiple grid patches. After a motivation of this approach, we discuss the relative advantages of global and patch-local tensor bases. We describe both our multi-patch infrastructure and our time evolution scheme, and comment on adaptive time integrators and parallelisation. We also describe various patch system topologies that provide spherical outer and/or multiple inner boundaries. We employ penalty inter-patch boundary conditions, and we demonstrate the stability and accuracy of our three-dimensional implementation. We solve both a scalar wave equation on a stationary rotating black hole background and the full Einstein equations. For the scalar wave equation, we compare the effects of global and patch-local tensor bases, different finite differencing operators, and the effect of artificial dissipation onto stability and accuracy. We show that multi-patch systems can directly compete with the so-called fixed mesh refinement approach; however, one can also combine both. For the Einstein equations, we show that using multiple grid patches with penalty boundary conditions leads to a robustly stable system. We also show long-term stable and accurate evolutions of a one-dimensional non-linear gauge wave. Finally, we evolve weak gravitational waves in three dimensions and extract accurate waveforms, taking advantage of the spherical shape of our grid lines.

preprint2005arXiv

Black hole formation through fragmentation of toroidal polytropes

We investigate new paths to black hole formation by considering the general relativistic evolution of a differentially rotating polytrope with toroidal shape. We find that this polytrope is unstable to nonaxisymmetric modes, which leads to a fragmentation into self-gravitating, collapsing components. In the case of one such fragment, we apply a simplified adaptive mesh refinement technique to follow the evolution to the formation of an apparent horizon centered on the fragment. This is the first study of the one-armed instability in full general relativity.

preprint2004arXiv

Evolutions in 3D numerical relativity using fixed mesh refinement

We present results of 3D numerical simulations using a finite difference code featuring fixed mesh refinement (FMR), in which a subset of the computational domain is refined in space and time. We apply this code to a series of test cases including a robust stability test, a nonlinear gauge wave and an excised Schwarzschild black hole in an evolving gauge. We find that the mesh refinement results are comparable in accuracy, stability and convergence to unigrid simulations with the same effective resolution. At the same time, the use of FMR reduces the computational resources needed to obtain a given accuracy. Particular care must be taken at the interfaces between coarse and fine grids to avoid a loss of convergence at higher resolutions, and we introduce the use of "buffer zones" as one resolution of this issue. We also introduce a new method for initial data generation, which enables higher-order interpolation in time even from the initial time slice. This FMR system, "Carpet", is a driver module in the freely available Cactus computational infrastructure, and is able to endow generic existing Cactus simulation modules ("thorns") with FMR with little or no extra effort.

preprint2003arXiv

A modified SPH approach for fluids with large density differences

We introduce a modified SPH approach that is based on discretising the particle density instead of the mass density. This approach makes it possible to use SPH particles with very different masses to simulate multi-phase flows with large differences in mass density between the phases. We test our formulation with a simple advection problem, with sound waves encountering a density discontinuity, and with shock tubes containing a contact discontinuity between air and Diesel oil. For all examined problems where particles have different masses, the new formulation yields better results than standard SPH. This is also the case for problems in which different spatial resolutions are needed while the mass density does not change.

preprint2003arXiv

Finding apparent horizons and other two-surfaces of constant expansion

Apparent horizons are structures of spacelike hypersurfaces that can be determined locally in time. Closed surfaces of constant expansion (CE surfaces) are a generalisation of apparent horizons. I present an efficient method for locating CE surfaces. This method uses an explicit representation of the surface, allowing for arbitrary resolutions and, in principle, shapes. The CE surface equation is then solved as a nonlinear elliptic equation. It is reasonable to assume that CE surfaces foliate a spacelike hypersurface outside of some interior region, thus defining an invariant (but still slicing-dependent) radial coordinate. This can be used to determine gauge modes and to compare time evolutions with different gauge conditions. CE surfaces also provide an efficient way to find new apparent horizons as they appear e.g. in binary black hole simulations.